2024-08-24T20:59:45.328 INFO:root:teuthology version: 1.2.0 2024-08-24T20:59:45.345 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-24T20:59:45.433 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-08-17_20:48:17-krbd-main-testing-default-smithi/7858438 branch: main description: krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{crc-rxbounce} thrashers/mon-thrasher thrashosds-health workloads/krbd_diff_continuous} email: ceph-qa@ceph.com first_in_suite: false job_id: '7858438' kernel: flavor: default kdb: 1 sha1: 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 last_in_suite: false machine_type: smithi name: teuthology-2024-08-17_20:48:17-krbd-main-testing-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: conf: client: rbd default features: 37 rbd default map options: ms_mode=crc,rxbounce global: mon warn on pool no app: false ms die on skipped message: false mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(MON_DOWN\) - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - SLOW_OPS - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub sha1: 4887e20f48210b9f64d81c80656e954e16f399f3 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 4887e20f48210b9f64d81c80656e954e16f399f3 extra_system_packages: - pv thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 797669399b32d2915e64eb6d4b1257ae3c50f80b owner: scheduled_teuthology@teuthology priority: 950 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.c - mgr.x - osd.0 - osd.1 - osd.2 - osd.3 - - mon.b - mgr.y - osd.4 - osd.5 - osd.6 - osd.7 - - client.0 seed: 623 sha1: 4887e20f48210b9f64d81c80656e954e16f399f3 sleep_before_teardown: 0 subset: 3/4 suite: krbd suite_branch: main suite_path: /home/teuthworker/src/git.ceph.com_ceph_797669399b32d2915e64eb6d4b1257ae3c50f80b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 797669399b32d2915e64eb6d4b1257ae3c50f80b targets: smithi060.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPob2aapu0eI0yJWw5Us9xEdIDZr7ZIQNss1w9pTTZrIxos63aUodWq1JQDPWDdU7ScT8lEIqIs4M9olaGK6JtM= smithi119.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAXzs+lI1f4H9frj7elmKQ7YHIUnp5B+Ut/e2AZnUuGNmpCe2+LQCMgqMjFRKO74nGr/UtaosQE0DKPyIvqnNU8= smithi179.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMt35kufurQGUGaYOaFAVZsx0Pahs2/dKmDXBhGCmQGis4a8xthNk55ayTBSkn8JqT4XyWK0FdduhxOtB8tkxkI= tasks: - install: null - ceph: null - mon_thrash: revive_delay: 20 thrash_delay: 1 - workunit: clients: all: - rbd/diff_continuous.sh env: RBD_DEVICE_TYPE: krbd teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 67db276914d29505c9707d04f3a3b8fb9d8aee4b timestamp: 2024-08-17_20:48:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-08-24T20:59:45.433 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_797669399b32d2915e64eb6d4b1257ae3c50f80b/qa; will attempt to use it 2024-08-24T20:59:45.433 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_797669399b32d2915e64eb6d4b1257ae3c50f80b/qa/tasks 2024-08-24T20:59:45.433 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-08-24T20:59:45.435 INFO:teuthology.task.internal:Checking packages... 2024-08-24T20:59:45.454 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '4887e20f48210b9f64d81c80656e954e16f399f3' 2024-08-24T20:59:45.455 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-24T20:59:45.455 INFO:teuthology.packaging:ref: None 2024-08-24T20:59:45.455 INFO:teuthology.packaging:tag: None 2024-08-24T20:59:45.455 INFO:teuthology.packaging:branch: main 2024-08-24T20:59:45.455 INFO:teuthology.packaging:sha1: 4887e20f48210b9f64d81c80656e954e16f399f3 2024-08-24T20:59:45.455 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=main 2024-08-24T20:59:45.688 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-5971.gdb4959e4 2024-08-24T20:59:45.690 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-08-24T20:59:45.696 INFO:teuthology.task.internal:no buildpackages task found 2024-08-24T20:59:45.696 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-08-24T20:59:45.720 INFO:teuthology.task.internal:Saving configuration 2024-08-24T20:59:45.733 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-08-24T20:59:45.746 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-08-24T20:59:45.772 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi060.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-08-17_20:48:17-krbd-main-testing-default-smithi/7858438', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-24 20:54:14.951620', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPob2aapu0eI0yJWw5Us9xEdIDZr7ZIQNss1w9pTTZrIxos63aUodWq1JQDPWDdU7ScT8lEIqIs4M9olaGK6JtM='} 2024-08-24T20:59:45.796 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi119.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-08-17_20:48:17-krbd-main-testing-default-smithi/7858438', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-24 20:54:14.953362', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAXzs+lI1f4H9frj7elmKQ7YHIUnp5B+Ut/e2AZnUuGNmpCe2+LQCMgqMjFRKO74nGr/UtaosQE0DKPyIvqnNU8='} 2024-08-24T20:59:45.819 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi179.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-08-17_20:48:17-krbd-main-testing-default-smithi/7858438', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-24 20:54:14.954515', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMt35kufurQGUGaYOaFAVZsx0Pahs2/dKmDXBhGCmQGis4a8xthNk55ayTBSkn8JqT4XyWK0FdduhxOtB8tkxkI='} 2024-08-24T20:59:45.819 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-08-24T20:59:45.825 INFO:teuthology.task.internal:roles: ubuntu@smithi060.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2024-08-24T20:59:45.825 INFO:teuthology.task.internal:roles: ubuntu@smithi119.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-08-24T20:59:45.825 INFO:teuthology.task.internal:roles: ubuntu@smithi179.front.sepia.ceph.com - ['client.0'] 2024-08-24T20:59:45.825 INFO:teuthology.run_tasks:Running task console_log... 2024-08-24T20:59:45.936 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3b2a60b250>, signals=[15]) 2024-08-24T20:59:45.936 INFO:teuthology.run_tasks:Running task internal.connect... 2024-08-24T20:59:45.942 INFO:teuthology.task.internal:Opening connections... 2024-08-24T20:59:45.942 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi060.front.sepia.ceph.com 2024-08-24T20:59:45.943 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-24T20:59:46.021 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi119.front.sepia.ceph.com 2024-08-24T20:59:46.021 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-24T20:59:46.093 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi179.front.sepia.ceph.com 2024-08-24T20:59:46.093 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-24T20:59:46.166 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-08-24T20:59:46.173 DEBUG:teuthology.orchestra.run.smithi060:> uname -m 2024-08-24T20:59:46.191 INFO:teuthology.orchestra.run.smithi060.stdout:x86_64 2024-08-24T20:59:46.191 DEBUG:teuthology.orchestra.run.smithi060:> cat /etc/os-release 2024-08-24T20:59:46.247 INFO:teuthology.orchestra.run.smithi060.stdout:NAME="CentOS Stream" 2024-08-24T20:59:46.248 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION="9" 2024-08-24T20:59:46.248 INFO:teuthology.orchestra.run.smithi060.stdout:ID="centos" 2024-08-24T20:59:46.248 INFO:teuthology.orchestra.run.smithi060.stdout:ID_LIKE="rhel fedora" 2024-08-24T20:59:46.248 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_ID="9" 2024-08-24T20:59:46.248 INFO:teuthology.orchestra.run.smithi060.stdout:PLATFORM_ID="platform:el9" 2024-08-24T20:59:46.248 INFO:teuthology.orchestra.run.smithi060.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-24T20:59:46.248 INFO:teuthology.orchestra.run.smithi060.stdout:ANSI_COLOR="0;31" 2024-08-24T20:59:46.248 INFO:teuthology.orchestra.run.smithi060.stdout:LOGO="fedora-logo-icon" 2024-08-24T20:59:46.248 INFO:teuthology.orchestra.run.smithi060.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-24T20:59:46.248 INFO:teuthology.orchestra.run.smithi060.stdout:HOME_URL="https://centos.org/" 2024-08-24T20:59:46.248 INFO:teuthology.orchestra.run.smithi060.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-08-24T20:59:46.248 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-24T20:59:46.248 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-24T20:59:46.249 INFO:teuthology.lock.ops:Updating smithi060.front.sepia.ceph.com on lock server 2024-08-24T20:59:46.268 DEBUG:teuthology.orchestra.run.smithi119:> uname -m 2024-08-24T20:59:46.287 INFO:teuthology.orchestra.run.smithi119.stdout:x86_64 2024-08-24T20:59:46.287 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release 2024-08-24T20:59:46.345 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="CentOS Stream" 2024-08-24T20:59:46.345 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="9" 2024-08-24T20:59:46.346 INFO:teuthology.orchestra.run.smithi119.stdout:ID="centos" 2024-08-24T20:59:46.346 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="rhel fedora" 2024-08-24T20:59:46.346 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="9" 2024-08-24T20:59:46.346 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el9" 2024-08-24T20:59:46.346 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-24T20:59:46.346 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31" 2024-08-24T20:59:46.346 INFO:teuthology.orchestra.run.smithi119.stdout:LOGO="fedora-logo-icon" 2024-08-24T20:59:46.346 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-24T20:59:46.346 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://centos.org/" 2024-08-24T20:59:46.346 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-08-24T20:59:46.346 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-24T20:59:46.346 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-24T20:59:46.347 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server 2024-08-24T20:59:46.368 DEBUG:teuthology.orchestra.run.smithi179:> uname -m 2024-08-24T20:59:46.386 INFO:teuthology.orchestra.run.smithi179.stdout:x86_64 2024-08-24T20:59:46.386 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release 2024-08-24T20:59:46.445 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="CentOS Stream" 2024-08-24T20:59:46.445 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="9" 2024-08-24T20:59:46.445 INFO:teuthology.orchestra.run.smithi179.stdout:ID="centos" 2024-08-24T20:59:46.445 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE="rhel fedora" 2024-08-24T20:59:46.445 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="9" 2024-08-24T20:59:46.445 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM_ID="platform:el9" 2024-08-24T20:59:46.445 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-24T20:59:46.445 INFO:teuthology.orchestra.run.smithi179.stdout:ANSI_COLOR="0;31" 2024-08-24T20:59:46.446 INFO:teuthology.orchestra.run.smithi179.stdout:LOGO="fedora-logo-icon" 2024-08-24T20:59:46.446 INFO:teuthology.orchestra.run.smithi179.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-24T20:59:46.446 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://centos.org/" 2024-08-24T20:59:46.446 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-08-24T20:59:46.446 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-24T20:59:46.446 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-24T20:59:46.446 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2024-08-24T20:59:46.468 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-08-24T20:59:46.476 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-08-24T20:59:46.519 INFO:teuthology.task.internal:Checking for old test directory... 2024-08-24T20:59:46.519 DEBUG:teuthology.orchestra.run.smithi060:> test '!' -e /home/ubuntu/cephtest 2024-08-24T20:59:46.522 DEBUG:teuthology.orchestra.run.smithi119:> test '!' -e /home/ubuntu/cephtest 2024-08-24T20:59:46.524 DEBUG:teuthology.orchestra.run.smithi179:> test '!' -e /home/ubuntu/cephtest 2024-08-24T20:59:46.541 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-08-24T20:59:46.547 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-08-24T20:59:46.547 DEBUG:teuthology.orchestra.run.smithi060:> test -z $(ls -A /var/lib/ceph) 2024-08-24T20:59:46.579 DEBUG:teuthology.orchestra.run.smithi119:> test -z $(ls -A /var/lib/ceph) 2024-08-24T20:59:46.582 DEBUG:teuthology.orchestra.run.smithi179:> test -z $(ls -A /var/lib/ceph) 2024-08-24T20:59:46.605 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-08-24T20:59:46.684 INFO:teuthology.run_tasks:Running task kernel... 2024-08-24T20:59:46.697 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': 1, 'sha1': '7503b862ff5bc4e556b3daee1c7881aa3e90ed62'} 2024-08-24T20:59:46.697 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': 1, 'sha1': '7503b862ff5bc4e556b3daee1c7881aa3e90ed62'}, 'mon.b': {'flavor': 'default', 'kdb': 1, 'sha1': '7503b862ff5bc4e556b3daee1c7881aa3e90ed62'}, 'client.0': {'flavor': 'default', 'kdb': 1, 'sha1': '7503b862ff5bc4e556b3daee1c7881aa3e90ed62'}}, timeout 300 2024-08-24T20:59:46.697 DEBUG:teuthology.orchestra.run.smithi060:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-24T20:59:46.698 DEBUG:teuthology.orchestra.run.smithi119:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-24T20:59:46.699 DEBUG:teuthology.orchestra.run.smithi179:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-24T20:59:46.715 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-24T20:59:46.716 DEBUG:teuthology.task.kernel:sha1 for mon.b is 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-24T20:59:46.716 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "7503b862ff5bc4e556b3daee1c7881aa3e90ed62"... 2024-08-24T20:59:46.716 DEBUG:teuthology.orchestra.run.smithi119:> uname -r 2024-08-24T20:59:46.717 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-24T20:59:46.717 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-24T20:59:46.718 DEBUG:teuthology.task.kernel:sha1 for client.0 is 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-24T20:59:46.718 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "7503b862ff5bc4e556b3daee1c7881aa3e90ed62"... 2024-08-24T20:59:46.718 DEBUG:teuthology.orchestra.run.smithi179:> uname -r 2024-08-24T20:59:46.718 DEBUG:teuthology.task.kernel:sha1 for mon.a is 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-24T20:59:46.719 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "7503b862ff5bc4e556b3daee1c7881aa3e90ed62"... 2024-08-24T20:59:46.719 DEBUG:teuthology.orchestra.run.smithi060:> uname -r 2024-08-24T20:59:46.773 INFO:teuthology.orchestra.run.smithi119.stdout:5.14.0-496.el9.x86_64 2024-08-24T20:59:46.773 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-496.el9.x86_64 vs 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-24T20:59:46.773 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-08-24T20:59:46.773 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-24T20:59:46.777 INFO:teuthology.orchestra.run.smithi179.stdout:5.14.0-496.el9.x86_64 2024-08-24T20:59:46.777 INFO:teuthology.orchestra.run.smithi060.stdout:5.14.0-496.el9.x86_64 2024-08-24T20:59:46.778 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-496.el9.x86_64 vs 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-24T20:59:46.778 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-08-24T20:59:46.778 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-24T20:59:46.779 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-496.el9.x86_64 vs 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-24T20:59:46.779 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-08-24T20:59:46.779 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-24T20:59:46.913 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum upgrade -y linux-firmware 2024-08-24T20:59:46.925 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum upgrade -y linux-firmware 2024-08-24T20:59:46.930 DEBUG:teuthology.orchestra.run.smithi179:> sudo yum upgrade -y linux-firmware 2024-08-24T20:59:49.253 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.2 MB 00:00 2024-08-24T20:59:49.293 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.2 MB 00:00 2024-08-24T20:59:49.559 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.2 MB 00:00 2024-08-24T20:59:50.996 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - AppStream 31 MB/s | 20 MB 00:00 2024-08-24T20:59:52.468 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - AppStream 11 MB/s | 20 MB 00:01 2024-08-24T20:59:53.518 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 9 - AppStream 6.5 MB/s | 20 MB 00:03 2024-08-24T20:59:55.930 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - CRB 5.5 MB/s | 6.6 MB 00:01 2024-08-24T20:59:57.522 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - Extras packages 77 kB/s | 18 kB 00:00 2024-08-24T20:59:57.985 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - CRB 4.0 MB/s | 6.6 MB 00:01 2024-08-24T20:59:58.418 INFO:teuthology.orchestra.run.smithi119.stdout:Extra Packages for Enterprise Linux 29 MB/s | 22 MB 00:00 2024-08-24T20:59:59.511 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - Extras packages 89 kB/s | 18 kB 00:00 2024-08-24T20:59:59.902 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 9 - CRB 2.5 MB/s | 6.6 MB 00:02 2024-08-24T21:00:00.357 INFO:teuthology.orchestra.run.smithi060.stdout:Extra Packages for Enterprise Linux 31 MB/s | 22 MB 00:00 2024-08-24T21:00:01.786 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 9 - Extras packages 35 kB/s | 18 kB 00:00 2024-08-24T21:00:02.840 INFO:teuthology.orchestra.run.smithi179.stdout:Extra Packages for Enterprise Linux 24 MB/s | 22 MB 00:00 2024-08-24T21:00:03.965 INFO:teuthology.orchestra.run.smithi119.stdout:lab-extras 25 kB/s | 1.7 kB 00:00 2024-08-24T21:00:05.904 INFO:teuthology.orchestra.run.smithi060.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-08-24T21:00:05.963 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-08-24T21:00:05.964 INFO:teuthology.orchestra.run.smithi119.stdout:Nothing to do. 2024-08-24T21:00:05.964 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-08-24T21:00:06.073 INFO:teuthology.task.kernel:Downloading kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on mon.b... 2024-08-24T21:00:06.074 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-24T21:00:06.220 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ 2024-08-24T21:00:06.221 DEBUG:teuthology.orchestra.run.smithi119:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ --input-file=- 2024-08-24T21:00:06.223 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi119.front.sepia.ceph.com to complete... 2024-08-24T21:00:08.058 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-08-24T21:00:08.059 INFO:teuthology.orchestra.run.smithi060.stdout:Nothing to do. 2024-08-24T21:00:08.059 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-08-24T21:00:08.162 INFO:teuthology.task.kernel:Downloading kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on mon.a... 2024-08-24T21:00:08.163 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-24T21:00:08.230 INFO:teuthology.orchestra.run.smithi179.stdout:lab-extras 50 kB/s | 1.7 kB 00:00 2024-08-24T21:00:08.304 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ 2024-08-24T21:00:08.304 DEBUG:teuthology.orchestra.run.smithi060:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ --input-file=- 2024-08-24T21:00:08.307 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi060.front.sepia.ceph.com to complete... 2024-08-24T21:00:10.199 INFO:teuthology.orchestra.run.smithi179.stdout:Dependencies resolved. 2024-08-24T21:00:10.200 INFO:teuthology.orchestra.run.smithi179.stdout:Nothing to do. 2024-08-24T21:00:10.200 INFO:teuthology.orchestra.run.smithi179.stdout:Complete! 2024-08-24T21:00:10.307 INFO:teuthology.task.kernel:Downloading kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.0... 2024-08-24T21:00:10.307 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-24T21:00:10.451 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ 2024-08-24T21:00:10.451 DEBUG:teuthology.orchestra.run.smithi179:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ --input-file=- 2024-08-24T21:00:10.454 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi179.front.sepia.ceph.com to complete... 2024-08-24T21:00:14.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-24 21:00:14 URL:https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm [360536130/360536130] -> "/tmp/kernel.x86_64.rpm" [1] 2024-08-24T21:00:14.802 INFO:teuthology.orchestra.run.smithi119.stderr:FINISHED --2024-08-24 21:00:14-- 2024-08-24T21:00:14.802 INFO:teuthology.orchestra.run.smithi119.stderr:Total wall clock time: 8.5s 2024-08-24T21:00:14.802 INFO:teuthology.orchestra.run.smithi119.stderr:Downloaded: 1 files, 344M in 8.3s (41.7 MB/s) 2024-08-24T21:00:14.805 INFO:teuthology.task.kernel:Installing kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on mon.b... 2024-08-24T21:00:14.805 DEBUG:teuthology.orchestra.run.smithi119:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-08-24T21:00:16.949 INFO:teuthology.orchestra.run.smithi119.stdout:Verifying... ######################################## 2024-08-24T21:00:17.129 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing... ######################################## 2024-08-24T21:00:17.252 INFO:teuthology.orchestra.run.smithi119.stdout:Updating / installing... 2024-08-24T21:00:18.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-08-24 21:00:18 URL:https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm [360536130/360536130] -> "/tmp/kernel.x86_64.rpm" [1] 2024-08-24T21:00:18.919 INFO:teuthology.orchestra.run.smithi060.stderr:FINISHED --2024-08-24 21:00:18-- 2024-08-24T21:00:18.919 INFO:teuthology.orchestra.run.smithi060.stderr:Total wall clock time: 11s 2024-08-24T21:00:18.920 INFO:teuthology.orchestra.run.smithi060.stderr:Downloaded: 1 files, 344M in 10s (33.8 MB/s) 2024-08-24T21:00:18.922 INFO:teuthology.task.kernel:Installing kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on mon.a... 2024-08-24T21:00:18.922 DEBUG:teuthology.orchestra.run.smithi060:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-08-24T21:00:21.145 INFO:teuthology.orchestra.run.smithi060.stdout:Verifying... ######################################## 2024-08-24T21:00:21.312 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing... ######################################## 2024-08-24T21:00:21.412 INFO:teuthology.orchestra.run.smithi060.stdout:Updating / installing... 2024-08-24T21:00:25.288 INFO:teuthology.orchestra.run.smithi119.stdout:kernel-6.11.0_rc3_g7503b862ff5b-1 ######################################## 2024-08-24T21:00:29.754 INFO:teuthology.orchestra.run.smithi060.stdout:kernel-6.11.0_rc3_g7503b862ff5b-1 ######################################## 2024-08-24T21:01:05.254 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi119.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-08-24T21:01:05.254 DEBUG:teuthology.orchestra.run.smithi119:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-08-24T21:01:05.338 INFO:teuthology.orchestra.run.smithi119.stdout:/boot/System.map-6.11.0-rc3-g7503b862ff5b 2024-08-24T21:01:05.339 INFO:teuthology.orchestra.run.smithi119.stdout:/boot/config-6.11.0-rc3-g7503b862ff5b 2024-08-24T21:01:05.339 INFO:teuthology.orchestra.run.smithi119.stdout:/boot/vmlinuz-6.11.0-rc3-g7503b862ff5b 2024-08-24T21:01:05.339 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b 2024-08-24T21:01:05.339 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/System.map 2024-08-24T21:01:05.339 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/config 2024-08-24T21:01:05.339 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel 2024-08-24T21:01:05.339 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch 2024-08-24T21:01:05.339 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86 2024-08-24T21:01:05.339 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto 2024-08-24T21:01:05.339 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-08-24T21:01:05.339 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-08-24T21:01:05.340 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-08-24T21:01:05.340 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-08-24T21:01:05.340 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-08-24T21:01:05.340 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-08-24T21:01:05.340 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-08-24T21:01:05.340 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32c-intel.ko 2024-08-24T21:01:05.340 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-08-24T21:01:05.340 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-08-24T21:01:05.340 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-08-24T21:01:05.340 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-08-24T21:01:05.340 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx2.ko 2024-08-24T21:01:05.340 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-08-24T21:01:05.341 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-08-24T21:01:05.341 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-08-24T21:01:05.341 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-08-24T21:01:05.341 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-08-24T21:01:05.341 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-08-24T21:01:05.341 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-08-24T21:01:05.341 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel 2024-08-24T21:01:05.341 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu 2024-08-24T21:01:05.341 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce 2024-08-24T21:01:05.341 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-08-24T21:01:05.341 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm 2024-08-24T21:01:05.341 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-amd.ko 2024-08-24T21:01:05.341 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-intel.ko 2024-08-24T21:01:05.342 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm.ko 2024-08-24T21:01:05.342 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto 2024-08-24T21:01:05.342 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ansi_cprng.ko 2024-08-24T21:01:05.342 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/anubis.ko 2024-08-24T21:01:05.342 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/arc4.ko 2024-08-24T21:01:05.342 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx 2024-08-24T21:01:05.342 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_memcpy.ko 2024-08-24T21:01:05.342 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_pq.ko 2024-08-24T21:01:05.342 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_raid6_recov.ko 2024-08-24T21:01:05.342 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_tx.ko 2024-08-24T21:01:05.342 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_xor.ko 2024-08-24T21:01:05.342 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/raid6test.ko 2024-08-24T21:01:05.343 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authenc.ko 2024-08-24T21:01:05.343 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authencesn.ko 2024-08-24T21:01:05.343 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blake2b_generic.ko 2024-08-24T21:01:05.343 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_common.ko 2024-08-24T21:01:05.343 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_generic.ko 2024-08-24T21:01:05.343 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/camellia_generic.ko 2024-08-24T21:01:05.343 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast5_generic.ko 2024-08-24T21:01:05.343 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast6_generic.ko 2024-08-24T21:01:05.343 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast_common.ko 2024-08-24T21:01:05.343 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ccm.ko 2024-08-24T21:01:05.343 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cmac.ko 2024-08-24T21:01:05.344 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crc32_generic.ko 2024-08-24T21:01:05.344 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_engine.ko 2024-08-24T21:01:05.344 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_user.ko 2024-08-24T21:01:05.344 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cts.ko 2024-08-24T21:01:05.344 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/des_generic.ko 2024-08-24T21:01:05.344 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/dh_generic.ko 2024-08-24T21:01:05.344 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecc.ko 2024-08-24T21:01:05.344 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecdh_generic.ko 2024-08-24T21:01:05.344 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/echainiv.ko 2024-08-24T21:01:05.344 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/essiv.ko 2024-08-24T21:01:05.344 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/fcrypt.ko 2024-08-24T21:01:05.344 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/khazad.ko 2024-08-24T21:01:05.344 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4.ko 2024-08-24T21:01:05.344 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4hc.ko 2024-08-24T21:01:05.345 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/md4.ko 2024-08-24T21:01:05.345 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/michael_mic.ko 2024-08-24T21:01:05.345 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcbc.ko 2024-08-24T21:01:05.345 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcrypt.ko 2024-08-24T21:01:05.345 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/rmd160.ko 2024-08-24T21:01:05.345 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/seed.ko 2024-08-24T21:01:05.345 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/serpent_generic.ko 2024-08-24T21:01:05.345 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tcrypt.ko 2024-08-24T21:01:05.345 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tea.ko 2024-08-24T21:01:05.345 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_common.ko 2024-08-24T21:01:05.345 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_generic.ko 2024-08-24T21:01:05.345 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/vmac.ko 2024-08-24T21:01:05.345 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/wp512.ko 2024-08-24T21:01:05.346 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xcbc.ko 2024-08-24T21:01:05.346 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xor.ko 2024-08-24T21:01:05.346 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xxhash_generic.ko 2024-08-24T21:01:05.346 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers 2024-08-24T21:01:05.346 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi 2024-08-24T21:01:05.346 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_ipmi.ko 2024-08-24T21:01:05.346 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_pad.ko 2024-08-24T21:01:05.346 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/ec_sys.ko 2024-08-24T21:01:05.346 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/platform_profile.ko 2024-08-24T21:01:05.346 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbs.ko 2024-08-24T21:01:05.346 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbshc.ko 2024-08-24T21:01:05.347 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/video.ko 2024-08-24T21:01:05.347 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata 2024-08-24T21:01:05.347 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/acard-ahci.ko 2024-08-24T21:01:05.347 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ahci_platform.ko 2024-08-24T21:01:05.347 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ata_generic.ko 2024-08-24T21:01:05.347 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/libahci_platform.ko 2024-08-24T21:01:05.347 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_acpi.ko 2024-08-24T21:01:05.347 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ali.ko 2024-08-24T21:01:05.347 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_amd.ko 2024-08-24T21:01:05.347 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_artop.ko 2024-08-24T21:01:05.348 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atiixp.ko 2024-08-24T21:01:05.348 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atp867x.ko 2024-08-24T21:01:05.348 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd640.ko 2024-08-24T21:01:05.348 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd64x.ko 2024-08-24T21:01:05.348 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cypress.ko 2024-08-24T21:01:05.348 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_efar.ko 2024-08-24T21:01:05.348 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt366.ko 2024-08-24T21:01:05.348 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt37x.ko 2024-08-24T21:01:05.348 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x2n.ko 2024-08-24T21:01:05.348 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x3.ko 2024-08-24T21:01:05.348 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it8213.ko 2024-08-24T21:01:05.348 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it821x.ko 2024-08-24T21:01:05.349 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_jmicron.ko 2024-08-24T21:01:05.349 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_marvell.ko 2024-08-24T21:01:05.349 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_mpiix.ko 2024-08-24T21:01:05.349 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_netcell.ko 2024-08-24T21:01:05.349 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ninja32.ko 2024-08-24T21:01:05.349 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87410.ko 2024-08-24T21:01:05.349 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87415.ko 2024-08-24T21:01:05.349 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_oldpiix.ko 2024-08-24T21:01:05.349 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_opti.ko 2024-08-24T21:01:05.349 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_optidma.ko 2024-08-24T21:01:05.349 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pcmcia.ko 2024-08-24T21:01:05.349 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc2027x.ko 2024-08-24T21:01:05.349 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-08-24T21:01:05.349 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_piccolo.ko 2024-08-24T21:01:05.350 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_rdc.ko 2024-08-24T21:01:05.350 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sch.ko 2024-08-24T21:01:05.350 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_serverworks.ko 2024-08-24T21:01:05.350 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sil680.ko 2024-08-24T21:01:05.350 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sis.ko 2024-08-24T21:01:05.350 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sl82c105.ko 2024-08-24T21:01:05.350 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_triflex.ko 2024-08-24T21:01:05.350 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_via.ko 2024-08-24T21:01:05.350 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pdc_adma.ko 2024-08-24T21:01:05.350 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_inic162x.ko 2024-08-24T21:01:05.350 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_mv.ko 2024-08-24T21:01:05.351 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_nv.ko 2024-08-24T21:01:05.351 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_promise.ko 2024-08-24T21:01:05.351 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_qstor.ko 2024-08-24T21:01:05.351 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil.ko 2024-08-24T21:01:05.351 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil24.ko 2024-08-24T21:01:05.351 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sis.ko 2024-08-24T21:01:05.351 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_svw.ko 2024-08-24T21:01:05.351 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sx4.ko 2024-08-24T21:01:05.351 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_uli.ko 2024-08-24T21:01:05.351 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_via.ko 2024-08-24T21:01:05.351 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_vsc.ko 2024-08-24T21:01:05.352 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay 2024-08-24T21:01:05.352 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay/ks0108.ko 2024-08-24T21:01:05.352 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base 2024-08-24T21:01:05.352 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap 2024-08-24T21:01:05.352 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-i2c.ko 2024-08-24T21:01:05.352 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-mmio.ko 2024-08-24T21:01:05.352 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma 2024-08-24T21:01:05.352 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma/bcma.ko 2024-08-24T21:01:05.352 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block 2024-08-24T21:01:05.352 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe 2024-08-24T21:01:05.352 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe/aoe.ko 2024-08-24T21:01:05.352 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/brd.ko 2024-08-24T21:01:05.353 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd 2024-08-24T21:01:05.353 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd/drbd.ko 2024-08-24T21:01:05.353 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/floppy.ko 2024-08-24T21:01:05.353 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/loop.ko 2024-08-24T21:01:05.353 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx 2024-08-24T21:01:05.353 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-08-24T21:01:05.353 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/nbd.ko 2024-08-24T21:01:05.353 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk 2024-08-24T21:01:05.353 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk/null_blk.ko 2024-08-24T21:01:05.353 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/pktcdvd.ko 2024-08-24T21:01:05.353 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/rbd.ko 2024-08-24T21:01:05.353 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/virtio_blk.ko 2024-08-24T21:01:05.353 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback 2024-08-24T21:01:05.354 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-08-24T21:01:05.354 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkfront.ko 2024-08-24T21:01:05.354 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram 2024-08-24T21:01:05.354 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram/zram.ko 2024-08-24T21:01:05.354 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char 2024-08-24T21:01:05.354 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hangcheck-timer.ko 2024-08-24T21:01:05.354 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random 2024-08-24T21:01:05.354 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/amd-rng.ko 2024-08-24T21:01:05.354 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/intel-rng.ko 2024-08-24T21:01:05.354 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-08-24T21:01:05.354 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/via-rng.ko 2024-08-24T21:01:05.354 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/virtio-rng.ko 2024-08-24T21:01:05.355 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi 2024-08-24T21:01:05.355 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-08-24T21:01:05.355 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-08-24T21:01:05.355 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-08-24T21:01:05.355 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_si.ko 2024-08-24T21:01:05.355 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-08-24T21:01:05.355 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-08-24T21:01:05.355 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/lp.ko 2024-08-24T21:01:05.355 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave 2024-08-24T21:01:05.355 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave/mwave.ko 2024-08-24T21:01:05.355 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ppdev.ko 2024-08-24T21:01:05.355 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tlclk.ko 2024-08-24T21:01:05.355 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm 2024-08-24T21:01:05.355 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm.ko 2024-08-24T21:01:05.356 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_atmel.ko 2024-08-24T21:01:05.356 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_infineon.ko 2024-08-24T21:01:05.356 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_nsc.ko 2024-08-24T21:01:05.356 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis.ko 2024-08-24T21:01:05.356 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-08-24T21:01:05.356 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/uv_mmtimer.ko 2024-08-24T21:01:05.356 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/virtio_console.ko 2024-08-24T21:01:05.356 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq 2024-08-24T21:01:05.356 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-08-24T21:01:05.356 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-08-24T21:01:05.356 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/p4-clockmod.ko 2024-08-24T21:01:05.356 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-08-24T21:01:05.356 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/powernow-k8.ko 2024-08-24T21:01:05.357 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/speedstep-lib.ko 2024-08-24T21:01:05.357 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto 2024-08-24T21:01:05.357 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp 2024-08-24T21:01:05.357 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-08-24T21:01:05.357 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp.ko 2024-08-24T21:01:05.357 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel 2024-08-24T21:01:05.357 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat 2024-08-24T21:01:05.357 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common 2024-08-24T21:01:05.357 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-08-24T21:01:05.357 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-08-24T21:01:05.357 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-08-24T21:01:05.357 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-aes.ko 2024-08-24T21:01:05.357 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-sha.ko 2024-08-24T21:01:05.358 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio 2024-08-24T21:01:05.358 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-08-24T21:01:05.358 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca 2024-08-24T21:01:05.358 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca/dca.ko 2024-08-24T21:01:05.358 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq 2024-08-24T21:01:05.358 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-08-24T21:01:05.358 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma 2024-08-24T21:01:05.358 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw 2024-08-24T21:01:05.358 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw/dw_dmac.ko 2024-08-24T21:01:05.358 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat 2024-08-24T21:01:05.358 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat/ioatdma.ko 2024-08-24T21:01:05.358 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac 2024-08-24T21:01:05.359 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/amd64_edac.ko 2024-08-24T21:01:05.359 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/e752x_edac.ko 2024-08-24T21:01:05.359 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/edac_mce_amd.ko 2024-08-24T21:01:05.359 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3000_edac.ko 2024-08-24T21:01:05.359 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3200_edac.ko 2024-08-24T21:01:05.359 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5100_edac.ko 2024-08-24T21:01:05.359 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5400_edac.ko 2024-08-24T21:01:05.359 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7300_edac.ko 2024-08-24T21:01:05.359 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7core_edac.ko 2024-08-24T21:01:05.359 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i82975x_edac.ko 2024-08-24T21:01:05.359 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/ie31200_edac.ko 2024-08-24T21:01:05.359 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/sb_edac.ko 2024-08-24T21:01:05.360 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/x38_edac.ko 2024-08-24T21:01:05.360 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware 2024-08-24T21:01:05.360 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/edd.ko 2024-08-24T21:01:05.360 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/iscsi_ibft.ko 2024-08-24T21:01:05.360 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio 2024-08-24T21:01:05.360 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-ich.ko 2024-08-24T21:01:05.360 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-viperboard.ko 2024-08-24T21:01:05.360 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid 2024-08-24T21:01:05.360 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-appleir.ko 2024-08-24T21:01:05.360 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-aureal.ko 2024-08-24T21:01:05.360 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-axff.ko 2024-08-24T21:01:05.360 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-dr.ko 2024-08-24T21:01:05.361 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elecom.ko 2024-08-24T21:01:05.361 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elo.ko 2024-08-24T21:01:05.361 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-emsff.ko 2024-08-24T21:01:05.361 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gaff.ko 2024-08-24T21:01:05.361 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gt683r.ko 2024-08-24T21:01:05.361 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gyration.ko 2024-08-24T21:01:05.361 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-kbd.ko 2024-08-24T21:01:05.361 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-mouse.ko 2024-08-24T21:01:05.361 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtekff.ko 2024-08-24T21:01:05.361 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-hyperv.ko 2024-08-24T21:01:05.361 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-icade.ko 2024-08-24T21:01:05.361 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-keytouch.ko 2024-08-24T21:01:05.361 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-kye.ko 2024-08-24T21:01:05.362 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lcpower.ko 2024-08-24T21:01:05.362 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-led.ko 2024-08-24T21:01:05.362 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lenovo.ko 2024-08-24T21:01:05.362 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-dj.ko 2024-08-24T21:01:05.362 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-08-24T21:01:05.362 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-multitouch.ko 2024-08-24T21:01:05.362 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-ortek.ko 2024-08-24T21:01:05.362 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-penmount.ko 2024-08-24T21:01:05.362 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-petalynx.ko 2024-08-24T21:01:05.362 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-picolcd.ko 2024-08-24T21:01:05.362 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-pl.ko 2024-08-24T21:01:05.362 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-plantronics.ko 2024-08-24T21:01:05.362 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-primax.ko 2024-08-24T21:01:05.362 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-rmi.ko 2024-08-24T21:01:05.363 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-arvo.ko 2024-08-24T21:01:05.363 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-common.ko 2024-08-24T21:01:05.363 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-isku.ko 2024-08-24T21:01:05.363 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kone.ko 2024-08-24T21:01:05.363 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-08-24T21:01:05.363 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-konepure.ko 2024-08-24T21:01:05.363 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-08-24T21:01:05.363 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-lua.ko 2024-08-24T21:01:05.363 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-pyra.ko 2024-08-24T21:01:05.363 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-ryos.ko 2024-08-24T21:01:05.363 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-savu.ko 2024-08-24T21:01:05.363 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat.ko 2024-08-24T21:01:05.364 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-saitek.ko 2024-08-24T21:01:05.364 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-samsung.ko 2024-08-24T21:01:05.364 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sensor-hub.ko 2024-08-24T21:01:05.364 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sjoy.ko 2024-08-24T21:01:05.364 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sony.ko 2024-08-24T21:01:05.364 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-speedlink.ko 2024-08-24T21:01:05.364 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-steelseries.ko 2024-08-24T21:01:05.364 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sunplus.ko 2024-08-24T21:01:05.364 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-thrustmaster.ko 2024-08-24T21:01:05.364 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tivo.ko 2024-08-24T21:01:05.364 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tmff.ko 2024-08-24T21:01:05.364 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-topseed.ko 2024-08-24T21:01:05.364 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-twinhan.ko 2024-08-24T21:01:05.365 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-uclogic.ko 2024-08-24T21:01:05.365 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-waltop.ko 2024-08-24T21:01:05.365 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-wiimote.ko 2024-08-24T21:01:05.365 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-xinmo.ko 2024-08-24T21:01:05.365 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zpff.ko 2024-08-24T21:01:05.365 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zydacron.ko 2024-08-24T21:01:05.365 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/uhid.ko 2024-08-24T21:01:05.365 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/wacom.ko 2024-08-24T21:01:05.365 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv 2024-08-24T21:01:05.365 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_balloon.ko 2024-08-24T21:01:05.365 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_utils.ko 2024-08-24T21:01:05.365 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_vmbus.ko 2024-08-24T21:01:05.365 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon 2024-08-24T21:01:05.366 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru.ko 2024-08-24T21:01:05.366 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru3.ko 2024-08-24T21:01:05.366 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/acpi_power_meter.ko 2024-08-24T21:01:05.366 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7414.ko 2024-08-24T21:01:05.366 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7418.ko 2024-08-24T21:01:05.366 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adc128d818.ko 2024-08-24T21:01:05.366 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1025.ko 2024-08-24T21:01:05.366 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1026.ko 2024-08-24T21:01:05.366 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1029.ko 2024-08-24T21:01:05.366 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1031.ko 2024-08-24T21:01:05.366 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm9240.ko 2024-08-24T21:01:05.366 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ads7828.ko 2024-08-24T21:01:05.366 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7410.ko 2024-08-24T21:01:05.367 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7411.ko 2024-08-24T21:01:05.367 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7462.ko 2024-08-24T21:01:05.367 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7470.ko 2024-08-24T21:01:05.367 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7475.ko 2024-08-24T21:01:05.367 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7x10.ko 2024-08-24T21:01:05.367 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/amc6821.ko 2024-08-24T21:01:05.367 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/applesmc.ko 2024-08-24T21:01:05.367 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asb100.ko 2024-08-24T21:01:05.367 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asc7621.ko 2024-08-24T21:01:05.367 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asus_atk0110.ko 2024-08-24T21:01:05.367 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/atxp1.ko 2024-08-24T21:01:05.367 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/coretemp.ko 2024-08-24T21:01:05.368 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-08-24T21:01:05.368 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dme1737.ko 2024-08-24T21:01:05.368 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds1621.ko 2024-08-24T21:01:05.368 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds620.ko 2024-08-24T21:01:05.368 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc1403.ko 2024-08-24T21:01:05.368 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc6w201.ko 2024-08-24T21:01:05.368 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71805f.ko 2024-08-24T21:01:05.368 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71882fg.ko 2024-08-24T21:01:05.368 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f75375s.ko 2024-08-24T21:01:05.368 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fam15h_power.ko 2024-08-24T21:01:05.368 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fschmd.ko 2024-08-24T21:01:05.368 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g760a.ko 2024-08-24T21:01:05.368 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g762.ko 2024-08-24T21:01:05.369 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl518sm.ko 2024-08-24T21:01:05.369 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl520sm.ko 2024-08-24T21:01:05.369 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/hwmon-vid.ko 2024-08-24T21:01:05.369 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5500_temp.ko 2024-08-24T21:01:05.369 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5k_amb.ko 2024-08-24T21:01:05.369 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmaem.ko 2024-08-24T21:01:05.369 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmpex.ko 2024-08-24T21:01:05.369 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina209.ko 2024-08-24T21:01:05.369 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina2xx.ko 2024-08-24T21:01:05.369 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/it87.ko 2024-08-24T21:01:05.369 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k10temp.ko 2024-08-24T21:01:05.369 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k8temp.ko 2024-08-24T21:01:05.369 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lineage-pem.ko 2024-08-24T21:01:05.370 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm63.ko 2024-08-24T21:01:05.370 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm73.ko 2024-08-24T21:01:05.370 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm75.ko 2024-08-24T21:01:05.370 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm77.ko 2024-08-24T21:01:05.370 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm78.ko 2024-08-24T21:01:05.370 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm80.ko 2024-08-24T21:01:05.370 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm83.ko 2024-08-24T21:01:05.370 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm85.ko 2024-08-24T21:01:05.370 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm87.ko 2024-08-24T21:01:05.370 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm90.ko 2024-08-24T21:01:05.370 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm92.ko 2024-08-24T21:01:05.370 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm93.ko 2024-08-24T21:01:05.370 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95234.ko 2024-08-24T21:01:05.371 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95241.ko 2024-08-24T21:01:05.371 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95245.ko 2024-08-24T21:01:05.371 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc2945.ko 2024-08-24T21:01:05.371 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4151.ko 2024-08-24T21:01:05.371 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4215.ko 2024-08-24T21:01:05.371 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4222.ko 2024-08-24T21:01:05.371 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4245.ko 2024-08-24T21:01:05.371 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4260.ko 2024-08-24T21:01:05.371 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4261.ko 2024-08-24T21:01:05.371 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max16065.ko 2024-08-24T21:01:05.371 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1619.ko 2024-08-24T21:01:05.371 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1668.ko 2024-08-24T21:01:05.372 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max197.ko 2024-08-24T21:01:05.372 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6639.ko 2024-08-24T21:01:05.372 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6650.ko 2024-08-24T21:01:05.372 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6697.ko 2024-08-24T21:01:05.372 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/mcp3021.ko 2024-08-24T21:01:05.372 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6683.ko 2024-08-24T21:01:05.372 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775-core.ko 2024-08-24T21:01:05.372 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775.ko 2024-08-24T21:01:05.372 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct7802.ko 2024-08-24T21:01:05.372 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87360.ko 2024-08-24T21:01:05.372 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87427.ko 2024-08-24T21:01:05.372 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pcf8591.ko 2024-08-24T21:01:05.372 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus 2024-08-24T21:01:05.373 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-08-24T21:01:05.373 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-08-24T21:01:05.373 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-08-24T21:01:05.373 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max16064.ko 2024-08-24T21:01:05.373 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max34440.ko 2024-08-24T21:01:05.373 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max8688.ko 2024-08-24T21:01:05.373 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-08-24T21:01:05.373 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-08-24T21:01:05.373 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-08-24T21:01:05.373 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-08-24T21:01:05.373 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-08-24T21:01:05.373 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-08-24T21:01:05.373 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/powr1220.ko 2024-08-24T21:01:05.373 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5627.ko 2024-08-24T21:01:05.374 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5636.ko 2024-08-24T21:01:05.374 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch56xx-common.ko 2024-08-24T21:01:05.374 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht15.ko 2024-08-24T21:01:05.374 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht21.ko 2024-08-24T21:01:05.374 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/shtc1.ko 2024-08-24T21:01:05.374 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sis5595.ko 2024-08-24T21:01:05.374 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47b397.ko 2024-08-24T21:01:05.374 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m1.ko 2024-08-24T21:01:05.374 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m192.ko 2024-08-24T21:01:05.374 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/thmc50.ko 2024-08-24T21:01:05.374 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp102.ko 2024-08-24T21:01:05.374 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp103.ko 2024-08-24T21:01:05.374 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp401.ko 2024-08-24T21:01:05.375 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp421.ko 2024-08-24T21:01:05.375 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via-cputemp.ko 2024-08-24T21:01:05.375 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via686a.ko 2024-08-24T21:01:05.375 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt1211.ko 2024-08-24T21:01:05.375 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt8231.ko 2024-08-24T21:01:05.375 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627ehf.ko 2024-08-24T21:01:05.375 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627hf.ko 2024-08-24T21:01:05.375 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83781d.ko 2024-08-24T21:01:05.375 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83791d.ko 2024-08-24T21:01:05.375 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83792d.ko 2024-08-24T21:01:05.375 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83793.ko 2024-08-24T21:01:05.376 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83795.ko 2024-08-24T21:01:05.376 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l785ts.ko 2024-08-24T21:01:05.376 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l786ng.ko 2024-08-24T21:01:05.376 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c 2024-08-24T21:01:05.376 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos 2024-08-24T21:01:05.376 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-08-24T21:01:05.376 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-08-24T21:01:05.376 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses 2024-08-24T21:01:05.376 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-08-24T21:01:05.376 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-08-24T21:01:05.376 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-08-24T21:01:05.376 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-08-24T21:01:05.376 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-08-24T21:01:05.377 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-08-24T21:01:05.377 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-08-24T21:01:05.377 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-08-24T21:01:05.377 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-i801.ko 2024-08-24T21:01:05.377 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-isch.ko 2024-08-24T21:01:05.377 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-08-24T21:01:05.377 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-08-24T21:01:05.377 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-08-24T21:01:05.377 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-parport.ko 2024-08-24T21:01:05.377 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-08-24T21:01:05.377 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-08-24T21:01:05.377 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-08-24T21:01:05.378 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-08-24T21:01:05.378 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-08-24T21:01:05.378 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-08-24T21:01:05.378 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-via.ko 2024-08-24T21:01:05.378 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-08-24T21:01:05.378 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-08-24T21:01:05.378 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-dev.ko 2024-08-24T21:01:05.378 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-mux.ko 2024-08-24T21:01:05.378 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-08-24T21:01:05.378 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-smbus.ko 2024-08-24T21:01:05.378 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-stub.ko 2024-08-24T21:01:05.378 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband 2024-08-24T21:01:05.379 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core 2024-08-24T21:01:05.379 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_cm.ko 2024-08-24T21:01:05.379 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_core.ko 2024-08-24T21:01:05.379 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_umad.ko 2024-08-24T21:01:05.379 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-08-24T21:01:05.379 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/iw_cm.ko 2024-08-24T21:01:05.379 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_cm.ko 2024-08-24T21:01:05.379 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-08-24T21:01:05.379 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw 2024-08-24T21:01:05.379 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4 2024-08-24T21:01:05.379 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-08-24T21:01:05.379 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4 2024-08-24T21:01:05.379 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-08-24T21:01:05.380 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5 2024-08-24T21:01:05.380 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-08-24T21:01:05.380 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca 2024-08-24T21:01:05.380 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-08-24T21:01:05.380 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp 2024-08-24T21:01:05.380 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib 2024-08-24T21:01:05.380 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-08-24T21:01:05.380 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser 2024-08-24T21:01:05.380 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-08-24T21:01:05.380 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert 2024-08-24T21:01:05.380 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-08-24T21:01:05.380 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp 2024-08-24T21:01:05.380 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-08-24T21:01:05.381 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt 2024-08-24T21:01:05.381 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-08-24T21:01:05.381 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input 2024-08-24T21:01:05.381 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport 2024-08-24T21:01:05.381 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-08-24T21:01:05.381 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/fm801-gp.ko 2024-08-24T21:01:05.381 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/gameport.ko 2024-08-24T21:01:05.381 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/joydev.ko 2024-08-24T21:01:05.381 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard 2024-08-24T21:01:05.381 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/gpio_keys.ko 2024-08-24T21:01:05.381 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse 2024-08-24T21:01:05.381 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/appletouch.ko 2024-08-24T21:01:05.382 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/bcm5974.ko 2024-08-24T21:01:05.382 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/cyapatp.ko 2024-08-24T21:01:05.382 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/elan_i2c.ko 2024-08-24T21:01:05.382 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/sermouse.ko 2024-08-24T21:01:05.382 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-08-24T21:01:05.382 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_usb.ko 2024-08-24T21:01:05.382 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/vsxxxaa.ko 2024-08-24T21:01:05.382 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4 2024-08-24T21:01:05.382 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4/rmi_core.ko 2024-08-24T21:01:05.382 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio 2024-08-24T21:01:05.382 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/altera_ps2.ko 2024-08-24T21:01:05.383 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/arc_ps2.ko 2024-08-24T21:01:05.383 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-08-24T21:01:05.383 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/serio_raw.ko 2024-08-24T21:01:05.383 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/sparse-keymap.ko 2024-08-24T21:01:05.383 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds 2024-08-24T21:01:05.383 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-blinkm.ko 2024-08-24T21:01:05.383 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lm3530.ko 2024-08-24T21:01:05.383 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lp3944.ko 2024-08-24T21:01:05.383 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-ss4200.ko 2024-08-24T21:01:05.383 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger 2024-08-24T21:01:05.383 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-08-24T21:01:05.383 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-08-24T21:01:05.383 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-08-24T21:01:05.384 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-08-24T21:01:05.384 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-08-24T21:01:05.384 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-08-24T21:01:05.384 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-08-24T21:01:05.384 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-08-24T21:01:05.384 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md 2024-08-24T21:01:05.384 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache 2024-08-24T21:01:05.384 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache/bcache.ko 2024-08-24T21:01:05.384 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-bio-prison.ko 2024-08-24T21:01:05.384 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache-smq.ko 2024-08-24T21:01:05.384 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache.ko 2024-08-24T21:01:05.384 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-crypt.ko 2024-08-24T21:01:05.384 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-delay.ko 2024-08-24T21:01:05.385 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-flakey.ko 2024-08-24T21:01:05.385 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-log-userspace.ko 2024-08-24T21:01:05.385 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-multipath.ko 2024-08-24T21:01:05.385 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-queue-length.ko 2024-08-24T21:01:05.385 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-raid.ko 2024-08-24T21:01:05.385 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-round-robin.ko 2024-08-24T21:01:05.385 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-service-time.ko 2024-08-24T21:01:05.385 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-switch.ko 2024-08-24T21:01:05.385 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-thin-pool.ko 2024-08-24T21:01:05.385 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-verity.ko 2024-08-24T21:01:05.385 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data 2024-08-24T21:01:05.385 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-08-24T21:01:05.385 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid0.ko 2024-08-24T21:01:05.386 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid1.ko 2024-08-24T21:01:05.386 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid10.ko 2024-08-24T21:01:05.386 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid456.ko 2024-08-24T21:01:05.386 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message 2024-08-24T21:01:05.386 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion 2024-08-24T21:01:05.386 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptbase.ko 2024-08-24T21:01:05.386 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptctl.ko 2024-08-24T21:01:05.386 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptfc.ko 2024-08-24T21:01:05.386 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptlan.ko 2024-08-24T21:01:05.386 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptsas.ko 2024-08-24T21:01:05.386 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptscsih.ko 2024-08-24T21:01:05.386 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptspi.ko 2024-08-24T21:01:05.387 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd 2024-08-24T21:01:05.387 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_ich.ko 2024-08-24T21:01:05.387 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_sch.ko 2024-08-24T21:01:05.387 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/mfd-core.ko 2024-08-24T21:01:05.387 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/sm501.ko 2024-08-24T21:01:05.387 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/viperboard.ko 2024-08-24T21:01:05.387 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/vx855.ko 2024-08-24T21:01:05.387 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/wl1273-core.ko 2024-08-24T21:01:05.387 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc 2024-08-24T21:01:05.387 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl 2024-08-24T21:01:05.387 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-08-24T21:01:05.387 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds9802als.ko 2024-08-24T21:01:05.388 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds990x.ko 2024-08-24T21:01:05.388 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/bh1770glc.ko 2024-08-24T21:01:05.388 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710 2024-08-24T21:01:05.388 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710/cb710.ko 2024-08-24T21:01:05.388 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom 2024-08-24T21:01:05.388 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/at24.ko 2024-08-24T21:01:05.388 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-08-24T21:01:05.388 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/max6875.ko 2024-08-24T21:01:05.388 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/enclosure.ko 2024-08-24T21:01:05.388 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/hpilo.ko 2024-08-24T21:01:05.388 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29003.ko 2024-08-24T21:01:05.388 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29020.ko 2024-08-24T21:01:05.388 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d 2024-08-24T21:01:05.389 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-08-24T21:01:05.389 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-08-24T21:01:05.389 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei 2024-08-24T21:01:05.389 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-me.ko 2024-08-24T21:01:05.389 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-txe.ko 2024-08-24T21:01:05.389 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei.ko 2024-08-24T21:01:05.389 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru 2024-08-24T21:01:05.389 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru/gru.ko 2024-08-24T21:01:05.389 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp 2024-08-24T21:01:05.389 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xp.ko 2024-08-24T21:01:05.389 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpc.ko 2024-08-24T21:01:05.390 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-08-24T21:01:05.390 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_7xx1.ko 2024-08-24T21:01:05.390 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_core.ko 2024-08-24T21:01:05.390 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tsl2550.ko 2024-08-24T21:01:05.390 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_balloon.ko 2024-08-24T21:01:05.390 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci 2024-08-24T21:01:05.390 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-08-24T21:01:05.390 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net 2024-08-24T21:01:05.390 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding 2024-08-24T21:01:05.390 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding/bonding.ko 2024-08-24T21:01:05.390 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa 2024-08-24T21:01:05.390 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53 2024-08-24T21:01:05.390 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53/b53_common.ko 2024-08-24T21:01:05.391 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/bcm-sf2.ko 2024-08-24T21:01:05.391 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6060.ko 2024-08-24T21:01:05.391 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx 2024-08-24T21:01:05.391 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-08-24T21:01:05.391 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dummy.ko 2024-08-24T21:01:05.391 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/eql.ko 2024-08-24T21:01:05.391 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet 2024-08-24T21:01:05.391 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com 2024-08-24T21:01:05.391 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-08-24T21:01:05.391 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-08-24T21:01:05.391 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-08-24T21:01:05.391 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-08-24T21:01:05.392 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390 2024-08-24T21:01:05.392 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/8390.ko 2024-08-24T21:01:05.392 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-08-24T21:01:05.392 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-08-24T21:01:05.392 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-08-24T21:01:05.392 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec 2024-08-24T21:01:05.392 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-08-24T21:01:05.392 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere 2024-08-24T21:01:05.392 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere/et131x.ko 2024-08-24T21:01:05.392 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon 2024-08-24T21:01:05.392 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-08-24T21:01:05.392 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera 2024-08-24T21:01:05.392 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-08-24T21:01:05.393 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd 2024-08-24T21:01:05.393 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-08-24T21:01:05.393 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-08-24T21:01:05.393 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-08-24T21:01:05.393 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros 2024-08-24T21:01:05.393 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx 2024-08-24T21:01:05.393 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-08-24T21:01:05.393 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c 2024-08-24T21:01:05.393 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-08-24T21:01:05.393 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e 2024-08-24T21:01:05.393 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-08-24T21:01:05.393 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx 2024-08-24T21:01:05.393 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-08-24T21:01:05.394 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-08-24T21:01:05.394 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom 2024-08-24T21:01:05.394 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-08-24T21:01:05.394 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-08-24T21:01:05.394 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-08-24T21:01:05.394 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-08-24T21:01:05.394 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-08-24T21:01:05.394 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet 2024-08-24T21:01:05.394 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-08-24T21:01:05.394 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-08-24T21:01:05.394 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade 2024-08-24T21:01:05.394 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna 2024-08-24T21:01:05.395 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-08-24T21:01:05.395 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio 2024-08-24T21:01:05.395 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb 2024-08-24T21:01:05.395 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-08-24T21:01:05.395 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-08-24T21:01:05.395 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-08-24T21:01:05.395 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-08-24T21:01:05.395 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-08-24T21:01:05.395 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-08-24T21:01:05.395 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-08-24T21:01:05.395 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-08-24T21:01:05.395 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-08-24T21:01:05.396 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco 2024-08-24T21:01:05.396 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic 2024-08-24T21:01:05.396 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-08-24T21:01:05.396 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec 2024-08-24T21:01:05.396 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip 2024-08-24T21:01:05.396 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-08-24T21:01:05.396 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-08-24T21:01:05.396 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-08-24T21:01:05.396 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-08-24T21:01:05.396 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-08-24T21:01:05.396 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-08-24T21:01:05.396 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink 2024-08-24T21:01:05.397 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-08-24T21:01:05.397 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-08-24T21:01:05.397 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dnet.ko 2024-08-24T21:01:05.397 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex 2024-08-24T21:01:05.397 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet 2024-08-24T21:01:05.397 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-08-24T21:01:05.397 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ethoc.ko 2024-08-24T21:01:05.397 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/fealnx.ko 2024-08-24T21:01:05.397 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel 2024-08-24T21:01:05.397 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e100.ko 2024-08-24T21:01:05.397 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000 2024-08-24T21:01:05.397 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-08-24T21:01:05.398 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e 2024-08-24T21:01:05.398 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-08-24T21:01:05.398 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k 2024-08-24T21:01:05.398 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-08-24T21:01:05.398 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e 2024-08-24T21:01:05.398 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-08-24T21:01:05.398 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf 2024-08-24T21:01:05.398 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-08-24T21:01:05.398 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb 2024-08-24T21:01:05.398 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-08-24T21:01:05.398 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf 2024-08-24T21:01:05.398 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-08-24T21:01:05.398 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe 2024-08-24T21:01:05.399 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-08-24T21:01:05.399 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf 2024-08-24T21:01:05.399 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-08-24T21:01:05.399 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth 2024-08-24T21:01:05.399 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-08-24T21:01:05.399 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie 2024-08-24T21:01:05.399 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-08-24T21:01:05.399 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/jme.ko 2024-08-24T21:01:05.399 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell 2024-08-24T21:01:05.399 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-08-24T21:01:05.399 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/skge.ko 2024-08-24T21:01:05.399 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-08-24T21:01:05.400 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox 2024-08-24T21:01:05.400 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4 2024-08-24T21:01:05.400 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-08-24T21:01:05.400 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-08-24T21:01:05.400 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5 2024-08-24T21:01:05.400 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-08-24T21:01:05.400 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-08-24T21:01:05.400 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel 2024-08-24T21:01:05.400 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-08-24T21:01:05.400 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom 2024-08-24T21:01:05.400 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge 2024-08-24T21:01:05.400 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-08-24T21:01:05.401 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi 2024-08-24T21:01:05.401 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-08-24T21:01:05.401 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-08-24T21:01:05.401 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion 2024-08-24T21:01:05.401 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-08-24T21:01:05.401 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia 2024-08-24T21:01:05.401 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-08-24T21:01:05.401 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines 2024-08-24T21:01:05.401 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-08-24T21:01:05.401 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-08-24T21:01:05.401 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic 2024-08-24T21:01:05.401 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen 2024-08-24T21:01:05.401 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-08-24T21:01:05.402 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-08-24T21:01:05.402 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-08-24T21:01:05.402 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-08-24T21:01:05.402 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc 2024-08-24T21:01:05.402 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-08-24T21:01:05.402 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek 2024-08-24T21:01:05.402 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-08-24T21:01:05.402 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-08-24T21:01:05.402 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/atp.ko 2024-08-24T21:01:05.402 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-08-24T21:01:05.402 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker 2024-08-24T21:01:05.402 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-08-24T21:01:05.402 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc 2024-08-24T21:01:05.403 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-08-24T21:01:05.403 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan 2024-08-24T21:01:05.403 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-08-24T21:01:05.403 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis 2024-08-24T21:01:05.403 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis190.ko 2024-08-24T21:01:05.403 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis900.ko 2024-08-24T21:01:05.403 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc 2024-08-24T21:01:05.403 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-08-24T21:01:05.403 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-08-24T21:01:05.403 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-08-24T21:01:05.403 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-08-24T21:01:05.403 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro 2024-08-24T21:01:05.403 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac 2024-08-24T21:01:05.404 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-08-24T21:01:05.404 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-08-24T21:01:05.404 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun 2024-08-24T21:01:05.404 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/cassini.ko 2024-08-24T21:01:05.404 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/niu.ko 2024-08-24T21:01:05.404 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sungem.ko 2024-08-24T21:01:05.404 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-08-24T21:01:05.404 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti 2024-08-24T21:01:05.404 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-08-24T21:01:05.404 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti 2024-08-24T21:01:05.404 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti/tlan.ko 2024-08-24T21:01:05.404 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via 2024-08-24T21:01:05.404 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-08-24T21:01:05.405 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-08-24T21:01:05.405 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet 2024-08-24T21:01:05.405 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-08-24T21:01:05.405 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-08-24T21:01:05.405 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom 2024-08-24T21:01:05.405 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-08-24T21:01:05.405 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/geneve.ko 2024-08-24T21:01:05.405 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv 2024-08-24T21:01:05.405 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-08-24T21:01:05.405 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154 2024-08-24T21:01:05.405 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154/fakelb.ko 2024-08-24T21:01:05.405 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ifb.ko 2024-08-24T21:01:05.405 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan 2024-08-24T21:01:05.406 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan/ipvlan.ko 2024-08-24T21:01:05.406 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvlan.ko 2024-08-24T21:01:05.406 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvtap.ko 2024-08-24T21:01:05.406 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio 2024-08-24T21:01:05.406 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio.ko 2024-08-24T21:01:05.406 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-08-24T21:01:05.406 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-08-24T21:01:05.406 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-regmap.ko 2024-08-24T21:01:05.406 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mii.ko 2024-08-24T21:01:05.406 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/net_failover.ko 2024-08-24T21:01:05.406 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/netconsole.ko 2024-08-24T21:01:05.406 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/nlmon.ko 2024-08-24T21:01:05.406 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs 2024-08-24T21:01:05.407 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs-lynx.ko 2024-08-24T21:01:05.407 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-08-24T21:01:05.407 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy 2024-08-24T21:01:05.407 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/amd.ko 2024-08-24T21:01:05.407 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-08-24T21:01:05.407 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-08-24T21:01:05.407 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm7xxx.ko 2024-08-24T21:01:05.407 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm87xx.ko 2024-08-24T21:01:05.407 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/broadcom.ko 2024-08-24T21:01:05.407 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/cicada.ko 2024-08-24T21:01:05.407 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/davicom.ko 2024-08-24T21:01:05.407 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/dp83640.ko 2024-08-24T21:01:05.408 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/et1011c.ko 2024-08-24T21:01:05.408 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/icplus.ko 2024-08-24T21:01:05.408 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/lxt.ko 2024-08-24T21:01:05.408 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/marvell.ko 2024-08-24T21:01:05.408 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/micrel.ko 2024-08-24T21:01:05.408 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/national.ko 2024-08-24T21:01:05.408 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/phylink.ko 2024-08-24T21:01:05.408 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/qsemi.ko 2024-08-24T21:01:05.408 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/realtek.ko 2024-08-24T21:01:05.408 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/smsc.ko 2024-08-24T21:01:05.408 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/ste10Xp.ko 2024-08-24T21:01:05.408 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/vitesse.ko 2024-08-24T21:01:05.408 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp 2024-08-24T21:01:05.408 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/bsd_comp.ko 2024-08-24T21:01:05.409 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_async.ko 2024-08-24T21:01:05.409 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_deflate.ko 2024-08-24T21:01:05.409 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_generic.ko 2024-08-24T21:01:05.409 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_mppe.ko 2024-08-24T21:01:05.409 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_synctty.ko 2024-08-24T21:01:05.409 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppoe.ko 2024-08-24T21:01:05.409 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppox.ko 2024-08-24T21:01:05.409 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pptp.ko 2024-08-24T21:01:05.409 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip 2024-08-24T21:01:05.409 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slhc.ko 2024-08-24T21:01:05.409 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slip.ko 2024-08-24T21:01:05.410 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/sungem_phy.ko 2024-08-24T21:01:05.410 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tap.ko 2024-08-24T21:01:05.410 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team 2024-08-24T21:01:05.410 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team.ko 2024-08-24T21:01:05.410 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_activebackup.ko 2024-08-24T21:01:05.410 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_broadcast.ko 2024-08-24T21:01:05.410 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-08-24T21:01:05.410 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_random.ko 2024-08-24T21:01:05.410 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-08-24T21:01:05.410 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tun.ko 2024-08-24T21:01:05.410 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/veth.ko 2024-08-24T21:01:05.410 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/virtio_net.ko 2024-08-24T21:01:05.410 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3 2024-08-24T21:01:05.410 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-08-24T21:01:05.411 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan 2024-08-24T21:01:05.411 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan/vxlan.ko 2024-08-24T21:01:05.411 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback 2024-08-24T21:01:05.411 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback/xen-netback.ko 2024-08-24T21:01:05.411 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netfront.ko 2024-08-24T21:01:05.411 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb 2024-08-24T21:01:05.411 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb/ntb.ko 2024-08-24T21:01:05.411 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme 2024-08-24T21:01:05.411 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host 2024-08-24T21:01:05.411 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme-core.ko 2024-08-24T21:01:05.411 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme.ko 2024-08-24T21:01:05.411 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport 2024-08-24T21:01:05.411 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport.ko 2024-08-24T21:01:05.411 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_cs.ko 2024-08-24T21:01:05.412 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_pc.ko 2024-08-24T21:01:05.412 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_serial.ko 2024-08-24T21:01:05.412 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci 2024-08-24T21:01:05.412 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug 2024-08-24T21:01:05.412 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-08-24T21:01:05.412 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie 2024-08-24T21:01:05.412 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie/aer_inject.ko 2024-08-24T21:01:05.412 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/xen-pcifront.ko 2024-08-24T21:01:05.412 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia 2024-08-24T21:01:05.412 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/i82092.ko 2024-08-24T21:01:05.412 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/pd6729.ko 2024-08-24T21:01:05.412 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/yenta_socket.ko 2024-08-24T21:01:05.412 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl 2024-08-24T21:01:05.413 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel 2024-08-24T21:01:05.413 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-08-24T21:01:05.413 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform 2024-08-24T21:01:05.413 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86 2024-08-24T21:01:05.413 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acer-wmi.ko 2024-08-24T21:01:05.413 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acerhdf.ko 2024-08-24T21:01:05.413 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/apple-gmux.ko 2024-08-24T21:01:05.413 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-laptop.ko 2024-08-24T21:01:05.413 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-08-24T21:01:05.413 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-wmi.ko 2024-08-24T21:01:05.413 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/classmate-laptop.ko 2024-08-24T21:01:05.413 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-08-24T21:01:05.413 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-08-24T21:01:05.414 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-08-24T21:01:05.414 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-08-24T21:01:05.414 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/hdaps.ko 2024-08-24T21:01:05.414 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel 2024-08-24T21:01:05.414 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-08-24T21:01:05.414 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel_ips.ko 2024-08-24T21:01:05.414 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/msi-wmi.ko 2024-08-24T21:01:05.414 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/mxm-wmi.ko 2024-08-24T21:01:05.414 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-08-24T21:01:05.414 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-laptop.ko 2024-08-24T21:01:05.414 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-q10.ko 2024-08-24T21:01:05.414 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/topstar-laptop.ko 2024-08-24T21:01:05.414 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-08-24T21:01:05.415 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_haps.ko 2024-08-24T21:01:05.415 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi-bmof.ko 2024-08-24T21:01:05.415 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi.ko 2024-08-24T21:01:05.415 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap 2024-08-24T21:01:05.415 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_common.ko 2024-08-24T21:01:05.415 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_msr.ko 2024-08-24T21:01:05.415 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps 2024-08-24T21:01:05.415 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients 2024-08-24T21:01:05.415 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-gpio.ko 2024-08-24T21:01:05.415 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-ldisc.ko 2024-08-24T21:01:05.415 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps_parport.ko 2024-08-24T21:01:05.415 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/pps_core.ko 2024-08-24T21:01:05.415 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp 2024-08-24T21:01:05.415 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp.ko 2024-08-24T21:01:05.416 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp_kvm.ko 2024-08-24T21:01:05.416 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras 2024-08-24T21:01:05.416 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd 2024-08-24T21:01:05.416 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl 2024-08-24T21:01:05.416 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-08-24T21:01:05.416 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/fmpm.ko 2024-08-24T21:01:05.416 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc 2024-08-24T21:01:05.416 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-bq32k.ko 2024-08-24T21:01:05.416 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1286.ko 2024-08-24T21:01:05.416 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1307.ko 2024-08-24T21:01:05.416 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1374.ko 2024-08-24T21:01:05.416 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1511.ko 2024-08-24T21:01:05.416 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1553.ko 2024-08-24T21:01:05.416 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1672.ko 2024-08-24T21:01:05.417 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1742.ko 2024-08-24T21:01:05.417 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds2404.ko 2024-08-24T21:01:05.417 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds3232.ko 2024-08-24T21:01:05.417 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-em3027.ko 2024-08-24T21:01:05.417 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-fm3130.ko 2024-08-24T21:01:05.417 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl12022.ko 2024-08-24T21:01:05.417 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl1208.ko 2024-08-24T21:01:05.417 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m41t80.ko 2024-08-24T21:01:05.417 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t35.ko 2024-08-24T21:01:05.417 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t59.ko 2024-08-24T21:01:05.417 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-max6900.ko 2024-08-24T21:01:05.417 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-msm6242.ko 2024-08-24T21:01:05.417 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf2127.ko 2024-08-24T21:01:05.417 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf85063.ko 2024-08-24T21:01:05.418 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8523.ko 2024-08-24T21:01:05.418 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8563.ko 2024-08-24T21:01:05.418 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8583.ko 2024-08-24T21:01:05.418 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rp5c01.ko 2024-08-24T21:01:05.418 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rs5c372.ko 2024-08-24T21:01:05.418 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-08-24T21:01:05.418 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8025.ko 2024-08-24T21:01:05.418 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8581.ko 2024-08-24T21:01:05.418 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-08-24T21:01:05.418 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-x1205.ko 2024-08-24T21:01:05.418 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi 2024-08-24T21:01:05.418 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-9xxx.ko 2024-08-24T21:01:05.418 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-sas.ko 2024-08-24T21:01:05.418 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-xxxx.ko 2024-08-24T21:01:05.419 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/BusLogic.ko 2024-08-24T21:01:05.419 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/a100u2w.ko 2024-08-24T21:01:05.419 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid 2024-08-24T21:01:05.419 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid/aacraid.ko 2024-08-24T21:01:05.419 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/advansys.ko 2024-08-24T21:01:05.419 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx 2024-08-24T21:01:05.419 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-08-24T21:01:05.419 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-08-24T21:01:05.419 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/am53c974.ko 2024-08-24T21:01:05.419 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr 2024-08-24T21:01:05.419 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-08-24T21:01:05.419 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/atp870u.ko 2024-08-24T21:01:05.419 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi 2024-08-24T21:01:05.419 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-08-24T21:01:05.420 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa 2024-08-24T21:01:05.420 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa/bfa.ko 2024-08-24T21:01:05.420 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc 2024-08-24T21:01:05.420 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-08-24T21:01:05.420 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i 2024-08-24T21:01:05.420 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-08-24T21:01:05.420 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ch.ko 2024-08-24T21:01:05.420 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor 2024-08-24T21:01:05.420 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor/csiostor.ko 2024-08-24T21:01:05.420 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi 2024-08-24T21:01:05.420 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i 2024-08-24T21:01:05.420 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-08-24T21:01:05.420 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i 2024-08-24T21:01:05.420 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-08-24T21:01:05.421 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-08-24T21:01:05.421 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dc395x.ko 2024-08-24T21:01:05.421 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler 2024-08-24T21:01:05.421 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-08-24T21:01:05.421 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-08-24T21:01:05.421 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-08-24T21:01:05.421 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-08-24T21:01:05.421 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dmx3191d.ko 2024-08-24T21:01:05.421 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r 2024-08-24T21:01:05.421 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r/esas2r.ko 2024-08-24T21:01:05.421 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esp_scsi.ko 2024-08-24T21:01:05.421 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe 2024-08-24T21:01:05.422 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/fcoe.ko 2024-08-24T21:01:05.422 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-08-24T21:01:05.422 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic 2024-08-24T21:01:05.422 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic/fnic.ko 2024-08-24T21:01:05.422 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hpsa.ko 2024-08-24T21:01:05.422 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hptiop.ko 2024-08-24T21:01:05.422 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hv_storvsc.ko 2024-08-24T21:01:05.422 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/initio.ko 2024-08-24T21:01:05.422 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ipr.ko 2024-08-24T21:01:05.422 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ips.ko 2024-08-24T21:01:05.422 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci 2024-08-24T21:01:05.422 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci/isci.ko 2024-08-24T21:01:05.422 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-08-24T21:01:05.423 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_tcp.ko 2024-08-24T21:01:05.423 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc 2024-08-24T21:01:05.423 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc/libfc.ko 2024-08-24T21:01:05.423 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi.ko 2024-08-24T21:01:05.423 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi_tcp.ko 2024-08-24T21:01:05.423 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas 2024-08-24T21:01:05.423 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas/libsas.ko 2024-08-24T21:01:05.423 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc 2024-08-24T21:01:05.423 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc/lpfc.ko 2024-08-24T21:01:05.423 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid 2024-08-24T21:01:05.423 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid.ko 2024-08-24T21:01:05.423 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-08-24T21:01:05.423 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-08-24T21:01:05.424 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-08-24T21:01:05.424 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas 2024-08-24T21:01:05.424 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-08-24T21:01:05.424 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas 2024-08-24T21:01:05.424 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas/mvsas.ko 2024-08-24T21:01:05.424 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvumi.ko 2024-08-24T21:01:05.424 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001 2024-08-24T21:01:05.424 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-08-24T21:01:05.424 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pmcraid.ko 2024-08-24T21:01:05.424 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla1280.ko 2024-08-24T21:01:05.424 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx 2024-08-24T21:01:05.424 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-08-24T21:01:05.424 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-08-24T21:01:05.424 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx 2024-08-24T21:01:05.425 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-08-24T21:01:05.425 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/raid_class.ko 2024-08-24T21:01:05.425 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_debug.ko 2024-08-24T21:01:05.425 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_fc.ko 2024-08-24T21:01:05.425 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-08-24T21:01:05.425 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_sas.ko 2024-08-24T21:01:05.425 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_spi.ko 2024-08-24T21:01:05.425 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_srp.ko 2024-08-24T21:01:05.425 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ses.ko 2024-08-24T21:01:05.425 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/st.ko 2024-08-24T21:01:05.425 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/stex.ko 2024-08-24T21:01:05.425 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2 2024-08-24T21:01:05.425 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-08-24T21:01:05.426 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/virtio_scsi.ko 2024-08-24T21:01:05.426 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/vmw_pvscsi.ko 2024-08-24T21:01:05.426 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/wd719x.ko 2024-08-24T21:01:05.426 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb 2024-08-24T21:01:05.426 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb/ssb.ko 2024-08-24T21:01:05.426 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target 2024-08-24T21:01:05.426 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi 2024-08-24T21:01:05.426 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-08-24T21:01:05.426 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback 2024-08-24T21:01:05.426 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback/tcm_loop.ko 2024-08-24T21:01:05.426 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_file.ko 2024-08-24T21:01:05.426 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_iblock.ko 2024-08-24T21:01:05.426 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_mod.ko 2024-08-24T21:01:05.426 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_pscsi.ko 2024-08-24T21:01:05.427 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_user.ko 2024-08-24T21:01:05.427 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc 2024-08-24T21:01:05.427 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-08-24T21:01:05.427 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal 2024-08-24T21:01:05.427 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel 2024-08-24T21:01:05.427 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal 2024-08-24T21:01:05.427 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-08-24T21:01:05.427 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-08-24T21:01:05.427 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-08-24T21:01:05.427 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-08-24T21:01:05.427 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-08-24T21:01:05.427 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-08-24T21:01:05.427 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-08-24T21:01:05.428 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-08-24T21:01:05.428 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-08-24T21:01:05.428 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-08-24T21:01:05.428 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-08-24T21:01:05.428 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-08-24T21:01:05.428 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-08-24T21:01:05.428 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-08-24T21:01:05.428 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-08-24T21:01:05.428 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-08-24T21:01:05.428 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-08-24T21:01:05.428 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-08-24T21:01:05.428 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty 2024-08-24T21:01:05.428 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless 2024-08-24T21:01:05.428 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-08-24T21:01:05.429 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_gsm.ko 2024-08-24T21:01:05.429 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_hdlc.ko 2024-08-24T21:01:05.429 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/nozomi.ko 2024-08-24T21:01:05.429 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial 2024-08-24T21:01:05.429 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250 2024-08-24T21:01:05.429 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-08-24T21:01:05.429 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/arc_uart.ko 2024-08-24T21:01:05.429 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm 2024-08-24T21:01:05.429 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm/jsm.ko 2024-08-24T21:01:05.429 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs 2024-08-24T21:01:05.429 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core 2024-08-24T21:01:05.429 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core/ufshcd-core.ko 2024-08-24T21:01:05.429 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host 2024-08-24T21:01:05.429 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-08-24T21:01:05.430 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio 2024-08-24T21:01:05.430 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio.ko 2024-08-24T21:01:05.430 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_aec.ko 2024-08-24T21:01:05.430 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_cif.ko 2024-08-24T21:01:05.430 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_pci_generic.ko 2024-08-24T21:01:05.430 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_sercos3.ko 2024-08-24T21:01:05.430 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb 2024-08-24T21:01:05.430 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class 2024-08-24T21:01:05.430 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-acm.ko 2024-08-24T21:01:05.430 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-wdm.ko 2024-08-24T21:01:05.430 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usblp.ko 2024-08-24T21:01:05.430 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usbtmc.ko 2024-08-24T21:01:05.430 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host 2024-08-24T21:01:05.430 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host/sl811-hcd.ko 2024-08-24T21:01:05.431 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image 2024-08-24T21:01:05.431 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/mdc800.ko 2024-08-24T21:01:05.431 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/microtek.ko 2024-08-24T21:01:05.431 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc 2024-08-24T21:01:05.431 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/adutux.ko 2024-08-24T21:01:05.431 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/appledisplay.ko 2024-08-24T21:01:05.431 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi26.ko 2024-08-24T21:01:05.431 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi62.ko 2024-08-24T21:01:05.431 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ezusb.ko 2024-08-24T21:01:05.431 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/idmouse.ko 2024-08-24T21:01:05.431 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/iowarrior.ko 2024-08-24T21:01:05.431 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/isight_firmware.ko 2024-08-24T21:01:05.431 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ldusb.ko 2024-08-24T21:01:05.431 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/legousbtower.ko 2024-08-24T21:01:05.432 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga 2024-08-24T21:01:05.432 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-08-24T21:01:05.432 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/trancevibrator.ko 2024-08-24T21:01:05.432 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usb3503.ko 2024-08-24T21:01:05.432 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usblcd.ko 2024-08-24T21:01:05.432 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usbsevseg.ko 2024-08-24T21:01:05.432 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/uss720.ko 2024-08-24T21:01:05.432 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/yurex.ko 2024-08-24T21:01:05.432 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy 2024-08-24T21:01:05.432 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy/phy-generic.ko 2024-08-24T21:01:05.432 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial 2024-08-24T21:01:05.432 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/aircable.ko 2024-08-24T21:01:05.432 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ark3116.ko 2024-08-24T21:01:05.433 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/belkin_sa.ko 2024-08-24T21:01:05.433 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ch341.ko 2024-08-24T21:01:05.433 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cp210x.ko 2024-08-24T21:01:05.433 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cyberjack.ko 2024-08-24T21:01:05.433 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cypress_m8.ko 2024-08-24T21:01:05.433 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/digi_acceleport.ko 2024-08-24T21:01:05.433 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/empeg.ko 2024-08-24T21:01:05.433 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ftdi_sio.ko 2024-08-24T21:01:05.433 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/garmin_gps.ko 2024-08-24T21:01:05.433 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_edgeport.ko 2024-08-24T21:01:05.433 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_ti.ko 2024-08-24T21:01:05.433 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipaq.ko 2024-08-24T21:01:05.433 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipw.ko 2024-08-24T21:01:05.434 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ir-usb.ko 2024-08-24T21:01:05.434 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-08-24T21:01:05.434 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan.ko 2024-08-24T21:01:05.434 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan_pda.ko 2024-08-24T21:01:05.434 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kl5kusb105.ko 2024-08-24T21:01:05.434 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kobil_sct.ko 2024-08-24T21:01:05.434 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mct_u232.ko 2024-08-24T21:01:05.434 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7720.ko 2024-08-24T21:01:05.434 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7840.ko 2024-08-24T21:01:05.434 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/navman.ko 2024-08-24T21:01:05.434 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/omninet.ko 2024-08-24T21:01:05.434 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/opticon.ko 2024-08-24T21:01:05.434 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/option.ko 2024-08-24T21:01:05.434 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/oti6858.ko 2024-08-24T21:01:05.435 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/pl2303.ko 2024-08-24T21:01:05.435 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcaux.ko 2024-08-24T21:01:05.435 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcserial.ko 2024-08-24T21:01:05.435 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/quatech2.ko 2024-08-24T21:01:05.435 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/safe_serial.ko 2024-08-24T21:01:05.435 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/sierra.ko 2024-08-24T21:01:05.435 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/spcp8x5.ko 2024-08-24T21:01:05.435 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ssu100.ko 2024-08-24T21:01:05.435 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/symbolserial.ko 2024-08-24T21:01:05.435 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-08-24T21:01:05.435 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-08-24T21:01:05.435 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_debug.ko 2024-08-24T21:01:05.435 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_wwan.ko 2024-08-24T21:01:05.436 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/visor.ko 2024-08-24T21:01:05.436 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/whiteheat.ko 2024-08-24T21:01:05.436 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/xsens_mt.ko 2024-08-24T21:01:05.436 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage 2024-08-24T21:01:05.436 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/uas.ko 2024-08-24T21:01:05.436 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-alauda.ko 2024-08-24T21:01:05.436 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-cypress.ko 2024-08-24T21:01:05.436 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-datafab.ko 2024-08-24T21:01:05.436 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-08-24T21:01:05.436 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-freecom.ko 2024-08-24T21:01:05.436 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-isd200.ko 2024-08-24T21:01:05.436 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-08-24T21:01:05.437 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-karma.ko 2024-08-24T21:01:05.437 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-onetouch.ko 2024-08-24T21:01:05.437 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-realtek.ko 2024-08-24T21:01:05.437 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr09.ko 2024-08-24T21:01:05.437 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr55.ko 2024-08-24T21:01:05.437 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-usbat.ko 2024-08-24T21:01:05.437 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/usb-storage.ko 2024-08-24T21:01:05.437 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip 2024-08-24T21:01:05.437 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-core.ko 2024-08-24T21:01:05.437 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-host.ko 2024-08-24T21:01:05.437 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-08-24T21:01:05.437 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio 2024-08-24T21:01:05.438 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci 2024-08-24T21:01:05.438 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-08-24T21:01:05.438 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci.ko 2024-08-24T21:01:05.438 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio.ko 2024-08-24T21:01:05.438 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-08-24T21:01:05.438 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost 2024-08-24T21:01:05.438 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost.ko 2024-08-24T21:01:05.438 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_iotlb.ko 2024-08-24T21:01:05.438 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_net.ko 2024-08-24T21:01:05.438 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_scsi.ko 2024-08-24T21:01:05.438 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video 2024-08-24T21:01:05.438 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight 2024-08-24T21:01:05.438 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/apple_bl.ko 2024-08-24T21:01:05.439 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/lcd.ko 2024-08-24T21:01:05.439 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/platform_lcd.ko 2024-08-24T21:01:05.439 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio 2024-08-24T21:01:05.439 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio.ko 2024-08-24T21:01:05.439 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_balloon.ko 2024-08-24T21:01:05.439 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_mmio.ko 2024-08-24T21:01:05.439 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci.ko 2024-08-24T21:01:05.439 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-08-24T21:01:05.439 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-08-24T21:01:05.439 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_ring.ko 2024-08-24T21:01:05.439 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1 2024-08-24T21:01:05.439 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters 2024-08-24T21:01:05.439 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2482.ko 2024-08-24T21:01:05.439 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2490.ko 2024-08-24T21:01:05.440 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves 2024-08-24T21:01:05.440 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-08-24T21:01:05.440 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-08-24T21:01:05.440 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-08-24T21:01:05.440 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-08-24T21:01:05.440 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-08-24T21:01:05.440 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-08-24T21:01:05.440 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-08-24T21:01:05.440 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-08-24T21:01:05.440 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-08-24T21:01:05.440 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_smem.ko 2024-08-24T21:01:05.440 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_therm.ko 2024-08-24T21:01:05.440 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/wire.ko 2024-08-24T21:01:05.441 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog 2024-08-24T21:01:05.441 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim1535_wdt.ko 2024-08-24T21:01:05.441 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim7101_wdt.ko 2024-08-24T21:01:05.441 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/f71808e_wdt.ko 2024-08-24T21:01:05.441 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/hpwdt.ko 2024-08-24T21:01:05.441 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/i6300esb.ko 2024-08-24T21:01:05.441 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-08-24T21:01:05.441 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_wdt.ko 2024-08-24T21:01:05.441 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ib700wdt.ko 2024-08-24T21:01:05.441 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ibmasr.ko 2024-08-24T21:01:05.441 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-08-24T21:01:05.441 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it8712f_wdt.ko 2024-08-24T21:01:05.441 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it87_wdt.ko 2024-08-24T21:01:05.441 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/machzwd.ko 2024-08-24T21:01:05.441 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/nv_tco.ko 2024-08-24T21:01:05.442 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_pci.ko 2024-08-24T21:01:05.442 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_usb.ko 2024-08-24T21:01:05.442 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-08-24T21:01:05.442 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sch311x_wdt.ko 2024-08-24T21:01:05.442 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/softdog.ko 2024-08-24T21:01:05.442 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sp5100_tco.ko 2024-08-24T21:01:05.442 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/via_wdt.ko 2024-08-24T21:01:05.442 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-08-24T21:01:05.442 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83877f_wdt.ko 2024-08-24T21:01:05.442 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83977f_wdt.ko 2024-08-24T21:01:05.442 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/wdt_pci.ko 2024-08-24T21:01:05.442 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/xen_wdt.ko 2024-08-24T21:01:05.443 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen 2024-08-24T21:01:05.443 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-acpi-processor.ko 2024-08-24T21:01:05.443 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-evtchn.ko 2024-08-24T21:01:05.443 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntalloc.ko 2024-08-24T21:01:05.443 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntdev.ko 2024-08-24T21:01:05.443 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback 2024-08-24T21:01:05.443 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-08-24T21:01:05.443 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-privcmd.ko 2024-08-24T21:01:05.443 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs 2024-08-24T21:01:05.443 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs/xenfs.ko 2024-08-24T21:01:05.443 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs 2024-08-24T21:01:05.443 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p 2024-08-24T21:01:05.444 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p/9p.ko 2024-08-24T21:01:05.444 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs 2024-08-24T21:01:05.444 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs/affs.ko 2024-08-24T21:01:05.444 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs 2024-08-24T21:01:05.444 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs/befs.ko 2024-08-24T21:01:05.444 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/binfmt_misc.ko 2024-08-24T21:01:05.444 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs 2024-08-24T21:01:05.444 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs/btrfs.ko 2024-08-24T21:01:05.444 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles 2024-08-24T21:01:05.444 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles/cachefiles.ko 2024-08-24T21:01:05.444 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph 2024-08-24T21:01:05.444 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph/ceph.ko 2024-08-24T21:01:05.445 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda 2024-08-24T21:01:05.445 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda/coda.ko 2024-08-24T21:01:05.445 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs 2024-08-24T21:01:05.445 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs/cramfs.ko 2024-08-24T21:01:05.445 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm 2024-08-24T21:01:05.445 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm/dlm.ko 2024-08-24T21:01:05.445 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs 2024-08-24T21:01:05.445 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs/ecryptfs.ko 2024-08-24T21:01:05.445 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs 2024-08-24T21:01:05.445 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs/f2fs.ko 2024-08-24T21:01:05.445 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat 2024-08-24T21:01:05.445 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/fat.ko 2024-08-24T21:01:05.445 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/msdos.ko 2024-08-24T21:01:05.446 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/vfat.ko 2024-08-24T21:01:05.446 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse 2024-08-24T21:01:05.446 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/cuse.ko 2024-08-24T21:01:05.446 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/fuse.ko 2024-08-24T21:01:05.446 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2 2024-08-24T21:01:05.446 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2/gfs2.ko 2024-08-24T21:01:05.446 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs 2024-08-24T21:01:05.446 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs/hfs.ko 2024-08-24T21:01:05.446 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus 2024-08-24T21:01:05.446 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus/hfsplus.ko 2024-08-24T21:01:05.446 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs 2024-08-24T21:01:05.447 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs/isofs.ko 2024-08-24T21:01:05.447 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs 2024-08-24T21:01:05.447 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs/jfs.ko 2024-08-24T21:01:05.447 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd 2024-08-24T21:01:05.447 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd/lockd.ko 2024-08-24T21:01:05.447 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix 2024-08-24T21:01:05.447 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix/minix.ko 2024-08-24T21:01:05.447 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs 2024-08-24T21:01:05.447 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs/netfs.ko 2024-08-24T21:01:05.447 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs 2024-08-24T21:01:05.447 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout 2024-08-24T21:01:05.447 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-08-24T21:01:05.448 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout 2024-08-24T21:01:05.448 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-08-24T21:01:05.448 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout 2024-08-24T21:01:05.448 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-08-24T21:01:05.448 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfs.ko 2024-08-24T21:01:05.448 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv3.ko 2024-08-24T21:01:05.448 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv4.ko 2024-08-24T21:01:05.448 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common 2024-08-24T21:01:05.448 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/grace.ko 2024-08-24T21:01:05.448 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/nfs_acl.ko 2024-08-24T21:01:05.448 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd 2024-08-24T21:01:05.449 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd/nfsd.ko 2024-08-24T21:01:05.449 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2 2024-08-24T21:01:05.449 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2/nilfs2.ko 2024-08-24T21:01:05.449 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls 2024-08-24T21:01:05.449 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-celtic.ko 2024-08-24T21:01:05.449 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-centeuro.ko 2024-08-24T21:01:05.449 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-croatian.ko 2024-08-24T21:01:05.449 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-cyrillic.ko 2024-08-24T21:01:05.449 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-gaelic.ko 2024-08-24T21:01:05.449 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-greek.ko 2024-08-24T21:01:05.449 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-iceland.ko 2024-08-24T21:01:05.449 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-inuit.ko 2024-08-24T21:01:05.449 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-roman.ko 2024-08-24T21:01:05.449 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-romanian.ko 2024-08-24T21:01:05.450 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-turkish.ko 2024-08-24T21:01:05.450 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1250.ko 2024-08-24T21:01:05.450 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1251.ko 2024-08-24T21:01:05.450 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1255.ko 2024-08-24T21:01:05.450 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp737.ko 2024-08-24T21:01:05.450 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp775.ko 2024-08-24T21:01:05.450 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp850.ko 2024-08-24T21:01:05.450 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp852.ko 2024-08-24T21:01:05.450 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp855.ko 2024-08-24T21:01:05.450 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp857.ko 2024-08-24T21:01:05.450 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp860.ko 2024-08-24T21:01:05.450 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp861.ko 2024-08-24T21:01:05.450 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp862.ko 2024-08-24T21:01:05.450 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp863.ko 2024-08-24T21:01:05.450 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp864.ko 2024-08-24T21:01:05.451 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp865.ko 2024-08-24T21:01:05.451 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp866.ko 2024-08-24T21:01:05.451 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp869.ko 2024-08-24T21:01:05.451 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp874.ko 2024-08-24T21:01:05.451 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp932.ko 2024-08-24T21:01:05.451 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp936.ko 2024-08-24T21:01:05.451 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp949.ko 2024-08-24T21:01:05.451 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp950.ko 2024-08-24T21:01:05.451 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_euc-jp.ko 2024-08-24T21:01:05.451 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-1.ko 2024-08-24T21:01:05.451 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-13.ko 2024-08-24T21:01:05.451 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-14.ko 2024-08-24T21:01:05.451 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-15.ko 2024-08-24T21:01:05.451 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-2.ko 2024-08-24T21:01:05.452 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-3.ko 2024-08-24T21:01:05.452 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-4.ko 2024-08-24T21:01:05.452 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-5.ko 2024-08-24T21:01:05.452 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-6.ko 2024-08-24T21:01:05.452 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-7.ko 2024-08-24T21:01:05.452 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-9.ko 2024-08-24T21:01:05.452 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-r.ko 2024-08-24T21:01:05.452 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-ru.ko 2024-08-24T21:01:05.452 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-u.ko 2024-08-24T21:01:05.452 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_ucs2_utils.ko 2024-08-24T21:01:05.452 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_utf8.ko 2024-08-24T21:01:05.452 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2 2024-08-24T21:01:05.452 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster 2024-08-24T21:01:05.452 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-08-24T21:01:05.452 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm 2024-08-24T21:01:05.453 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-08-24T21:01:05.453 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs 2024-08-24T21:01:05.453 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-08-24T21:01:05.453 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2.ko 2024-08-24T21:01:05.453 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-08-24T21:01:05.453 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-08-24T21:01:05.453 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-08-24T21:01:05.453 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs 2024-08-24T21:01:05.453 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs/overlay.ko 2024-08-24T21:01:05.453 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore 2024-08-24T21:01:05.453 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore/ramoops.ko 2024-08-24T21:01:05.453 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs 2024-08-24T21:01:05.453 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs/reiserfs.ko 2024-08-24T21:01:05.454 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs 2024-08-24T21:01:05.454 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs/romfs.ko 2024-08-24T21:01:05.454 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb 2024-08-24T21:01:05.454 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client 2024-08-24T21:01:05.454 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client/cifs.ko 2024-08-24T21:01:05.454 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common 2024-08-24T21:01:05.454 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_arc4.ko 2024-08-24T21:01:05.454 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_md4.ko 2024-08-24T21:01:05.454 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs 2024-08-24T21:01:05.454 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs/squashfs.ko 2024-08-24T21:01:05.454 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv 2024-08-24T21:01:05.454 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv/sysv.ko 2024-08-24T21:01:05.454 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf 2024-08-24T21:01:05.454 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf/udf.ko 2024-08-24T21:01:05.455 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs 2024-08-24T21:01:05.455 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs/ufs.ko 2024-08-24T21:01:05.455 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs 2024-08-24T21:01:05.455 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs/xfs.ko 2024-08-24T21:01:05.455 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel 2024-08-24T21:01:05.455 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu 2024-08-24T21:01:05.455 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu/rcutorture.ko 2024-08-24T21:01:05.455 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/torture.ko 2024-08-24T21:01:05.455 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace 2024-08-24T21:01:05.455 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-08-24T21:01:05.455 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib 2024-08-24T21:01:05.455 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/asn1_encoder.ko 2024-08-24T21:01:05.455 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc-itu-t.ko 2024-08-24T21:01:05.455 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc8.ko 2024-08-24T21:01:05.456 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto 2024-08-24T21:01:05.456 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libaescfb.ko 2024-08-24T21:01:05.456 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libarc4.ko 2024-08-24T21:01:05.456 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libdes.ko 2024-08-24T21:01:05.456 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/libcrc32c.ko 2024-08-24T21:01:05.456 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lru_cache.ko 2024-08-24T21:01:05.456 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4 2024-08-24T21:01:05.456 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4_compress.ko 2024-08-24T21:01:05.456 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4hc_compress.ko 2024-08-24T21:01:05.456 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math 2024-08-24T21:01:05.456 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math/cordic.ko 2024-08-24T21:01:05.456 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6 2024-08-24T21:01:05.456 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6/raid6_pq.ko 2024-08-24T21:01:05.456 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon 2024-08-24T21:01:05.456 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon/reed_solomon.ko 2024-08-24T21:01:05.457 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_bm.ko 2024-08-24T21:01:05.457 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_fsm.ko 2024-08-24T21:01:05.457 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_kmp.ko 2024-08-24T21:01:05.457 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd 2024-08-24T21:01:05.457 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd/zstd_compress.ko 2024-08-24T21:01:05.457 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm 2024-08-24T21:01:05.457 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm/hwpoison-inject.ko 2024-08-24T21:01:05.457 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net 2024-08-24T21:01:05.457 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan 2024-08-24T21:01:05.457 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/6lowpan.ko 2024-08-24T21:01:05.457 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_dest.ko 2024-08-24T21:01:05.457 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_fragment.ko 2024-08-24T21:01:05.458 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_hop.ko 2024-08-24T21:01:05.458 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_ipv6.ko 2024-08-24T21:01:05.458 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_mobility.ko 2024-08-24T21:01:05.458 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_routing.ko 2024-08-24T21:01:05.458 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_udp.ko 2024-08-24T21:01:05.458 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802 2024-08-24T21:01:05.458 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/garp.ko 2024-08-24T21:01:05.458 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/mrp.ko 2024-08-24T21:01:05.458 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/p8022.ko 2024-08-24T21:01:05.458 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/psnap.ko 2024-08-24T21:01:05.458 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/stp.ko 2024-08-24T21:01:05.458 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q 2024-08-24T21:01:05.458 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q/8021q.ko 2024-08-24T21:01:05.459 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p 2024-08-24T21:01:05.459 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet.ko 2024-08-24T21:01:05.459 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_fd.ko 2024-08-24T21:01:05.459 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_rdma.ko 2024-08-24T21:01:05.459 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_virtio.ko 2024-08-24T21:01:05.459 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv 2024-08-24T21:01:05.459 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv/batman-adv.ko 2024-08-24T21:01:05.459 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge 2024-08-24T21:01:05.459 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/br_netfilter.ko 2024-08-24T21:01:05.459 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/bridge.ko 2024-08-24T21:01:05.459 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter 2024-08-24T21:01:05.459 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-08-24T21:01:05.459 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_among.ko 2024-08-24T21:01:05.459 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arp.ko 2024-08-24T21:01:05.460 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-08-24T21:01:05.460 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-08-24T21:01:05.460 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip.ko 2024-08-24T21:01:05.460 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-08-24T21:01:05.460 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_limit.ko 2024-08-24T21:01:05.460 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_log.ko 2024-08-24T21:01:05.460 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark.ko 2024-08-24T21:01:05.460 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-08-24T21:01:05.460 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-08-24T21:01:05.460 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-08-24T21:01:05.461 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-08-24T21:01:05.461 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_snat.ko 2024-08-24T21:01:05.461 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_stp.ko 2024-08-24T21:01:05.461 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-08-24T21:01:05.461 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-08-24T21:01:05.461 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-08-24T21:01:05.461 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-08-24T21:01:05.461 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtables.ko 2024-08-24T21:01:05.461 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-08-24T21:01:05.461 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-08-24T21:01:05.461 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-08-24T21:01:05.461 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph 2024-08-24T21:01:05.461 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph/libceph.ko 2024-08-24T21:01:05.461 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core 2024-08-24T21:01:05.462 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/failover.ko 2024-08-24T21:01:05.462 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/pktgen.ko 2024-08-24T21:01:05.462 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp 2024-08-24T21:01:05.462 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp.ko 2024-08-24T21:01:05.462 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_diag.ko 2024-08-24T21:01:05.462 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv4.ko 2024-08-24T21:01:05.462 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv6.ko 2024-08-24T21:01:05.462 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver 2024-08-24T21:01:05.462 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver/dns_resolver.ko 2024-08-24T21:01:05.462 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa 2024-08-24T21:01:05.462 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/dsa_core.ko 2024-08-24T21:01:05.462 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_brcm.ko 2024-08-24T21:01:05.462 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_dsa.ko 2024-08-24T21:01:05.462 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_none.ko 2024-08-24T21:01:05.462 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_trailer.ko 2024-08-24T21:01:05.463 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154 2024-08-24T21:01:05.463 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan 2024-08-24T21:01:05.463 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-08-24T21:01:05.463 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154.ko 2024-08-24T21:01:05.463 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154_socket.ko 2024-08-24T21:01:05.463 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4 2024-08-24T21:01:05.463 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ah4.ko 2024-08-24T21:01:05.463 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/esp4.ko 2024-08-24T21:01:05.463 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/fou.ko 2024-08-24T21:01:05.463 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/gre.ko 2024-08-24T21:01:05.463 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/inet_diag.ko 2024-08-24T21:01:05.463 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_gre.ko 2024-08-24T21:01:05.463 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_tunnel.ko 2024-08-24T21:01:05.463 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_vti.ko 2024-08-24T21:01:05.464 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipcomp.ko 2024-08-24T21:01:05.464 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipip.ko 2024-08-24T21:01:05.464 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter 2024-08-24T21:01:05.464 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arp_tables.ko 2024-08-24T21:01:05.464 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-08-24T21:01:05.464 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-08-24T21:01:05.464 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-08-24T21:01:05.464 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-08-24T21:01:05.464 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-08-24T21:01:05.464 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-08-24T21:01:05.464 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-08-24T21:01:05.464 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-08-24T21:01:05.464 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-08-24T21:01:05.464 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_security.ko 2024-08-24T21:01:05.465 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-08-24T21:01:05.465 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-08-24T21:01:05.465 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-08-24T21:01:05.465 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-08-24T21:01:05.465 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-08-24T21:01:05.465 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-08-24T21:01:05.465 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-08-24T21:01:05.465 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-08-24T21:01:05.465 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-08-24T21:01:05.465 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-08-24T21:01:05.465 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_bic.ko 2024-08-24T21:01:05.465 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_dctcp.ko 2024-08-24T21:01:05.465 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_diag.ko 2024-08-24T21:01:05.465 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_highspeed.ko 2024-08-24T21:01:05.466 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_htcp.ko 2024-08-24T21:01:05.466 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_hybla.ko 2024-08-24T21:01:05.466 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_illinois.ko 2024-08-24T21:01:05.466 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_lp.ko 2024-08-24T21:01:05.466 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_scalable.ko 2024-08-24T21:01:05.466 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_vegas.ko 2024-08-24T21:01:05.466 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_veno.ko 2024-08-24T21:01:05.466 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_westwood.ko 2024-08-24T21:01:05.466 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_yeah.ko 2024-08-24T21:01:05.466 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tunnel4.ko 2024-08-24T21:01:05.466 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_diag.ko 2024-08-24T21:01:05.466 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_tunnel.ko 2024-08-24T21:01:05.466 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/xfrm4_tunnel.ko 2024-08-24T21:01:05.466 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6 2024-08-24T21:01:05.467 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ah6.ko 2024-08-24T21:01:05.467 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/esp6.ko 2024-08-24T21:01:05.467 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/fou6.ko 2024-08-24T21:01:05.467 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_tunnel.ko 2024-08-24T21:01:05.467 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-08-24T21:01:05.467 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_vti.ko 2024-08-24T21:01:05.467 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ipcomp6.ko 2024-08-24T21:01:05.467 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter 2024-08-24T21:01:05.467 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-08-24T21:01:05.467 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-08-24T21:01:05.467 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-08-24T21:01:05.467 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-08-24T21:01:05.467 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-08-24T21:01:05.467 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-08-24T21:01:05.467 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-08-24T21:01:05.468 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-08-24T21:01:05.468 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-08-24T21:01:05.468 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-08-24T21:01:05.468 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-08-24T21:01:05.468 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-08-24T21:01:05.468 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-08-24T21:01:05.468 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-08-24T21:01:05.468 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-08-24T21:01:05.468 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-08-24T21:01:05.468 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-08-24T21:01:05.468 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-08-24T21:01:05.468 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-08-24T21:01:05.468 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-08-24T21:01:05.469 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-08-24T21:01:05.469 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-08-24T21:01:05.469 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-08-24T21:01:05.469 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-08-24T21:01:05.469 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/sit.ko 2024-08-24T21:01:05.469 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/tunnel6.ko 2024-08-24T21:01:05.469 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/xfrm6_tunnel.ko 2024-08-24T21:01:05.469 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key 2024-08-24T21:01:05.469 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key/af_key.ko 2024-08-24T21:01:05.469 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp 2024-08-24T21:01:05.469 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_core.ko 2024-08-24T21:01:05.469 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_debugfs.ko 2024-08-24T21:01:05.470 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_eth.ko 2024-08-24T21:01:05.470 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip.ko 2024-08-24T21:01:05.470 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip6.ko 2024-08-24T21:01:05.470 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_netlink.ko 2024-08-24T21:01:05.470 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ppp.ko 2024-08-24T21:01:05.470 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc 2024-08-24T21:01:05.470 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc/llc.ko 2024-08-24T21:01:05.470 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154 2024-08-24T21:01:05.470 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154/mac802154.ko 2024-08-24T21:01:05.470 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls 2024-08-24T21:01:05.470 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls/mpls_gso.ko 2024-08-24T21:01:05.470 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter 2024-08-24T21:01:05.470 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset 2024-08-24T21:01:05.470 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set.ko 2024-08-24T21:01:05.471 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-08-24T21:01:05.471 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-08-24T21:01:05.471 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-08-24T21:01:05.471 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-08-24T21:01:05.471 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-08-24T21:01:05.471 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-08-24T21:01:05.471 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-08-24T21:01:05.471 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-08-24T21:01:05.471 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-08-24T21:01:05.471 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-08-24T21:01:05.471 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-08-24T21:01:05.471 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-08-24T21:01:05.471 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-08-24T21:01:05.471 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-08-24T21:01:05.472 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-08-24T21:01:05.472 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs 2024-08-24T21:01:05.472 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs.ko 2024-08-24T21:01:05.472 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-08-24T21:01:05.472 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-08-24T21:01:05.472 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-08-24T21:01:05.472 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-08-24T21:01:05.472 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-08-24T21:01:05.472 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-08-24T21:01:05.472 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-08-24T21:01:05.472 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-08-24T21:01:05.472 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-08-24T21:01:05.472 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-08-24T21:01:05.473 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-08-24T21:01:05.473 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-08-24T21:01:05.473 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-08-24T21:01:05.473 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conncount.ko 2024-08-24T21:01:05.473 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack.ko 2024-08-24T21:01:05.473 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-08-24T21:01:05.473 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-08-24T21:01:05.473 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-08-24T21:01:05.473 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_h323.ko 2024-08-24T21:01:05.473 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_irc.ko 2024-08-24T21:01:05.473 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-08-24T21:01:05.473 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-08-24T21:01:05.473 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-08-24T21:01:05.474 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sane.ko 2024-08-24T21:01:05.474 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sip.ko 2024-08-24T21:01:05.474 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-08-24T21:01:05.474 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-08-24T21:01:05.474 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_dup_netdev.ko 2024-08-24T21:01:05.474 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table.ko 2024-08-24T21:01:05.474 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table_inet.ko 2024-08-24T21:01:05.474 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_log_syslog.ko 2024-08-24T21:01:05.474 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat.ko 2024-08-24T21:01:05.474 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_amanda.ko 2024-08-24T21:01:05.474 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_ftp.ko 2024-08-24T21:01:05.474 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_irc.ko 2024-08-24T21:01:05.474 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_sip.ko 2024-08-24T21:01:05.475 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_tftp.ko 2024-08-24T21:01:05.475 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_synproxy_core.ko 2024-08-24T21:01:05.475 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_tables.ko 2024-08-24T21:01:05.475 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink.ko 2024-08-24T21:01:05.475 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_acct.ko 2024-08-24T21:01:05.475 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_log.ko 2024-08-24T21:01:05.475 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_osf.ko 2024-08-24T21:01:05.475 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_queue.ko 2024-08-24T21:01:05.475 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_chain_nat.ko 2024-08-24T21:01:05.475 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_compat.ko 2024-08-24T21:01:05.475 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_ct.ko 2024-08-24T21:01:05.475 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_dup_netdev.ko 2024-08-24T21:01:05.475 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fib.ko 2024-08-24T21:01:05.475 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fwd_netdev.ko 2024-08-24T21:01:05.476 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_hash.ko 2024-08-24T21:01:05.476 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_limit.ko 2024-08-24T21:01:05.476 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_log.ko 2024-08-24T21:01:05.476 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_masq.ko 2024-08-24T21:01:05.476 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_nat.ko 2024-08-24T21:01:05.476 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_numgen.ko 2024-08-24T21:01:05.476 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_queue.ko 2024-08-24T21:01:05.476 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_quota.ko 2024-08-24T21:01:05.476 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_redir.ko 2024-08-24T21:01:05.476 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject.ko 2024-08-24T21:01:05.476 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject_inet.ko 2024-08-24T21:01:05.476 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_socket.ko 2024-08-24T21:01:05.476 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_tunnel.ko 2024-08-24T21:01:05.476 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_AUDIT.ko 2024-08-24T21:01:05.476 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CHECKSUM.ko 2024-08-24T21:01:05.477 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CLASSIFY.ko 2024-08-24T21:01:05.477 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-08-24T21:01:05.477 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CT.ko 2024-08-24T21:01:05.477 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_DSCP.ko 2024-08-24T21:01:05.477 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HL.ko 2024-08-24T21:01:05.477 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HMARK.ko 2024-08-24T21:01:05.477 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_IDLETIMER.ko 2024-08-24T21:01:05.477 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LED.ko 2024-08-24T21:01:05.477 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LOG.ko 2024-08-24T21:01:05.477 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_MASQUERADE.ko 2024-08-24T21:01:05.477 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NETMAP.ko 2024-08-24T21:01:05.477 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFLOG.ko 2024-08-24T21:01:05.478 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFQUEUE.ko 2024-08-24T21:01:05.478 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_RATEEST.ko 2024-08-24T21:01:05.478 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_REDIRECT.ko 2024-08-24T21:01:05.478 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_SECMARK.ko 2024-08-24T21:01:05.478 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPMSS.ko 2024-08-24T21:01:05.478 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-08-24T21:01:05.478 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TEE.ko 2024-08-24T21:01:05.478 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TPROXY.ko 2024-08-24T21:01:05.478 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TRACE.ko 2024-08-24T21:01:05.478 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_addrtype.ko 2024-08-24T21:01:05.478 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_bpf.ko 2024-08-24T21:01:05.478 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cgroup.ko 2024-08-24T21:01:05.478 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cluster.ko 2024-08-24T21:01:05.478 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_comment.ko 2024-08-24T21:01:05.479 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connbytes.ko 2024-08-24T21:01:05.479 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlabel.ko 2024-08-24T21:01:05.479 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlimit.ko 2024-08-24T21:01:05.479 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connmark.ko 2024-08-24T21:01:05.479 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_conntrack.ko 2024-08-24T21:01:05.479 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cpu.ko 2024-08-24T21:01:05.479 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dccp.ko 2024-08-24T21:01:05.479 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_devgroup.ko 2024-08-24T21:01:05.479 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dscp.ko 2024-08-24T21:01:05.479 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ecn.ko 2024-08-24T21:01:05.479 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_esp.ko 2024-08-24T21:01:05.479 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hashlimit.ko 2024-08-24T21:01:05.479 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_helper.ko 2024-08-24T21:01:05.479 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hl.ko 2024-08-24T21:01:05.480 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipcomp.ko 2024-08-24T21:01:05.480 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_iprange.ko 2024-08-24T21:01:05.480 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipvs.ko 2024-08-24T21:01:05.480 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_l2tp.ko 2024-08-24T21:01:05.480 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_length.ko 2024-08-24T21:01:05.480 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_limit.ko 2024-08-24T21:01:05.480 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mac.ko 2024-08-24T21:01:05.480 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mark.ko 2024-08-24T21:01:05.480 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_multiport.ko 2024-08-24T21:01:05.480 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nat.ko 2024-08-24T21:01:05.480 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nfacct.ko 2024-08-24T21:01:05.480 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_osf.ko 2024-08-24T21:01:05.480 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_owner.ko 2024-08-24T21:01:05.480 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_physdev.ko 2024-08-24T21:01:05.480 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_pkttype.ko 2024-08-24T21:01:05.481 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_policy.ko 2024-08-24T21:01:05.481 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_quota.ko 2024-08-24T21:01:05.481 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_rateest.ko 2024-08-24T21:01:05.481 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_realm.ko 2024-08-24T21:01:05.481 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_recent.ko 2024-08-24T21:01:05.481 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_sctp.ko 2024-08-24T21:01:05.481 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_set.ko 2024-08-24T21:01:05.481 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_socket.ko 2024-08-24T21:01:05.481 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_state.ko 2024-08-24T21:01:05.481 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_statistic.ko 2024-08-24T21:01:05.481 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_string.ko 2024-08-24T21:01:05.481 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_tcpmss.ko 2024-08-24T21:01:05.481 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_time.ko 2024-08-24T21:01:05.481 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_u32.ko 2024-08-24T21:01:05.482 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink 2024-08-24T21:01:05.482 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink/netlink_diag.ko 2024-08-24T21:01:05.482 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh 2024-08-24T21:01:05.482 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh/nsh.ko 2024-08-24T21:01:05.482 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch 2024-08-24T21:01:05.482 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/openvswitch.ko 2024-08-24T21:01:05.482 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-geneve.ko 2024-08-24T21:01:05.482 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-gre.ko 2024-08-24T21:01:05.482 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-vxlan.ko 2024-08-24T21:01:05.482 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet 2024-08-24T21:01:05.482 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet/af_packet_diag.ko 2024-08-24T21:01:05.482 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds 2024-08-24T21:01:05.482 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds.ko 2024-08-24T21:01:05.483 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_rdma.ko 2024-08-24T21:01:05.483 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_tcp.ko 2024-08-24T21:01:05.483 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched 2024-08-24T21:01:05.483 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_csum.ko 2024-08-24T21:01:05.483 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_gact.ko 2024-08-24T21:01:05.483 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_mirred.ko 2024-08-24T21:01:05.483 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_nat.ko 2024-08-24T21:01:05.483 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_pedit.ko 2024-08-24T21:01:05.483 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_police.ko 2024-08-24T21:01:05.483 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_simple.ko 2024-08-24T21:01:05.483 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_skbedit.ko 2024-08-24T21:01:05.483 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_vlan.ko 2024-08-24T21:01:05.483 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_basic.ko 2024-08-24T21:01:05.484 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_bpf.ko 2024-08-24T21:01:05.484 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_flow.ko 2024-08-24T21:01:05.484 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_fw.ko 2024-08-24T21:01:05.484 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_route.ko 2024-08-24T21:01:05.484 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_u32.ko 2024-08-24T21:01:05.484 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_cmp.ko 2024-08-24T21:01:05.484 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_ipset.ko 2024-08-24T21:01:05.484 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_meta.ko 2024-08-24T21:01:05.484 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_nbyte.ko 2024-08-24T21:01:05.484 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_text.ko 2024-08-24T21:01:05.484 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_u32.ko 2024-08-24T21:01:05.484 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_choke.ko 2024-08-24T21:01:05.484 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_codel.ko 2024-08-24T21:01:05.485 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_drr.ko 2024-08-24T21:01:05.485 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_fq.ko 2024-08-24T21:01:05.485 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_gred.ko 2024-08-24T21:01:05.485 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hfsc.ko 2024-08-24T21:01:05.485 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hhf.ko 2024-08-24T21:01:05.485 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_htb.ko 2024-08-24T21:01:05.485 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_ingress.ko 2024-08-24T21:01:05.485 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio.ko 2024-08-24T21:01:05.485 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio_lib.ko 2024-08-24T21:01:05.485 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_multiq.ko 2024-08-24T21:01:05.485 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_netem.ko 2024-08-24T21:01:05.486 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_pie.ko 2024-08-24T21:01:05.486 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_plug.ko 2024-08-24T21:01:05.486 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_prio.ko 2024-08-24T21:01:05.486 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_qfq.ko 2024-08-24T21:01:05.486 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_red.ko 2024-08-24T21:01:05.486 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfb.ko 2024-08-24T21:01:05.486 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfq.ko 2024-08-24T21:01:05.486 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_tbf.ko 2024-08-24T21:01:05.486 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_teql.ko 2024-08-24T21:01:05.486 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp 2024-08-24T21:01:05.486 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp.ko 2024-08-24T21:01:05.486 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp_diag.ko 2024-08-24T21:01:05.486 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc 2024-08-24T21:01:05.486 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss 2024-08-24T21:01:05.487 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-08-24T21:01:05.487 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-08-24T21:01:05.487 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/sunrpc.ko 2024-08-24T21:01:05.487 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma 2024-08-24T21:01:05.487 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-08-24T21:01:05.487 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc 2024-08-24T21:01:05.487 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc.ko 2024-08-24T21:01:05.487 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc_diag.ko 2024-08-24T21:01:05.487 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix 2024-08-24T21:01:05.487 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix/unix_diag.ko 2024-08-24T21:01:05.487 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock 2024-08-24T21:01:05.487 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-08-24T21:01:05.487 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-08-24T21:01:05.487 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock.ko 2024-08-24T21:01:05.488 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_diag.ko 2024-08-24T21:01:05.488 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_loopback.ko 2024-08-24T21:01:05.488 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm 2024-08-24T21:01:05.488 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm/xfrm_ipcomp.ko 2024-08-24T21:01:05.488 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security 2024-08-24T21:01:05.488 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys 2024-08-24T21:01:05.488 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys 2024-08-24T21:01:05.488 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-08-24T21:01:05.488 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys 2024-08-24T21:01:05.488 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys/trusted.ko 2024-08-24T21:01:05.488 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias 2024-08-24T21:01:05.488 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias.bin 2024-08-24T21:01:05.488 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin 2024-08-24T21:01:05.488 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.alias.bin 2024-08-24T21:01:05.489 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.bin 2024-08-24T21:01:05.489 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.modinfo 2024-08-24T21:01:05.489 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep 2024-08-24T21:01:05.489 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep.bin 2024-08-24T21:01:05.489 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.devname 2024-08-24T21:01:05.489 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.order 2024-08-24T21:01:05.489 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.softdep 2024-08-24T21:01:05.489 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols 2024-08-24T21:01:05.489 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols.bin 2024-08-24T21:01:05.489 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.weakdep 2024-08-24T21:01:05.489 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-24T21:01:05.493 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc3-g7503b862ff5b 2024-08-24T21:01:05.493 DEBUG:teuthology.orchestra.run.smithi119:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-08-24T21:01:05.517 INFO:teuthology.orchestra.run.smithi119.stdout:postinstall scriptlet (using /bin/sh): 2024-08-24T21:01:05.517 INFO:teuthology.orchestra.run.smithi119.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-24T21:01:05.517 INFO:teuthology.orchestra.run.smithi119.stdout: /usr/bin/kernel-install add 6.11.0-rc3-g7503b862ff5b /lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-24T21:01:05.518 INFO:teuthology.orchestra.run.smithi119.stdout:fi 2024-08-24T21:01:05.518 INFO:teuthology.orchestra.run.smithi119.stdout:for file in vmlinuz System.map config; do 2024-08-24T21:01:05.518 INFO:teuthology.orchestra.run.smithi119.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b"; then 2024-08-24T21:01:05.518 INFO:teuthology.orchestra.run.smithi119.stdout: cp "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b" 2024-08-24T21:01:05.518 INFO:teuthology.orchestra.run.smithi119.stdout: fi 2024-08-24T21:01:05.518 INFO:teuthology.orchestra.run.smithi119.stdout:done 2024-08-24T21:01:05.518 INFO:teuthology.orchestra.run.smithi119.stdout:if [ -d "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" ] && \ 2024-08-24T21:01:05.518 INFO:teuthology.orchestra.run.smithi119.stdout: ! diff -rq "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" >/dev/null 2>&1; then 2024-08-24T21:01:05.518 INFO:teuthology.orchestra.run.smithi119.stdout: rm -rf "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-24T21:01:05.518 INFO:teuthology.orchestra.run.smithi119.stdout: cp -r "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-24T21:01:05.518 INFO:teuthology.orchestra.run.smithi119.stdout:fi 2024-08-24T21:01:05.519 INFO:teuthology.orchestra.run.smithi119.stdout:if [ ! -e "/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep" ]; then 2024-08-24T21:01:05.519 INFO:teuthology.orchestra.run.smithi119.stdout: /usr/sbin/depmod 6.11.0-rc3-g7503b862ff5b 2024-08-24T21:01:05.519 INFO:teuthology.orchestra.run.smithi119.stdout:fi 2024-08-24T21:01:05.519 INFO:teuthology.orchestra.run.smithi119.stdout:preuninstall scriptlet (using /bin/sh): 2024-08-24T21:01:05.519 INFO:teuthology.orchestra.run.smithi119.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-24T21:01:05.519 INFO:teuthology.orchestra.run.smithi119.stdout:kernel-install remove 6.11.0-rc3-g7503b862ff5b 2024-08-24T21:01:05.519 INFO:teuthology.orchestra.run.smithi119.stdout:fi 2024-08-24T21:01:05.519 DEBUG:teuthology.orchestra.run.smithi119:> sudo rpm -qi grub2-tools 2024-08-24T21:01:05.591 INFO:teuthology.orchestra.run.smithi119.stdout:Name : grub2-tools 2024-08-24T21:01:05.591 INFO:teuthology.orchestra.run.smithi119.stdout:Epoch : 1 2024-08-24T21:01:05.591 INFO:teuthology.orchestra.run.smithi119.stdout:Version : 2.06 2024-08-24T21:01:05.591 INFO:teuthology.orchestra.run.smithi119.stdout:Release : 82.el9 2024-08-24T21:01:05.591 INFO:teuthology.orchestra.run.smithi119.stdout:Architecture: x86_64 2024-08-24T21:01:05.592 INFO:teuthology.orchestra.run.smithi119.stdout:Install Date: Wed 21 Aug 2024 09:12:29 PM UTC 2024-08-24T21:01:05.592 INFO:teuthology.orchestra.run.smithi119.stdout:Group : Unspecified 2024-08-24T21:01:05.592 INFO:teuthology.orchestra.run.smithi119.stdout:Size : 8274670 2024-08-24T21:01:05.592 INFO:teuthology.orchestra.run.smithi119.stdout:License : GPLv3+ 2024-08-24T21:01:05.592 INFO:teuthology.orchestra.run.smithi119.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-08-24T21:01:05.592 INFO:teuthology.orchestra.run.smithi119.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-08-24T21:01:05.592 INFO:teuthology.orchestra.run.smithi119.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-08-24T21:01:05.592 INFO:teuthology.orchestra.run.smithi119.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-08-24T21:01:05.592 INFO:teuthology.orchestra.run.smithi119.stdout:Packager : builder@centos.org 2024-08-24T21:01:05.592 INFO:teuthology.orchestra.run.smithi119.stdout:Vendor : CentOS 2024-08-24T21:01:05.592 INFO:teuthology.orchestra.run.smithi119.stdout:URL : http://www.gnu.org/software/grub/ 2024-08-24T21:01:05.592 INFO:teuthology.orchestra.run.smithi119.stdout:Summary : Support tools for GRUB. 2024-08-24T21:01:05.592 INFO:teuthology.orchestra.run.smithi119.stdout:Description : 2024-08-24T21:01:05.593 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-24T21:01:05.593 INFO:teuthology.orchestra.run.smithi119.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-08-24T21:01:05.593 INFO:teuthology.orchestra.run.smithi119.stdout:customizable bootloader with modular architecture. It supports a rich 2024-08-24T21:01:05.593 INFO:teuthology.orchestra.run.smithi119.stdout:variety of kernel formats, file systems, computer architectures and 2024-08-24T21:01:05.593 INFO:teuthology.orchestra.run.smithi119.stdout:hardware devices. 2024-08-24T21:01:05.593 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-24T21:01:05.593 INFO:teuthology.orchestra.run.smithi119.stdout:This subpackage provides tools for support of all platforms. 2024-08-24T21:01:05.594 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-08-24T21:01:05.594 INFO:teuthology.task.kernel:Updating grub on smithi119 to boot 6.11.0-rc3-g7503b862ff5b 2024-08-24T21:01:05.594 DEBUG:teuthology.orchestra.run.smithi119:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-08-24T21:01:06.171 INFO:teuthology.orchestra.run.smithi119.stderr:Generating grub configuration file ... 2024-08-24T21:01:07.511 INFO:teuthology.orchestra.run.smithi119.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-08-24T21:01:07.556 INFO:teuthology.orchestra.run.smithi119.stderr:done 2024-08-24T21:01:07.565 DEBUG:teuthology.orchestra.run.smithi119:> mktemp 2024-08-24T21:01:07.581 INFO:teuthology.orchestra.run.smithi119.stdout:/tmp/tmp.YZQZV86mWt 2024-08-24T21:01:07.581 DEBUG:teuthology.orchestra.run.smithi119:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.YZQZV86mWt 2024-08-24T21:01:07.647 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 0666 /tmp/tmp.YZQZV86mWt 2024-08-24T21:01:07.788 DEBUG:teuthology.orchestra.remote:smithi119:/tmp/tmp.YZQZV86mWt is 6KB 2024-08-24T21:01:07.837 DEBUG:teuthology.orchestra.run.smithi119:> rm -fr /tmp/tmp.YZQZV86mWt 2024-08-24T21:01:07.851 DEBUG:teuthology.orchestra.run.smithi119:> sudo /bin/ls /boot/loader/entries || true 2024-08-24T21:01:07.914 INFO:teuthology.orchestra.run.smithi119.stdout:7acb1e34f9714b649e59f4e98f1746e5-0-rescue.conf 2024-08-24T21:01:07.914 INFO:teuthology.orchestra.run.smithi119.stdout:7acb1e34f9714b649e59f4e98f1746e5-5.14.0-239.el9.x86_64.conf 2024-08-24T21:01:07.914 INFO:teuthology.orchestra.run.smithi119.stdout:7acb1e34f9714b649e59f4e98f1746e5-5.14.0-496.el9.x86_64.conf 2024-08-24T21:01:07.914 INFO:teuthology.orchestra.run.smithi119.stdout:7acb1e34f9714b649e59f4e98f1746e5-6.11.0-rc3-g7503b862ff5b.conf 2024-08-24T21:01:07.916 DEBUG:teuthology.orchestra.run.smithi119:> sudo grub2-set-default 7acb1e34f9714b649e59f4e98f1746e5-6.11.0-rc3-g7503b862ff5b 2024-08-24T21:01:08.070 DEBUG:teuthology.orchestra.run.smithi119:> sudo shutdown -r now 2024-08-24T21:01:09.669 INFO:teuthology.orchestra.run.smithi179.stderr:2024-08-24 21:01:09 URL:https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm [360536130/360536130] -> "/tmp/kernel.x86_64.rpm" [1] 2024-08-24T21:01:09.670 INFO:teuthology.orchestra.run.smithi179.stderr:FINISHED --2024-08-24 21:01:09-- 2024-08-24T21:01:09.670 INFO:teuthology.orchestra.run.smithi179.stderr:Total wall clock time: 59s 2024-08-24T21:01:09.670 INFO:teuthology.orchestra.run.smithi179.stderr:Downloaded: 1 files, 344M in 59s (5.86 MB/s) 2024-08-24T21:01:09.673 INFO:teuthology.task.kernel:Installing kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.0... 2024-08-24T21:01:09.673 DEBUG:teuthology.orchestra.run.smithi179:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-08-24T21:01:10.220 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi060.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-08-24T21:01:10.221 DEBUG:teuthology.orchestra.run.smithi060:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-08-24T21:01:10.303 INFO:teuthology.orchestra.run.smithi060.stdout:/boot/System.map-6.11.0-rc3-g7503b862ff5b 2024-08-24T21:01:10.303 INFO:teuthology.orchestra.run.smithi060.stdout:/boot/config-6.11.0-rc3-g7503b862ff5b 2024-08-24T21:01:10.303 INFO:teuthology.orchestra.run.smithi060.stdout:/boot/vmlinuz-6.11.0-rc3-g7503b862ff5b 2024-08-24T21:01:10.303 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b 2024-08-24T21:01:10.304 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/System.map 2024-08-24T21:01:10.304 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/config 2024-08-24T21:01:10.304 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel 2024-08-24T21:01:10.304 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch 2024-08-24T21:01:10.304 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86 2024-08-24T21:01:10.304 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto 2024-08-24T21:01:10.304 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-08-24T21:01:10.304 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-08-24T21:01:10.304 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-08-24T21:01:10.304 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-08-24T21:01:10.304 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-08-24T21:01:10.304 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-08-24T21:01:10.304 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-08-24T21:01:10.305 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32c-intel.ko 2024-08-24T21:01:10.305 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-08-24T21:01:10.305 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-08-24T21:01:10.305 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-08-24T21:01:10.305 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-08-24T21:01:10.305 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx2.ko 2024-08-24T21:01:10.305 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-08-24T21:01:10.305 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-08-24T21:01:10.305 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-08-24T21:01:10.306 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-08-24T21:01:10.306 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-08-24T21:01:10.306 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-08-24T21:01:10.306 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-08-24T21:01:10.306 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel 2024-08-24T21:01:10.306 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu 2024-08-24T21:01:10.306 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce 2024-08-24T21:01:10.306 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-08-24T21:01:10.306 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm 2024-08-24T21:01:10.306 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-amd.ko 2024-08-24T21:01:10.306 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-intel.ko 2024-08-24T21:01:10.306 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm.ko 2024-08-24T21:01:10.307 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto 2024-08-24T21:01:10.307 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ansi_cprng.ko 2024-08-24T21:01:10.307 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/anubis.ko 2024-08-24T21:01:10.307 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/arc4.ko 2024-08-24T21:01:10.307 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx 2024-08-24T21:01:10.307 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_memcpy.ko 2024-08-24T21:01:10.307 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_pq.ko 2024-08-24T21:01:10.307 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_raid6_recov.ko 2024-08-24T21:01:10.307 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_tx.ko 2024-08-24T21:01:10.307 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_xor.ko 2024-08-24T21:01:10.307 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/raid6test.ko 2024-08-24T21:01:10.307 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authenc.ko 2024-08-24T21:01:10.307 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authencesn.ko 2024-08-24T21:01:10.308 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blake2b_generic.ko 2024-08-24T21:01:10.308 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_common.ko 2024-08-24T21:01:10.308 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_generic.ko 2024-08-24T21:01:10.308 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/camellia_generic.ko 2024-08-24T21:01:10.308 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast5_generic.ko 2024-08-24T21:01:10.308 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast6_generic.ko 2024-08-24T21:01:10.308 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast_common.ko 2024-08-24T21:01:10.308 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ccm.ko 2024-08-24T21:01:10.308 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cmac.ko 2024-08-24T21:01:10.308 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crc32_generic.ko 2024-08-24T21:01:10.308 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_engine.ko 2024-08-24T21:01:10.308 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_user.ko 2024-08-24T21:01:10.309 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cts.ko 2024-08-24T21:01:10.309 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/des_generic.ko 2024-08-24T21:01:10.309 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/dh_generic.ko 2024-08-24T21:01:10.309 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecc.ko 2024-08-24T21:01:10.309 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecdh_generic.ko 2024-08-24T21:01:10.309 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/echainiv.ko 2024-08-24T21:01:10.309 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/essiv.ko 2024-08-24T21:01:10.309 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/fcrypt.ko 2024-08-24T21:01:10.309 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/khazad.ko 2024-08-24T21:01:10.309 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4.ko 2024-08-24T21:01:10.309 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4hc.ko 2024-08-24T21:01:10.309 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/md4.ko 2024-08-24T21:01:10.309 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/michael_mic.ko 2024-08-24T21:01:10.310 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcbc.ko 2024-08-24T21:01:10.310 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcrypt.ko 2024-08-24T21:01:10.310 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/rmd160.ko 2024-08-24T21:01:10.310 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/seed.ko 2024-08-24T21:01:10.310 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/serpent_generic.ko 2024-08-24T21:01:10.310 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tcrypt.ko 2024-08-24T21:01:10.310 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tea.ko 2024-08-24T21:01:10.310 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_common.ko 2024-08-24T21:01:10.310 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_generic.ko 2024-08-24T21:01:10.310 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/vmac.ko 2024-08-24T21:01:10.310 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/wp512.ko 2024-08-24T21:01:10.310 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xcbc.ko 2024-08-24T21:01:10.310 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xor.ko 2024-08-24T21:01:10.311 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xxhash_generic.ko 2024-08-24T21:01:10.311 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers 2024-08-24T21:01:10.311 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi 2024-08-24T21:01:10.311 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_ipmi.ko 2024-08-24T21:01:10.311 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_pad.ko 2024-08-24T21:01:10.311 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/ec_sys.ko 2024-08-24T21:01:10.311 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/platform_profile.ko 2024-08-24T21:01:10.311 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbs.ko 2024-08-24T21:01:10.311 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbshc.ko 2024-08-24T21:01:10.311 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/video.ko 2024-08-24T21:01:10.311 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata 2024-08-24T21:01:10.311 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/acard-ahci.ko 2024-08-24T21:01:10.311 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ahci_platform.ko 2024-08-24T21:01:10.312 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ata_generic.ko 2024-08-24T21:01:10.312 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/libahci_platform.ko 2024-08-24T21:01:10.312 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_acpi.ko 2024-08-24T21:01:10.312 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ali.ko 2024-08-24T21:01:10.312 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_amd.ko 2024-08-24T21:01:10.312 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_artop.ko 2024-08-24T21:01:10.312 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atiixp.ko 2024-08-24T21:01:10.312 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atp867x.ko 2024-08-24T21:01:10.312 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd640.ko 2024-08-24T21:01:10.312 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd64x.ko 2024-08-24T21:01:10.312 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cypress.ko 2024-08-24T21:01:10.313 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_efar.ko 2024-08-24T21:01:10.313 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt366.ko 2024-08-24T21:01:10.313 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt37x.ko 2024-08-24T21:01:10.313 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x2n.ko 2024-08-24T21:01:10.313 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x3.ko 2024-08-24T21:01:10.313 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it8213.ko 2024-08-24T21:01:10.313 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it821x.ko 2024-08-24T21:01:10.313 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_jmicron.ko 2024-08-24T21:01:10.313 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_marvell.ko 2024-08-24T21:01:10.313 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_mpiix.ko 2024-08-24T21:01:10.314 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_netcell.ko 2024-08-24T21:01:10.314 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ninja32.ko 2024-08-24T21:01:10.314 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87410.ko 2024-08-24T21:01:10.314 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87415.ko 2024-08-24T21:01:10.314 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_oldpiix.ko 2024-08-24T21:01:10.314 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_opti.ko 2024-08-24T21:01:10.314 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_optidma.ko 2024-08-24T21:01:10.314 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pcmcia.ko 2024-08-24T21:01:10.314 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc2027x.ko 2024-08-24T21:01:10.314 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-08-24T21:01:10.315 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_piccolo.ko 2024-08-24T21:01:10.315 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_rdc.ko 2024-08-24T21:01:10.315 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sch.ko 2024-08-24T21:01:10.315 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_serverworks.ko 2024-08-24T21:01:10.315 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sil680.ko 2024-08-24T21:01:10.315 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sis.ko 2024-08-24T21:01:10.315 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sl82c105.ko 2024-08-24T21:01:10.315 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_triflex.ko 2024-08-24T21:01:10.315 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_via.ko 2024-08-24T21:01:10.315 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pdc_adma.ko 2024-08-24T21:01:10.315 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_inic162x.ko 2024-08-24T21:01:10.315 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_mv.ko 2024-08-24T21:01:10.316 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_nv.ko 2024-08-24T21:01:10.316 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_promise.ko 2024-08-24T21:01:10.316 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_qstor.ko 2024-08-24T21:01:10.316 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil.ko 2024-08-24T21:01:10.316 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil24.ko 2024-08-24T21:01:10.316 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sis.ko 2024-08-24T21:01:10.316 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_svw.ko 2024-08-24T21:01:10.316 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sx4.ko 2024-08-24T21:01:10.316 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_uli.ko 2024-08-24T21:01:10.316 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_via.ko 2024-08-24T21:01:10.316 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_vsc.ko 2024-08-24T21:01:10.316 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay 2024-08-24T21:01:10.317 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay/ks0108.ko 2024-08-24T21:01:10.317 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base 2024-08-24T21:01:10.317 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap 2024-08-24T21:01:10.317 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-i2c.ko 2024-08-24T21:01:10.317 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-mmio.ko 2024-08-24T21:01:10.317 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma 2024-08-24T21:01:10.317 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma/bcma.ko 2024-08-24T21:01:10.317 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block 2024-08-24T21:01:10.317 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe 2024-08-24T21:01:10.317 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe/aoe.ko 2024-08-24T21:01:10.317 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/brd.ko 2024-08-24T21:01:10.317 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd 2024-08-24T21:01:10.317 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd/drbd.ko 2024-08-24T21:01:10.318 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/floppy.ko 2024-08-24T21:01:10.318 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/loop.ko 2024-08-24T21:01:10.318 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx 2024-08-24T21:01:10.318 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-08-24T21:01:10.318 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/nbd.ko 2024-08-24T21:01:10.318 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk 2024-08-24T21:01:10.318 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk/null_blk.ko 2024-08-24T21:01:10.318 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/pktcdvd.ko 2024-08-24T21:01:10.318 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/rbd.ko 2024-08-24T21:01:10.318 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/virtio_blk.ko 2024-08-24T21:01:10.318 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback 2024-08-24T21:01:10.318 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-08-24T21:01:10.319 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkfront.ko 2024-08-24T21:01:10.319 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram 2024-08-24T21:01:10.319 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram/zram.ko 2024-08-24T21:01:10.319 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char 2024-08-24T21:01:10.319 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hangcheck-timer.ko 2024-08-24T21:01:10.319 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random 2024-08-24T21:01:10.319 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/amd-rng.ko 2024-08-24T21:01:10.319 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/intel-rng.ko 2024-08-24T21:01:10.319 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-08-24T21:01:10.319 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/via-rng.ko 2024-08-24T21:01:10.320 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/virtio-rng.ko 2024-08-24T21:01:10.320 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi 2024-08-24T21:01:10.320 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-08-24T21:01:10.320 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-08-24T21:01:10.320 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-08-24T21:01:10.320 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_si.ko 2024-08-24T21:01:10.320 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-08-24T21:01:10.320 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-08-24T21:01:10.320 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/lp.ko 2024-08-24T21:01:10.320 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave 2024-08-24T21:01:10.320 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave/mwave.ko 2024-08-24T21:01:10.320 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ppdev.ko 2024-08-24T21:01:10.320 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tlclk.ko 2024-08-24T21:01:10.320 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm 2024-08-24T21:01:10.321 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm.ko 2024-08-24T21:01:10.321 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_atmel.ko 2024-08-24T21:01:10.321 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_infineon.ko 2024-08-24T21:01:10.321 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_nsc.ko 2024-08-24T21:01:10.321 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis.ko 2024-08-24T21:01:10.321 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-08-24T21:01:10.321 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/uv_mmtimer.ko 2024-08-24T21:01:10.321 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/virtio_console.ko 2024-08-24T21:01:10.321 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq 2024-08-24T21:01:10.321 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-08-24T21:01:10.321 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-08-24T21:01:10.321 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/p4-clockmod.ko 2024-08-24T21:01:10.322 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-08-24T21:01:10.322 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/powernow-k8.ko 2024-08-24T21:01:10.322 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/speedstep-lib.ko 2024-08-24T21:01:10.322 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto 2024-08-24T21:01:10.322 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp 2024-08-24T21:01:10.322 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-08-24T21:01:10.322 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp.ko 2024-08-24T21:01:10.322 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel 2024-08-24T21:01:10.322 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat 2024-08-24T21:01:10.322 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common 2024-08-24T21:01:10.322 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-08-24T21:01:10.322 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-08-24T21:01:10.322 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-08-24T21:01:10.323 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-aes.ko 2024-08-24T21:01:10.323 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-sha.ko 2024-08-24T21:01:10.323 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio 2024-08-24T21:01:10.323 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-08-24T21:01:10.323 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca 2024-08-24T21:01:10.323 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca/dca.ko 2024-08-24T21:01:10.323 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq 2024-08-24T21:01:10.323 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-08-24T21:01:10.323 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma 2024-08-24T21:01:10.323 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw 2024-08-24T21:01:10.323 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw/dw_dmac.ko 2024-08-24T21:01:10.323 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat 2024-08-24T21:01:10.324 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat/ioatdma.ko 2024-08-24T21:01:10.324 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac 2024-08-24T21:01:10.324 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/amd64_edac.ko 2024-08-24T21:01:10.324 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/e752x_edac.ko 2024-08-24T21:01:10.324 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/edac_mce_amd.ko 2024-08-24T21:01:10.324 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3000_edac.ko 2024-08-24T21:01:10.324 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3200_edac.ko 2024-08-24T21:01:10.324 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5100_edac.ko 2024-08-24T21:01:10.324 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5400_edac.ko 2024-08-24T21:01:10.324 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7300_edac.ko 2024-08-24T21:01:10.324 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7core_edac.ko 2024-08-24T21:01:10.324 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i82975x_edac.ko 2024-08-24T21:01:10.325 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/ie31200_edac.ko 2024-08-24T21:01:10.325 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/sb_edac.ko 2024-08-24T21:01:10.325 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/x38_edac.ko 2024-08-24T21:01:10.325 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware 2024-08-24T21:01:10.325 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/edd.ko 2024-08-24T21:01:10.325 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/iscsi_ibft.ko 2024-08-24T21:01:10.325 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio 2024-08-24T21:01:10.325 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-ich.ko 2024-08-24T21:01:10.325 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-viperboard.ko 2024-08-24T21:01:10.325 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid 2024-08-24T21:01:10.325 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-appleir.ko 2024-08-24T21:01:10.325 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-aureal.ko 2024-08-24T21:01:10.325 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-axff.ko 2024-08-24T21:01:10.325 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-dr.ko 2024-08-24T21:01:10.326 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elecom.ko 2024-08-24T21:01:10.326 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elo.ko 2024-08-24T21:01:10.326 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-emsff.ko 2024-08-24T21:01:10.326 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gaff.ko 2024-08-24T21:01:10.326 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gt683r.ko 2024-08-24T21:01:10.326 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gyration.ko 2024-08-24T21:01:10.326 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-kbd.ko 2024-08-24T21:01:10.326 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-mouse.ko 2024-08-24T21:01:10.326 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtekff.ko 2024-08-24T21:01:10.326 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-hyperv.ko 2024-08-24T21:01:10.326 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-icade.ko 2024-08-24T21:01:10.326 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-keytouch.ko 2024-08-24T21:01:10.327 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-kye.ko 2024-08-24T21:01:10.327 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lcpower.ko 2024-08-24T21:01:10.327 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-led.ko 2024-08-24T21:01:10.327 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lenovo.ko 2024-08-24T21:01:10.327 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-dj.ko 2024-08-24T21:01:10.327 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-08-24T21:01:10.327 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-multitouch.ko 2024-08-24T21:01:10.327 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-ortek.ko 2024-08-24T21:01:10.327 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-penmount.ko 2024-08-24T21:01:10.327 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-petalynx.ko 2024-08-24T21:01:10.327 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-picolcd.ko 2024-08-24T21:01:10.327 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-pl.ko 2024-08-24T21:01:10.328 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-plantronics.ko 2024-08-24T21:01:10.328 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-primax.ko 2024-08-24T21:01:10.328 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-rmi.ko 2024-08-24T21:01:10.328 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-arvo.ko 2024-08-24T21:01:10.328 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-common.ko 2024-08-24T21:01:10.328 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-isku.ko 2024-08-24T21:01:10.328 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kone.ko 2024-08-24T21:01:10.328 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-08-24T21:01:10.328 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-konepure.ko 2024-08-24T21:01:10.328 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-08-24T21:01:10.328 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-lua.ko 2024-08-24T21:01:10.328 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-pyra.ko 2024-08-24T21:01:10.329 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-ryos.ko 2024-08-24T21:01:10.329 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-savu.ko 2024-08-24T21:01:10.329 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat.ko 2024-08-24T21:01:10.329 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-saitek.ko 2024-08-24T21:01:10.329 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-samsung.ko 2024-08-24T21:01:10.329 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sensor-hub.ko 2024-08-24T21:01:10.329 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sjoy.ko 2024-08-24T21:01:10.329 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sony.ko 2024-08-24T21:01:10.329 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-speedlink.ko 2024-08-24T21:01:10.329 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-steelseries.ko 2024-08-24T21:01:10.329 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sunplus.ko 2024-08-24T21:01:10.329 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-thrustmaster.ko 2024-08-24T21:01:10.330 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tivo.ko 2024-08-24T21:01:10.330 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tmff.ko 2024-08-24T21:01:10.330 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-topseed.ko 2024-08-24T21:01:10.330 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-twinhan.ko 2024-08-24T21:01:10.330 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-uclogic.ko 2024-08-24T21:01:10.330 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-waltop.ko 2024-08-24T21:01:10.330 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-wiimote.ko 2024-08-24T21:01:10.330 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-xinmo.ko 2024-08-24T21:01:10.330 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zpff.ko 2024-08-24T21:01:10.330 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zydacron.ko 2024-08-24T21:01:10.330 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/uhid.ko 2024-08-24T21:01:10.330 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/wacom.ko 2024-08-24T21:01:10.330 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv 2024-08-24T21:01:10.331 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_balloon.ko 2024-08-24T21:01:10.331 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_utils.ko 2024-08-24T21:01:10.331 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_vmbus.ko 2024-08-24T21:01:10.331 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon 2024-08-24T21:01:10.331 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru.ko 2024-08-24T21:01:10.331 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru3.ko 2024-08-24T21:01:10.331 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/acpi_power_meter.ko 2024-08-24T21:01:10.331 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7414.ko 2024-08-24T21:01:10.331 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7418.ko 2024-08-24T21:01:10.331 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adc128d818.ko 2024-08-24T21:01:10.331 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1025.ko 2024-08-24T21:01:10.331 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1026.ko 2024-08-24T21:01:10.332 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1029.ko 2024-08-24T21:01:10.332 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1031.ko 2024-08-24T21:01:10.332 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm9240.ko 2024-08-24T21:01:10.332 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ads7828.ko 2024-08-24T21:01:10.332 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7410.ko 2024-08-24T21:01:10.332 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7411.ko 2024-08-24T21:01:10.332 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7462.ko 2024-08-24T21:01:10.332 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7470.ko 2024-08-24T21:01:10.332 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7475.ko 2024-08-24T21:01:10.332 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7x10.ko 2024-08-24T21:01:10.332 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/amc6821.ko 2024-08-24T21:01:10.332 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/applesmc.ko 2024-08-24T21:01:10.332 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asb100.ko 2024-08-24T21:01:10.333 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asc7621.ko 2024-08-24T21:01:10.333 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asus_atk0110.ko 2024-08-24T21:01:10.333 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/atxp1.ko 2024-08-24T21:01:10.333 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/coretemp.ko 2024-08-24T21:01:10.333 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-08-24T21:01:10.333 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dme1737.ko 2024-08-24T21:01:10.333 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds1621.ko 2024-08-24T21:01:10.333 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds620.ko 2024-08-24T21:01:10.333 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc1403.ko 2024-08-24T21:01:10.333 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc6w201.ko 2024-08-24T21:01:10.333 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71805f.ko 2024-08-24T21:01:10.333 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71882fg.ko 2024-08-24T21:01:10.333 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f75375s.ko 2024-08-24T21:01:10.334 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fam15h_power.ko 2024-08-24T21:01:10.334 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fschmd.ko 2024-08-24T21:01:10.334 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g760a.ko 2024-08-24T21:01:10.334 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g762.ko 2024-08-24T21:01:10.334 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl518sm.ko 2024-08-24T21:01:10.334 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl520sm.ko 2024-08-24T21:01:10.334 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/hwmon-vid.ko 2024-08-24T21:01:10.334 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5500_temp.ko 2024-08-24T21:01:10.334 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5k_amb.ko 2024-08-24T21:01:10.335 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmaem.ko 2024-08-24T21:01:10.335 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmpex.ko 2024-08-24T21:01:10.335 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina209.ko 2024-08-24T21:01:10.335 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina2xx.ko 2024-08-24T21:01:10.335 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/it87.ko 2024-08-24T21:01:10.335 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k10temp.ko 2024-08-24T21:01:10.335 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k8temp.ko 2024-08-24T21:01:10.335 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lineage-pem.ko 2024-08-24T21:01:10.335 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm63.ko 2024-08-24T21:01:10.335 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm73.ko 2024-08-24T21:01:10.335 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm75.ko 2024-08-24T21:01:10.335 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm77.ko 2024-08-24T21:01:10.336 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm78.ko 2024-08-24T21:01:10.336 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm80.ko 2024-08-24T21:01:10.336 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm83.ko 2024-08-24T21:01:10.336 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm85.ko 2024-08-24T21:01:10.336 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm87.ko 2024-08-24T21:01:10.336 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm90.ko 2024-08-24T21:01:10.336 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm92.ko 2024-08-24T21:01:10.336 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm93.ko 2024-08-24T21:01:10.336 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95234.ko 2024-08-24T21:01:10.336 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95241.ko 2024-08-24T21:01:10.336 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95245.ko 2024-08-24T21:01:10.336 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc2945.ko 2024-08-24T21:01:10.336 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4151.ko 2024-08-24T21:01:10.337 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4215.ko 2024-08-24T21:01:10.337 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4222.ko 2024-08-24T21:01:10.337 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4245.ko 2024-08-24T21:01:10.337 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4260.ko 2024-08-24T21:01:10.337 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4261.ko 2024-08-24T21:01:10.337 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max16065.ko 2024-08-24T21:01:10.337 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1619.ko 2024-08-24T21:01:10.337 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1668.ko 2024-08-24T21:01:10.337 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max197.ko 2024-08-24T21:01:10.337 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6639.ko 2024-08-24T21:01:10.337 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6650.ko 2024-08-24T21:01:10.337 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6697.ko 2024-08-24T21:01:10.338 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/mcp3021.ko 2024-08-24T21:01:10.338 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6683.ko 2024-08-24T21:01:10.338 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775-core.ko 2024-08-24T21:01:10.338 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775.ko 2024-08-24T21:01:10.338 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct7802.ko 2024-08-24T21:01:10.338 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87360.ko 2024-08-24T21:01:10.338 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87427.ko 2024-08-24T21:01:10.338 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pcf8591.ko 2024-08-24T21:01:10.338 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus 2024-08-24T21:01:10.338 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-08-24T21:01:10.338 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-08-24T21:01:10.338 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-08-24T21:01:10.338 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max16064.ko 2024-08-24T21:01:10.339 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max34440.ko 2024-08-24T21:01:10.339 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max8688.ko 2024-08-24T21:01:10.339 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-08-24T21:01:10.339 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-08-24T21:01:10.339 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-08-24T21:01:10.339 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-08-24T21:01:10.339 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-08-24T21:01:10.339 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-08-24T21:01:10.339 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/powr1220.ko 2024-08-24T21:01:10.339 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5627.ko 2024-08-24T21:01:10.339 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5636.ko 2024-08-24T21:01:10.339 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch56xx-common.ko 2024-08-24T21:01:10.339 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht15.ko 2024-08-24T21:01:10.340 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht21.ko 2024-08-24T21:01:10.340 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/shtc1.ko 2024-08-24T21:01:10.340 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sis5595.ko 2024-08-24T21:01:10.340 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47b397.ko 2024-08-24T21:01:10.340 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m1.ko 2024-08-24T21:01:10.340 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m192.ko 2024-08-24T21:01:10.340 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/thmc50.ko 2024-08-24T21:01:10.340 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp102.ko 2024-08-24T21:01:10.340 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp103.ko 2024-08-24T21:01:10.340 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp401.ko 2024-08-24T21:01:10.340 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp421.ko 2024-08-24T21:01:10.340 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via-cputemp.ko 2024-08-24T21:01:10.340 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via686a.ko 2024-08-24T21:01:10.341 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt1211.ko 2024-08-24T21:01:10.341 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt8231.ko 2024-08-24T21:01:10.341 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627ehf.ko 2024-08-24T21:01:10.341 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627hf.ko 2024-08-24T21:01:10.341 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83781d.ko 2024-08-24T21:01:10.341 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83791d.ko 2024-08-24T21:01:10.341 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83792d.ko 2024-08-24T21:01:10.341 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83793.ko 2024-08-24T21:01:10.341 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83795.ko 2024-08-24T21:01:10.341 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l785ts.ko 2024-08-24T21:01:10.341 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l786ng.ko 2024-08-24T21:01:10.341 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c 2024-08-24T21:01:10.342 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos 2024-08-24T21:01:10.342 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-08-24T21:01:10.342 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-08-24T21:01:10.342 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses 2024-08-24T21:01:10.342 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-08-24T21:01:10.342 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-08-24T21:01:10.342 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-08-24T21:01:10.342 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-08-24T21:01:10.342 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-08-24T21:01:10.342 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-08-24T21:01:10.342 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-08-24T21:01:10.342 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-08-24T21:01:10.343 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-i801.ko 2024-08-24T21:01:10.343 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-isch.ko 2024-08-24T21:01:10.343 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-08-24T21:01:10.343 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-08-24T21:01:10.343 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-08-24T21:01:10.343 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-parport.ko 2024-08-24T21:01:10.343 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-08-24T21:01:10.343 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-08-24T21:01:10.343 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-08-24T21:01:10.343 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-08-24T21:01:10.343 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-08-24T21:01:10.343 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-08-24T21:01:10.343 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-via.ko 2024-08-24T21:01:10.344 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-08-24T21:01:10.344 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-08-24T21:01:10.344 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-dev.ko 2024-08-24T21:01:10.344 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-mux.ko 2024-08-24T21:01:10.344 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-08-24T21:01:10.344 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-smbus.ko 2024-08-24T21:01:10.344 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-stub.ko 2024-08-24T21:01:10.344 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband 2024-08-24T21:01:10.344 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core 2024-08-24T21:01:10.344 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_cm.ko 2024-08-24T21:01:10.344 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_core.ko 2024-08-24T21:01:10.344 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_umad.ko 2024-08-24T21:01:10.344 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-08-24T21:01:10.344 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/iw_cm.ko 2024-08-24T21:01:10.345 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_cm.ko 2024-08-24T21:01:10.345 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-08-24T21:01:10.345 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw 2024-08-24T21:01:10.345 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4 2024-08-24T21:01:10.345 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-08-24T21:01:10.345 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4 2024-08-24T21:01:10.345 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-08-24T21:01:10.345 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5 2024-08-24T21:01:10.345 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-08-24T21:01:10.345 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca 2024-08-24T21:01:10.345 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-08-24T21:01:10.345 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp 2024-08-24T21:01:10.345 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib 2024-08-24T21:01:10.346 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-08-24T21:01:10.346 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser 2024-08-24T21:01:10.346 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-08-24T21:01:10.346 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert 2024-08-24T21:01:10.346 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-08-24T21:01:10.346 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp 2024-08-24T21:01:10.346 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-08-24T21:01:10.346 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt 2024-08-24T21:01:10.346 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-08-24T21:01:10.346 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input 2024-08-24T21:01:10.346 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport 2024-08-24T21:01:10.346 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-08-24T21:01:10.347 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/fm801-gp.ko 2024-08-24T21:01:10.347 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/gameport.ko 2024-08-24T21:01:10.347 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/joydev.ko 2024-08-24T21:01:10.347 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard 2024-08-24T21:01:10.347 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/gpio_keys.ko 2024-08-24T21:01:10.347 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse 2024-08-24T21:01:10.347 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/appletouch.ko 2024-08-24T21:01:10.347 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/bcm5974.ko 2024-08-24T21:01:10.347 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/cyapatp.ko 2024-08-24T21:01:10.347 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/elan_i2c.ko 2024-08-24T21:01:10.347 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/sermouse.ko 2024-08-24T21:01:10.347 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-08-24T21:01:10.348 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_usb.ko 2024-08-24T21:01:10.348 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/vsxxxaa.ko 2024-08-24T21:01:10.348 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4 2024-08-24T21:01:10.348 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4/rmi_core.ko 2024-08-24T21:01:10.348 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio 2024-08-24T21:01:10.348 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/altera_ps2.ko 2024-08-24T21:01:10.348 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/arc_ps2.ko 2024-08-24T21:01:10.348 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-08-24T21:01:10.348 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/serio_raw.ko 2024-08-24T21:01:10.348 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/sparse-keymap.ko 2024-08-24T21:01:10.348 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds 2024-08-24T21:01:10.348 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-blinkm.ko 2024-08-24T21:01:10.348 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lm3530.ko 2024-08-24T21:01:10.349 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lp3944.ko 2024-08-24T21:01:10.349 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-ss4200.ko 2024-08-24T21:01:10.349 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger 2024-08-24T21:01:10.349 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-08-24T21:01:10.349 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-08-24T21:01:10.349 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-08-24T21:01:10.349 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-08-24T21:01:10.349 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-08-24T21:01:10.349 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-08-24T21:01:10.349 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-08-24T21:01:10.349 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-08-24T21:01:10.349 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md 2024-08-24T21:01:10.349 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache 2024-08-24T21:01:10.350 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache/bcache.ko 2024-08-24T21:01:10.350 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-bio-prison.ko 2024-08-24T21:01:10.350 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache-smq.ko 2024-08-24T21:01:10.350 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache.ko 2024-08-24T21:01:10.350 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-crypt.ko 2024-08-24T21:01:10.350 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-delay.ko 2024-08-24T21:01:10.350 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-flakey.ko 2024-08-24T21:01:10.350 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-log-userspace.ko 2024-08-24T21:01:10.350 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-multipath.ko 2024-08-24T21:01:10.350 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-queue-length.ko 2024-08-24T21:01:10.350 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-raid.ko 2024-08-24T21:01:10.350 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-round-robin.ko 2024-08-24T21:01:10.351 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-service-time.ko 2024-08-24T21:01:10.351 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-switch.ko 2024-08-24T21:01:10.351 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-thin-pool.ko 2024-08-24T21:01:10.351 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-verity.ko 2024-08-24T21:01:10.351 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data 2024-08-24T21:01:10.351 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-08-24T21:01:10.351 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid0.ko 2024-08-24T21:01:10.351 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid1.ko 2024-08-24T21:01:10.351 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid10.ko 2024-08-24T21:01:10.351 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid456.ko 2024-08-24T21:01:10.351 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message 2024-08-24T21:01:10.351 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion 2024-08-24T21:01:10.351 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptbase.ko 2024-08-24T21:01:10.352 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptctl.ko 2024-08-24T21:01:10.352 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptfc.ko 2024-08-24T21:01:10.352 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptlan.ko 2024-08-24T21:01:10.352 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptsas.ko 2024-08-24T21:01:10.352 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptscsih.ko 2024-08-24T21:01:10.352 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptspi.ko 2024-08-24T21:01:10.352 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd 2024-08-24T21:01:10.352 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_ich.ko 2024-08-24T21:01:10.352 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_sch.ko 2024-08-24T21:01:10.352 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/mfd-core.ko 2024-08-24T21:01:10.352 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/sm501.ko 2024-08-24T21:01:10.352 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/viperboard.ko 2024-08-24T21:01:10.352 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/vx855.ko 2024-08-24T21:01:10.353 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/wl1273-core.ko 2024-08-24T21:01:10.353 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc 2024-08-24T21:01:10.353 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl 2024-08-24T21:01:10.353 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-08-24T21:01:10.353 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds9802als.ko 2024-08-24T21:01:10.353 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds990x.ko 2024-08-24T21:01:10.353 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/bh1770glc.ko 2024-08-24T21:01:10.353 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710 2024-08-24T21:01:10.353 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710/cb710.ko 2024-08-24T21:01:10.353 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom 2024-08-24T21:01:10.353 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/at24.ko 2024-08-24T21:01:10.353 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-08-24T21:01:10.353 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/max6875.ko 2024-08-24T21:01:10.354 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/enclosure.ko 2024-08-24T21:01:10.354 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/hpilo.ko 2024-08-24T21:01:10.354 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29003.ko 2024-08-24T21:01:10.354 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29020.ko 2024-08-24T21:01:10.354 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d 2024-08-24T21:01:10.354 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-08-24T21:01:10.354 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-08-24T21:01:10.354 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei 2024-08-24T21:01:10.354 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-me.ko 2024-08-24T21:01:10.354 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-txe.ko 2024-08-24T21:01:10.354 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei.ko 2024-08-24T21:01:10.354 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru 2024-08-24T21:01:10.355 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru/gru.ko 2024-08-24T21:01:10.355 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp 2024-08-24T21:01:10.355 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xp.ko 2024-08-24T21:01:10.355 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpc.ko 2024-08-24T21:01:10.355 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-08-24T21:01:10.355 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_7xx1.ko 2024-08-24T21:01:10.355 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_core.ko 2024-08-24T21:01:10.355 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tsl2550.ko 2024-08-24T21:01:10.355 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_balloon.ko 2024-08-24T21:01:10.355 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci 2024-08-24T21:01:10.355 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-08-24T21:01:10.356 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net 2024-08-24T21:01:10.356 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding 2024-08-24T21:01:10.356 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding/bonding.ko 2024-08-24T21:01:10.356 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa 2024-08-24T21:01:10.356 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53 2024-08-24T21:01:10.356 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53/b53_common.ko 2024-08-24T21:01:10.356 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/bcm-sf2.ko 2024-08-24T21:01:10.356 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6060.ko 2024-08-24T21:01:10.356 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx 2024-08-24T21:01:10.356 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-08-24T21:01:10.356 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dummy.ko 2024-08-24T21:01:10.356 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/eql.ko 2024-08-24T21:01:10.356 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet 2024-08-24T21:01:10.357 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com 2024-08-24T21:01:10.357 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-08-24T21:01:10.357 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-08-24T21:01:10.357 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-08-24T21:01:10.357 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-08-24T21:01:10.357 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390 2024-08-24T21:01:10.357 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/8390.ko 2024-08-24T21:01:10.357 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-08-24T21:01:10.357 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-08-24T21:01:10.357 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-08-24T21:01:10.357 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec 2024-08-24T21:01:10.357 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-08-24T21:01:10.357 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere 2024-08-24T21:01:10.358 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere/et131x.ko 2024-08-24T21:01:10.358 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon 2024-08-24T21:01:10.358 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-08-24T21:01:10.358 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera 2024-08-24T21:01:10.358 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-08-24T21:01:10.358 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd 2024-08-24T21:01:10.358 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-08-24T21:01:10.358 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-08-24T21:01:10.358 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-08-24T21:01:10.358 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros 2024-08-24T21:01:10.358 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx 2024-08-24T21:01:10.358 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-08-24T21:01:10.358 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c 2024-08-24T21:01:10.359 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-08-24T21:01:10.359 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e 2024-08-24T21:01:10.359 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-08-24T21:01:10.359 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx 2024-08-24T21:01:10.359 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-08-24T21:01:10.359 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-08-24T21:01:10.359 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom 2024-08-24T21:01:10.359 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-08-24T21:01:10.359 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-08-24T21:01:10.359 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-08-24T21:01:10.359 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-08-24T21:01:10.359 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-08-24T21:01:10.360 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet 2024-08-24T21:01:10.360 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-08-24T21:01:10.360 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-08-24T21:01:10.360 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade 2024-08-24T21:01:10.360 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna 2024-08-24T21:01:10.360 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-08-24T21:01:10.360 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio 2024-08-24T21:01:10.360 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb 2024-08-24T21:01:10.360 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-08-24T21:01:10.360 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-08-24T21:01:10.360 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-08-24T21:01:10.360 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-08-24T21:01:10.360 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-08-24T21:01:10.361 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-08-24T21:01:10.361 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-08-24T21:01:10.361 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-08-24T21:01:10.361 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-08-24T21:01:10.361 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco 2024-08-24T21:01:10.361 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic 2024-08-24T21:01:10.361 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-08-24T21:01:10.361 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec 2024-08-24T21:01:10.361 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip 2024-08-24T21:01:10.361 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-08-24T21:01:10.361 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-08-24T21:01:10.361 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-08-24T21:01:10.361 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-08-24T21:01:10.362 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-08-24T21:01:10.362 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-08-24T21:01:10.362 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink 2024-08-24T21:01:10.362 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-08-24T21:01:10.362 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-08-24T21:01:10.362 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dnet.ko 2024-08-24T21:01:10.362 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex 2024-08-24T21:01:10.362 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet 2024-08-24T21:01:10.362 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-08-24T21:01:10.362 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ethoc.ko 2024-08-24T21:01:10.362 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/fealnx.ko 2024-08-24T21:01:10.362 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel 2024-08-24T21:01:10.362 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e100.ko 2024-08-24T21:01:10.363 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000 2024-08-24T21:01:10.363 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-08-24T21:01:10.363 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e 2024-08-24T21:01:10.363 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-08-24T21:01:10.363 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k 2024-08-24T21:01:10.363 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-08-24T21:01:10.363 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e 2024-08-24T21:01:10.363 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-08-24T21:01:10.363 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf 2024-08-24T21:01:10.363 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-08-24T21:01:10.363 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb 2024-08-24T21:01:10.363 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-08-24T21:01:10.363 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf 2024-08-24T21:01:10.363 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-08-24T21:01:10.364 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe 2024-08-24T21:01:10.364 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-08-24T21:01:10.364 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf 2024-08-24T21:01:10.364 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-08-24T21:01:10.364 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth 2024-08-24T21:01:10.364 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-08-24T21:01:10.364 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie 2024-08-24T21:01:10.364 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-08-24T21:01:10.364 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/jme.ko 2024-08-24T21:01:10.364 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell 2024-08-24T21:01:10.364 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-08-24T21:01:10.364 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/skge.ko 2024-08-24T21:01:10.365 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-08-24T21:01:10.365 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox 2024-08-24T21:01:10.365 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4 2024-08-24T21:01:10.365 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-08-24T21:01:10.365 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-08-24T21:01:10.365 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5 2024-08-24T21:01:10.365 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-08-24T21:01:10.365 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-08-24T21:01:10.365 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel 2024-08-24T21:01:10.365 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-08-24T21:01:10.365 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom 2024-08-24T21:01:10.365 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge 2024-08-24T21:01:10.365 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-08-24T21:01:10.366 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi 2024-08-24T21:01:10.366 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-08-24T21:01:10.366 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-08-24T21:01:10.366 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion 2024-08-24T21:01:10.366 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-08-24T21:01:10.366 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia 2024-08-24T21:01:10.366 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-08-24T21:01:10.366 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines 2024-08-24T21:01:10.366 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-08-24T21:01:10.366 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-08-24T21:01:10.366 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic 2024-08-24T21:01:10.366 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen 2024-08-24T21:01:10.367 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-08-24T21:01:10.367 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-08-24T21:01:10.367 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-08-24T21:01:10.367 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-08-24T21:01:10.367 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc 2024-08-24T21:01:10.367 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-08-24T21:01:10.367 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek 2024-08-24T21:01:10.367 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-08-24T21:01:10.367 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-08-24T21:01:10.367 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/atp.ko 2024-08-24T21:01:10.367 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-08-24T21:01:10.367 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker 2024-08-24T21:01:10.367 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-08-24T21:01:10.368 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc 2024-08-24T21:01:10.368 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-08-24T21:01:10.368 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan 2024-08-24T21:01:10.368 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-08-24T21:01:10.368 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis 2024-08-24T21:01:10.368 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis190.ko 2024-08-24T21:01:10.368 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis900.ko 2024-08-24T21:01:10.368 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc 2024-08-24T21:01:10.368 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-08-24T21:01:10.368 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-08-24T21:01:10.368 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-08-24T21:01:10.368 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-08-24T21:01:10.368 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro 2024-08-24T21:01:10.368 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac 2024-08-24T21:01:10.369 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-08-24T21:01:10.369 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-08-24T21:01:10.369 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun 2024-08-24T21:01:10.369 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/cassini.ko 2024-08-24T21:01:10.369 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/niu.ko 2024-08-24T21:01:10.369 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sungem.ko 2024-08-24T21:01:10.369 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-08-24T21:01:10.369 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti 2024-08-24T21:01:10.369 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-08-24T21:01:10.369 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti 2024-08-24T21:01:10.369 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti/tlan.ko 2024-08-24T21:01:10.369 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via 2024-08-24T21:01:10.370 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-08-24T21:01:10.370 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-08-24T21:01:10.370 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet 2024-08-24T21:01:10.370 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-08-24T21:01:10.370 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-08-24T21:01:10.370 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom 2024-08-24T21:01:10.370 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-08-24T21:01:10.370 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/geneve.ko 2024-08-24T21:01:10.370 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv 2024-08-24T21:01:10.370 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-08-24T21:01:10.370 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154 2024-08-24T21:01:10.370 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154/fakelb.ko 2024-08-24T21:01:10.370 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ifb.ko 2024-08-24T21:01:10.371 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan 2024-08-24T21:01:10.371 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan/ipvlan.ko 2024-08-24T21:01:10.371 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvlan.ko 2024-08-24T21:01:10.371 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvtap.ko 2024-08-24T21:01:10.371 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio 2024-08-24T21:01:10.371 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio.ko 2024-08-24T21:01:10.371 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-08-24T21:01:10.371 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-08-24T21:01:10.371 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-regmap.ko 2024-08-24T21:01:10.371 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mii.ko 2024-08-24T21:01:10.371 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/net_failover.ko 2024-08-24T21:01:10.371 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/netconsole.ko 2024-08-24T21:01:10.371 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/nlmon.ko 2024-08-24T21:01:10.372 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs 2024-08-24T21:01:10.372 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs-lynx.ko 2024-08-24T21:01:10.372 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-08-24T21:01:10.372 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy 2024-08-24T21:01:10.372 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/amd.ko 2024-08-24T21:01:10.372 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-08-24T21:01:10.372 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-08-24T21:01:10.372 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm7xxx.ko 2024-08-24T21:01:10.372 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm87xx.ko 2024-08-24T21:01:10.372 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/broadcom.ko 2024-08-24T21:01:10.372 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/cicada.ko 2024-08-24T21:01:10.372 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/davicom.ko 2024-08-24T21:01:10.373 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/dp83640.ko 2024-08-24T21:01:10.373 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/et1011c.ko 2024-08-24T21:01:10.373 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/icplus.ko 2024-08-24T21:01:10.373 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/lxt.ko 2024-08-24T21:01:10.373 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/marvell.ko 2024-08-24T21:01:10.373 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/micrel.ko 2024-08-24T21:01:10.373 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/national.ko 2024-08-24T21:01:10.373 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/phylink.ko 2024-08-24T21:01:10.373 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/qsemi.ko 2024-08-24T21:01:10.373 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/realtek.ko 2024-08-24T21:01:10.373 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/smsc.ko 2024-08-24T21:01:10.373 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/ste10Xp.ko 2024-08-24T21:01:10.373 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/vitesse.ko 2024-08-24T21:01:10.374 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp 2024-08-24T21:01:10.374 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/bsd_comp.ko 2024-08-24T21:01:10.374 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_async.ko 2024-08-24T21:01:10.374 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_deflate.ko 2024-08-24T21:01:10.374 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_generic.ko 2024-08-24T21:01:10.374 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_mppe.ko 2024-08-24T21:01:10.374 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_synctty.ko 2024-08-24T21:01:10.374 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppoe.ko 2024-08-24T21:01:10.374 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppox.ko 2024-08-24T21:01:10.374 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pptp.ko 2024-08-24T21:01:10.374 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip 2024-08-24T21:01:10.374 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slhc.ko 2024-08-24T21:01:10.374 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slip.ko 2024-08-24T21:01:10.375 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/sungem_phy.ko 2024-08-24T21:01:10.375 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tap.ko 2024-08-24T21:01:10.375 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team 2024-08-24T21:01:10.375 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team.ko 2024-08-24T21:01:10.375 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_activebackup.ko 2024-08-24T21:01:10.375 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_broadcast.ko 2024-08-24T21:01:10.375 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-08-24T21:01:10.375 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_random.ko 2024-08-24T21:01:10.375 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-08-24T21:01:10.375 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tun.ko 2024-08-24T21:01:10.375 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/veth.ko 2024-08-24T21:01:10.375 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/virtio_net.ko 2024-08-24T21:01:10.375 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3 2024-08-24T21:01:10.376 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-08-24T21:01:10.376 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan 2024-08-24T21:01:10.376 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan/vxlan.ko 2024-08-24T21:01:10.376 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback 2024-08-24T21:01:10.376 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback/xen-netback.ko 2024-08-24T21:01:10.376 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netfront.ko 2024-08-24T21:01:10.376 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb 2024-08-24T21:01:10.376 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb/ntb.ko 2024-08-24T21:01:10.376 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme 2024-08-24T21:01:10.376 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host 2024-08-24T21:01:10.376 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme-core.ko 2024-08-24T21:01:10.376 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme.ko 2024-08-24T21:01:10.377 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport 2024-08-24T21:01:10.377 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport.ko 2024-08-24T21:01:10.377 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_cs.ko 2024-08-24T21:01:10.377 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_pc.ko 2024-08-24T21:01:10.377 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_serial.ko 2024-08-24T21:01:10.377 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci 2024-08-24T21:01:10.377 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug 2024-08-24T21:01:10.377 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-08-24T21:01:10.377 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie 2024-08-24T21:01:10.377 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie/aer_inject.ko 2024-08-24T21:01:10.377 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/xen-pcifront.ko 2024-08-24T21:01:10.377 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia 2024-08-24T21:01:10.377 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/i82092.ko 2024-08-24T21:01:10.378 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/pd6729.ko 2024-08-24T21:01:10.378 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/yenta_socket.ko 2024-08-24T21:01:10.378 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl 2024-08-24T21:01:10.378 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel 2024-08-24T21:01:10.378 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-08-24T21:01:10.378 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform 2024-08-24T21:01:10.378 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86 2024-08-24T21:01:10.378 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acer-wmi.ko 2024-08-24T21:01:10.378 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acerhdf.ko 2024-08-24T21:01:10.378 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/apple-gmux.ko 2024-08-24T21:01:10.378 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-laptop.ko 2024-08-24T21:01:10.378 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-08-24T21:01:10.379 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-wmi.ko 2024-08-24T21:01:10.379 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/classmate-laptop.ko 2024-08-24T21:01:10.379 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-08-24T21:01:10.379 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-08-24T21:01:10.379 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-08-24T21:01:10.379 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-08-24T21:01:10.379 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/hdaps.ko 2024-08-24T21:01:10.379 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel 2024-08-24T21:01:10.379 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-08-24T21:01:10.379 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel_ips.ko 2024-08-24T21:01:10.379 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/msi-wmi.ko 2024-08-24T21:01:10.379 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/mxm-wmi.ko 2024-08-24T21:01:10.380 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-08-24T21:01:10.380 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-laptop.ko 2024-08-24T21:01:10.380 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-q10.ko 2024-08-24T21:01:10.380 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/topstar-laptop.ko 2024-08-24T21:01:10.380 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-08-24T21:01:10.380 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_haps.ko 2024-08-24T21:01:10.380 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi-bmof.ko 2024-08-24T21:01:10.380 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi.ko 2024-08-24T21:01:10.380 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap 2024-08-24T21:01:10.380 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_common.ko 2024-08-24T21:01:10.380 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_msr.ko 2024-08-24T21:01:10.380 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps 2024-08-24T21:01:10.380 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients 2024-08-24T21:01:10.380 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-gpio.ko 2024-08-24T21:01:10.381 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-ldisc.ko 2024-08-24T21:01:10.381 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps_parport.ko 2024-08-24T21:01:10.381 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/pps_core.ko 2024-08-24T21:01:10.381 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp 2024-08-24T21:01:10.381 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp.ko 2024-08-24T21:01:10.381 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp_kvm.ko 2024-08-24T21:01:10.381 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras 2024-08-24T21:01:10.381 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd 2024-08-24T21:01:10.381 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl 2024-08-24T21:01:10.381 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-08-24T21:01:10.381 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/fmpm.ko 2024-08-24T21:01:10.382 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc 2024-08-24T21:01:10.382 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-bq32k.ko 2024-08-24T21:01:10.382 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1286.ko 2024-08-24T21:01:10.382 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1307.ko 2024-08-24T21:01:10.382 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1374.ko 2024-08-24T21:01:10.382 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1511.ko 2024-08-24T21:01:10.382 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1553.ko 2024-08-24T21:01:10.382 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1672.ko 2024-08-24T21:01:10.382 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1742.ko 2024-08-24T21:01:10.382 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds2404.ko 2024-08-24T21:01:10.382 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds3232.ko 2024-08-24T21:01:10.382 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-em3027.ko 2024-08-24T21:01:10.383 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-fm3130.ko 2024-08-24T21:01:10.383 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl12022.ko 2024-08-24T21:01:10.383 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl1208.ko 2024-08-24T21:01:10.383 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m41t80.ko 2024-08-24T21:01:10.383 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t35.ko 2024-08-24T21:01:10.383 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t59.ko 2024-08-24T21:01:10.383 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-max6900.ko 2024-08-24T21:01:10.383 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-msm6242.ko 2024-08-24T21:01:10.383 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf2127.ko 2024-08-24T21:01:10.383 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf85063.ko 2024-08-24T21:01:10.383 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8523.ko 2024-08-24T21:01:10.383 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8563.ko 2024-08-24T21:01:10.383 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8583.ko 2024-08-24T21:01:10.384 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rp5c01.ko 2024-08-24T21:01:10.384 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rs5c372.ko 2024-08-24T21:01:10.384 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-08-24T21:01:10.384 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8025.ko 2024-08-24T21:01:10.384 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8581.ko 2024-08-24T21:01:10.384 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-08-24T21:01:10.384 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-x1205.ko 2024-08-24T21:01:10.384 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi 2024-08-24T21:01:10.384 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-9xxx.ko 2024-08-24T21:01:10.384 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-sas.ko 2024-08-24T21:01:10.384 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-xxxx.ko 2024-08-24T21:01:10.384 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/BusLogic.ko 2024-08-24T21:01:10.384 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/a100u2w.ko 2024-08-24T21:01:10.385 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid 2024-08-24T21:01:10.385 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid/aacraid.ko 2024-08-24T21:01:10.385 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/advansys.ko 2024-08-24T21:01:10.385 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx 2024-08-24T21:01:10.385 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-08-24T21:01:10.385 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-08-24T21:01:10.385 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/am53c974.ko 2024-08-24T21:01:10.385 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr 2024-08-24T21:01:10.385 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-08-24T21:01:10.385 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/atp870u.ko 2024-08-24T21:01:10.385 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi 2024-08-24T21:01:10.385 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-08-24T21:01:10.385 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa 2024-08-24T21:01:10.386 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa/bfa.ko 2024-08-24T21:01:10.386 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc 2024-08-24T21:01:10.386 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-08-24T21:01:10.386 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i 2024-08-24T21:01:10.386 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-08-24T21:01:10.386 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ch.ko 2024-08-24T21:01:10.386 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor 2024-08-24T21:01:10.386 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor/csiostor.ko 2024-08-24T21:01:10.386 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi 2024-08-24T21:01:10.386 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i 2024-08-24T21:01:10.386 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-08-24T21:01:10.386 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i 2024-08-24T21:01:10.386 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-08-24T21:01:10.387 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-08-24T21:01:10.387 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dc395x.ko 2024-08-24T21:01:10.387 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler 2024-08-24T21:01:10.387 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-08-24T21:01:10.387 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-08-24T21:01:10.387 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-08-24T21:01:10.387 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-08-24T21:01:10.387 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dmx3191d.ko 2024-08-24T21:01:10.387 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r 2024-08-24T21:01:10.387 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r/esas2r.ko 2024-08-24T21:01:10.387 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esp_scsi.ko 2024-08-24T21:01:10.387 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe 2024-08-24T21:01:10.388 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/fcoe.ko 2024-08-24T21:01:10.388 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-08-24T21:01:10.388 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic 2024-08-24T21:01:10.388 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic/fnic.ko 2024-08-24T21:01:10.388 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hpsa.ko 2024-08-24T21:01:10.388 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hptiop.ko 2024-08-24T21:01:10.388 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hv_storvsc.ko 2024-08-24T21:01:10.388 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/initio.ko 2024-08-24T21:01:10.388 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ipr.ko 2024-08-24T21:01:10.388 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ips.ko 2024-08-24T21:01:10.388 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci 2024-08-24T21:01:10.388 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci/isci.ko 2024-08-24T21:01:10.388 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-08-24T21:01:10.389 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_tcp.ko 2024-08-24T21:01:10.389 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc 2024-08-24T21:01:10.389 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc/libfc.ko 2024-08-24T21:01:10.389 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi.ko 2024-08-24T21:01:10.389 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi_tcp.ko 2024-08-24T21:01:10.389 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas 2024-08-24T21:01:10.389 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas/libsas.ko 2024-08-24T21:01:10.389 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc 2024-08-24T21:01:10.389 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc/lpfc.ko 2024-08-24T21:01:10.389 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid 2024-08-24T21:01:10.389 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid.ko 2024-08-24T21:01:10.389 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-08-24T21:01:10.389 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-08-24T21:01:10.389 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-08-24T21:01:10.390 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas 2024-08-24T21:01:10.390 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-08-24T21:01:10.390 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas 2024-08-24T21:01:10.390 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas/mvsas.ko 2024-08-24T21:01:10.390 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvumi.ko 2024-08-24T21:01:10.390 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001 2024-08-24T21:01:10.390 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-08-24T21:01:10.390 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pmcraid.ko 2024-08-24T21:01:10.390 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla1280.ko 2024-08-24T21:01:10.390 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx 2024-08-24T21:01:10.390 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-08-24T21:01:10.390 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-08-24T21:01:10.390 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx 2024-08-24T21:01:10.390 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-08-24T21:01:10.391 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/raid_class.ko 2024-08-24T21:01:10.391 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_debug.ko 2024-08-24T21:01:10.391 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_fc.ko 2024-08-24T21:01:10.391 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-08-24T21:01:10.391 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_sas.ko 2024-08-24T21:01:10.391 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_spi.ko 2024-08-24T21:01:10.391 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_srp.ko 2024-08-24T21:01:10.391 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ses.ko 2024-08-24T21:01:10.391 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/st.ko 2024-08-24T21:01:10.391 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/stex.ko 2024-08-24T21:01:10.391 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2 2024-08-24T21:01:10.391 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-08-24T21:01:10.392 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/virtio_scsi.ko 2024-08-24T21:01:10.392 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/vmw_pvscsi.ko 2024-08-24T21:01:10.392 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/wd719x.ko 2024-08-24T21:01:10.392 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb 2024-08-24T21:01:10.392 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb/ssb.ko 2024-08-24T21:01:10.392 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target 2024-08-24T21:01:10.392 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi 2024-08-24T21:01:10.392 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-08-24T21:01:10.392 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback 2024-08-24T21:01:10.392 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback/tcm_loop.ko 2024-08-24T21:01:10.392 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_file.ko 2024-08-24T21:01:10.392 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_iblock.ko 2024-08-24T21:01:10.392 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_mod.ko 2024-08-24T21:01:10.393 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_pscsi.ko 2024-08-24T21:01:10.393 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_user.ko 2024-08-24T21:01:10.393 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc 2024-08-24T21:01:10.393 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-08-24T21:01:10.393 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal 2024-08-24T21:01:10.393 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel 2024-08-24T21:01:10.393 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal 2024-08-24T21:01:10.393 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-08-24T21:01:10.393 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-08-24T21:01:10.393 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-08-24T21:01:10.393 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-08-24T21:01:10.393 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-08-24T21:01:10.394 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-08-24T21:01:10.394 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-08-24T21:01:10.394 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-08-24T21:01:10.394 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-08-24T21:01:10.394 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-08-24T21:01:10.394 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-08-24T21:01:10.394 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-08-24T21:01:10.394 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-08-24T21:01:10.394 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-08-24T21:01:10.394 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-08-24T21:01:10.394 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-08-24T21:01:10.394 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-08-24T21:01:10.395 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-08-24T21:01:10.395 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty 2024-08-24T21:01:10.395 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless 2024-08-24T21:01:10.395 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-08-24T21:01:10.395 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_gsm.ko 2024-08-24T21:01:10.395 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_hdlc.ko 2024-08-24T21:01:10.395 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/nozomi.ko 2024-08-24T21:01:10.395 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial 2024-08-24T21:01:10.395 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250 2024-08-24T21:01:10.395 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-08-24T21:01:10.395 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/arc_uart.ko 2024-08-24T21:01:10.395 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm 2024-08-24T21:01:10.395 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm/jsm.ko 2024-08-24T21:01:10.396 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs 2024-08-24T21:01:10.396 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core 2024-08-24T21:01:10.396 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core/ufshcd-core.ko 2024-08-24T21:01:10.396 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host 2024-08-24T21:01:10.396 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-08-24T21:01:10.396 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio 2024-08-24T21:01:10.396 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio.ko 2024-08-24T21:01:10.396 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_aec.ko 2024-08-24T21:01:10.396 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_cif.ko 2024-08-24T21:01:10.396 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_pci_generic.ko 2024-08-24T21:01:10.396 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_sercos3.ko 2024-08-24T21:01:10.396 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb 2024-08-24T21:01:10.396 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class 2024-08-24T21:01:10.396 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-acm.ko 2024-08-24T21:01:10.397 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-wdm.ko 2024-08-24T21:01:10.397 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usblp.ko 2024-08-24T21:01:10.397 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usbtmc.ko 2024-08-24T21:01:10.397 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host 2024-08-24T21:01:10.397 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host/sl811-hcd.ko 2024-08-24T21:01:10.397 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image 2024-08-24T21:01:10.397 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/mdc800.ko 2024-08-24T21:01:10.397 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/microtek.ko 2024-08-24T21:01:10.397 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc 2024-08-24T21:01:10.397 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/adutux.ko 2024-08-24T21:01:10.397 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/appledisplay.ko 2024-08-24T21:01:10.397 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi26.ko 2024-08-24T21:01:10.398 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi62.ko 2024-08-24T21:01:10.398 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ezusb.ko 2024-08-24T21:01:10.398 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/idmouse.ko 2024-08-24T21:01:10.398 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/iowarrior.ko 2024-08-24T21:01:10.398 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/isight_firmware.ko 2024-08-24T21:01:10.398 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ldusb.ko 2024-08-24T21:01:10.398 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/legousbtower.ko 2024-08-24T21:01:10.398 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga 2024-08-24T21:01:10.398 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-08-24T21:01:10.398 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/trancevibrator.ko 2024-08-24T21:01:10.398 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usb3503.ko 2024-08-24T21:01:10.398 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usblcd.ko 2024-08-24T21:01:10.399 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usbsevseg.ko 2024-08-24T21:01:10.399 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/uss720.ko 2024-08-24T21:01:10.399 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/yurex.ko 2024-08-24T21:01:10.399 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy 2024-08-24T21:01:10.399 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy/phy-generic.ko 2024-08-24T21:01:10.399 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial 2024-08-24T21:01:10.399 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/aircable.ko 2024-08-24T21:01:10.399 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ark3116.ko 2024-08-24T21:01:10.399 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/belkin_sa.ko 2024-08-24T21:01:10.399 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ch341.ko 2024-08-24T21:01:10.399 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cp210x.ko 2024-08-24T21:01:10.399 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cyberjack.ko 2024-08-24T21:01:10.400 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cypress_m8.ko 2024-08-24T21:01:10.400 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/digi_acceleport.ko 2024-08-24T21:01:10.400 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/empeg.ko 2024-08-24T21:01:10.400 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ftdi_sio.ko 2024-08-24T21:01:10.400 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/garmin_gps.ko 2024-08-24T21:01:10.400 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_edgeport.ko 2024-08-24T21:01:10.400 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_ti.ko 2024-08-24T21:01:10.400 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipaq.ko 2024-08-24T21:01:10.400 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipw.ko 2024-08-24T21:01:10.400 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ir-usb.ko 2024-08-24T21:01:10.400 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-08-24T21:01:10.400 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan.ko 2024-08-24T21:01:10.400 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan_pda.ko 2024-08-24T21:01:10.401 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kl5kusb105.ko 2024-08-24T21:01:10.401 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kobil_sct.ko 2024-08-24T21:01:10.401 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mct_u232.ko 2024-08-24T21:01:10.401 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7720.ko 2024-08-24T21:01:10.401 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7840.ko 2024-08-24T21:01:10.401 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/navman.ko 2024-08-24T21:01:10.401 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/omninet.ko 2024-08-24T21:01:10.401 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/opticon.ko 2024-08-24T21:01:10.401 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/option.ko 2024-08-24T21:01:10.401 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/oti6858.ko 2024-08-24T21:01:10.401 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/pl2303.ko 2024-08-24T21:01:10.401 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcaux.ko 2024-08-24T21:01:10.401 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcserial.ko 2024-08-24T21:01:10.401 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/quatech2.ko 2024-08-24T21:01:10.402 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/safe_serial.ko 2024-08-24T21:01:10.402 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/sierra.ko 2024-08-24T21:01:10.402 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/spcp8x5.ko 2024-08-24T21:01:10.402 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ssu100.ko 2024-08-24T21:01:10.402 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/symbolserial.ko 2024-08-24T21:01:10.402 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-08-24T21:01:10.402 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-08-24T21:01:10.402 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_debug.ko 2024-08-24T21:01:10.402 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_wwan.ko 2024-08-24T21:01:10.402 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/visor.ko 2024-08-24T21:01:10.402 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/whiteheat.ko 2024-08-24T21:01:10.402 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/xsens_mt.ko 2024-08-24T21:01:10.402 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage 2024-08-24T21:01:10.403 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/uas.ko 2024-08-24T21:01:10.403 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-alauda.ko 2024-08-24T21:01:10.403 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-cypress.ko 2024-08-24T21:01:10.403 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-datafab.ko 2024-08-24T21:01:10.403 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-08-24T21:01:10.403 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-freecom.ko 2024-08-24T21:01:10.403 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-isd200.ko 2024-08-24T21:01:10.403 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-08-24T21:01:10.403 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-karma.ko 2024-08-24T21:01:10.403 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-onetouch.ko 2024-08-24T21:01:10.403 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-realtek.ko 2024-08-24T21:01:10.403 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr09.ko 2024-08-24T21:01:10.403 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr55.ko 2024-08-24T21:01:10.404 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-usbat.ko 2024-08-24T21:01:10.404 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/usb-storage.ko 2024-08-24T21:01:10.404 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip 2024-08-24T21:01:10.404 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-core.ko 2024-08-24T21:01:10.404 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-host.ko 2024-08-24T21:01:10.404 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-08-24T21:01:10.404 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio 2024-08-24T21:01:10.404 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci 2024-08-24T21:01:10.404 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-08-24T21:01:10.404 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci.ko 2024-08-24T21:01:10.404 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio.ko 2024-08-24T21:01:10.404 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-08-24T21:01:10.404 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost 2024-08-24T21:01:10.405 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost.ko 2024-08-24T21:01:10.405 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_iotlb.ko 2024-08-24T21:01:10.405 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_net.ko 2024-08-24T21:01:10.405 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_scsi.ko 2024-08-24T21:01:10.405 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video 2024-08-24T21:01:10.405 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight 2024-08-24T21:01:10.405 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/apple_bl.ko 2024-08-24T21:01:10.405 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/lcd.ko 2024-08-24T21:01:10.405 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/platform_lcd.ko 2024-08-24T21:01:10.405 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio 2024-08-24T21:01:10.405 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio.ko 2024-08-24T21:01:10.405 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_balloon.ko 2024-08-24T21:01:10.405 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_mmio.ko 2024-08-24T21:01:10.406 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci.ko 2024-08-24T21:01:10.406 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-08-24T21:01:10.406 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-08-24T21:01:10.406 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_ring.ko 2024-08-24T21:01:10.406 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1 2024-08-24T21:01:10.406 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters 2024-08-24T21:01:10.406 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2482.ko 2024-08-24T21:01:10.406 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2490.ko 2024-08-24T21:01:10.406 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves 2024-08-24T21:01:10.406 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-08-24T21:01:10.406 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-08-24T21:01:10.406 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-08-24T21:01:10.406 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-08-24T21:01:10.407 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-08-24T21:01:10.407 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-08-24T21:01:10.407 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-08-24T21:01:10.407 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-08-24T21:01:10.407 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-08-24T21:01:10.407 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_smem.ko 2024-08-24T21:01:10.407 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_therm.ko 2024-08-24T21:01:10.407 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/wire.ko 2024-08-24T21:01:10.407 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog 2024-08-24T21:01:10.407 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim1535_wdt.ko 2024-08-24T21:01:10.407 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim7101_wdt.ko 2024-08-24T21:01:10.407 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/f71808e_wdt.ko 2024-08-24T21:01:10.407 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/hpwdt.ko 2024-08-24T21:01:10.407 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/i6300esb.ko 2024-08-24T21:01:10.408 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-08-24T21:01:10.408 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_wdt.ko 2024-08-24T21:01:10.408 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ib700wdt.ko 2024-08-24T21:01:10.408 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ibmasr.ko 2024-08-24T21:01:10.408 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-08-24T21:01:10.408 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it8712f_wdt.ko 2024-08-24T21:01:10.408 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it87_wdt.ko 2024-08-24T21:01:10.408 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/machzwd.ko 2024-08-24T21:01:10.408 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/nv_tco.ko 2024-08-24T21:01:10.408 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_pci.ko 2024-08-24T21:01:10.408 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_usb.ko 2024-08-24T21:01:10.408 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-08-24T21:01:10.408 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sch311x_wdt.ko 2024-08-24T21:01:10.409 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/softdog.ko 2024-08-24T21:01:10.409 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sp5100_tco.ko 2024-08-24T21:01:10.409 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/via_wdt.ko 2024-08-24T21:01:10.409 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-08-24T21:01:10.409 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83877f_wdt.ko 2024-08-24T21:01:10.409 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83977f_wdt.ko 2024-08-24T21:01:10.409 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/wdt_pci.ko 2024-08-24T21:01:10.409 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/xen_wdt.ko 2024-08-24T21:01:10.409 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen 2024-08-24T21:01:10.409 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-acpi-processor.ko 2024-08-24T21:01:10.409 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-evtchn.ko 2024-08-24T21:01:10.410 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntalloc.ko 2024-08-24T21:01:10.410 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntdev.ko 2024-08-24T21:01:10.410 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback 2024-08-24T21:01:10.410 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-08-24T21:01:10.410 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-privcmd.ko 2024-08-24T21:01:10.410 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs 2024-08-24T21:01:10.410 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs/xenfs.ko 2024-08-24T21:01:10.410 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs 2024-08-24T21:01:10.410 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p 2024-08-24T21:01:10.410 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p/9p.ko 2024-08-24T21:01:10.410 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs 2024-08-24T21:01:10.410 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs/affs.ko 2024-08-24T21:01:10.411 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs 2024-08-24T21:01:10.411 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs/befs.ko 2024-08-24T21:01:10.411 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/binfmt_misc.ko 2024-08-24T21:01:10.411 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs 2024-08-24T21:01:10.411 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs/btrfs.ko 2024-08-24T21:01:10.411 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles 2024-08-24T21:01:10.411 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles/cachefiles.ko 2024-08-24T21:01:10.411 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph 2024-08-24T21:01:10.411 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph/ceph.ko 2024-08-24T21:01:10.411 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda 2024-08-24T21:01:10.411 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda/coda.ko 2024-08-24T21:01:10.412 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs 2024-08-24T21:01:10.412 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs/cramfs.ko 2024-08-24T21:01:10.412 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm 2024-08-24T21:01:10.412 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm/dlm.ko 2024-08-24T21:01:10.412 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs 2024-08-24T21:01:10.412 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs/ecryptfs.ko 2024-08-24T21:01:10.412 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs 2024-08-24T21:01:10.412 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs/f2fs.ko 2024-08-24T21:01:10.412 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat 2024-08-24T21:01:10.412 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/fat.ko 2024-08-24T21:01:10.412 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/msdos.ko 2024-08-24T21:01:10.412 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/vfat.ko 2024-08-24T21:01:10.412 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse 2024-08-24T21:01:10.413 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/cuse.ko 2024-08-24T21:01:10.413 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/fuse.ko 2024-08-24T21:01:10.413 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2 2024-08-24T21:01:10.413 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2/gfs2.ko 2024-08-24T21:01:10.413 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs 2024-08-24T21:01:10.413 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs/hfs.ko 2024-08-24T21:01:10.413 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus 2024-08-24T21:01:10.413 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus/hfsplus.ko 2024-08-24T21:01:10.413 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs 2024-08-24T21:01:10.413 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs/isofs.ko 2024-08-24T21:01:10.413 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs 2024-08-24T21:01:10.413 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs/jfs.ko 2024-08-24T21:01:10.413 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd 2024-08-24T21:01:10.413 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd/lockd.ko 2024-08-24T21:01:10.414 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix 2024-08-24T21:01:10.414 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix/minix.ko 2024-08-24T21:01:10.414 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs 2024-08-24T21:01:10.414 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs/netfs.ko 2024-08-24T21:01:10.414 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs 2024-08-24T21:01:10.414 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout 2024-08-24T21:01:10.414 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-08-24T21:01:10.414 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout 2024-08-24T21:01:10.414 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-08-24T21:01:10.415 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout 2024-08-24T21:01:10.415 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-08-24T21:01:10.415 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfs.ko 2024-08-24T21:01:10.415 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv3.ko 2024-08-24T21:01:10.415 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv4.ko 2024-08-24T21:01:10.415 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common 2024-08-24T21:01:10.415 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/grace.ko 2024-08-24T21:01:10.415 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/nfs_acl.ko 2024-08-24T21:01:10.415 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd 2024-08-24T21:01:10.415 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd/nfsd.ko 2024-08-24T21:01:10.415 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2 2024-08-24T21:01:10.415 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2/nilfs2.ko 2024-08-24T21:01:10.415 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls 2024-08-24T21:01:10.416 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-celtic.ko 2024-08-24T21:01:10.416 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-centeuro.ko 2024-08-24T21:01:10.416 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-croatian.ko 2024-08-24T21:01:10.416 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-cyrillic.ko 2024-08-24T21:01:10.416 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-gaelic.ko 2024-08-24T21:01:10.416 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-greek.ko 2024-08-24T21:01:10.416 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-iceland.ko 2024-08-24T21:01:10.416 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-inuit.ko 2024-08-24T21:01:10.416 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-roman.ko 2024-08-24T21:01:10.416 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-romanian.ko 2024-08-24T21:01:10.416 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-turkish.ko 2024-08-24T21:01:10.416 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1250.ko 2024-08-24T21:01:10.417 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1251.ko 2024-08-24T21:01:10.417 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1255.ko 2024-08-24T21:01:10.417 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp737.ko 2024-08-24T21:01:10.417 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp775.ko 2024-08-24T21:01:10.417 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp850.ko 2024-08-24T21:01:10.417 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp852.ko 2024-08-24T21:01:10.417 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp855.ko 2024-08-24T21:01:10.417 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp857.ko 2024-08-24T21:01:10.417 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp860.ko 2024-08-24T21:01:10.417 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp861.ko 2024-08-24T21:01:10.417 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp862.ko 2024-08-24T21:01:10.417 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp863.ko 2024-08-24T21:01:10.417 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp864.ko 2024-08-24T21:01:10.418 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp865.ko 2024-08-24T21:01:10.418 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp866.ko 2024-08-24T21:01:10.418 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp869.ko 2024-08-24T21:01:10.418 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp874.ko 2024-08-24T21:01:10.418 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp932.ko 2024-08-24T21:01:10.418 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp936.ko 2024-08-24T21:01:10.418 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp949.ko 2024-08-24T21:01:10.418 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp950.ko 2024-08-24T21:01:10.418 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_euc-jp.ko 2024-08-24T21:01:10.418 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-1.ko 2024-08-24T21:01:10.418 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-13.ko 2024-08-24T21:01:10.418 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-14.ko 2024-08-24T21:01:10.418 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-15.ko 2024-08-24T21:01:10.419 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-2.ko 2024-08-24T21:01:10.419 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-3.ko 2024-08-24T21:01:10.419 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-4.ko 2024-08-24T21:01:10.419 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-5.ko 2024-08-24T21:01:10.419 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-6.ko 2024-08-24T21:01:10.419 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-7.ko 2024-08-24T21:01:10.419 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-9.ko 2024-08-24T21:01:10.419 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-r.ko 2024-08-24T21:01:10.419 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-ru.ko 2024-08-24T21:01:10.419 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-u.ko 2024-08-24T21:01:10.419 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_ucs2_utils.ko 2024-08-24T21:01:10.419 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_utf8.ko 2024-08-24T21:01:10.419 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2 2024-08-24T21:01:10.420 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster 2024-08-24T21:01:10.420 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-08-24T21:01:10.420 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm 2024-08-24T21:01:10.420 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-08-24T21:01:10.420 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs 2024-08-24T21:01:10.420 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-08-24T21:01:10.420 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2.ko 2024-08-24T21:01:10.420 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-08-24T21:01:10.420 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-08-24T21:01:10.420 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-08-24T21:01:10.420 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs 2024-08-24T21:01:10.420 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs/overlay.ko 2024-08-24T21:01:10.420 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore 2024-08-24T21:01:10.420 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore/ramoops.ko 2024-08-24T21:01:10.421 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs 2024-08-24T21:01:10.421 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs/reiserfs.ko 2024-08-24T21:01:10.421 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs 2024-08-24T21:01:10.421 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs/romfs.ko 2024-08-24T21:01:10.421 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb 2024-08-24T21:01:10.421 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client 2024-08-24T21:01:10.421 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client/cifs.ko 2024-08-24T21:01:10.421 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common 2024-08-24T21:01:10.421 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_arc4.ko 2024-08-24T21:01:10.421 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_md4.ko 2024-08-24T21:01:10.421 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs 2024-08-24T21:01:10.421 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs/squashfs.ko 2024-08-24T21:01:10.421 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv 2024-08-24T21:01:10.422 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv/sysv.ko 2024-08-24T21:01:10.422 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf 2024-08-24T21:01:10.422 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf/udf.ko 2024-08-24T21:01:10.422 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs 2024-08-24T21:01:10.422 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs/ufs.ko 2024-08-24T21:01:10.422 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs 2024-08-24T21:01:10.422 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs/xfs.ko 2024-08-24T21:01:10.422 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel 2024-08-24T21:01:10.422 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu 2024-08-24T21:01:10.422 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu/rcutorture.ko 2024-08-24T21:01:10.422 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/torture.ko 2024-08-24T21:01:10.422 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace 2024-08-24T21:01:10.422 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-08-24T21:01:10.423 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib 2024-08-24T21:01:10.423 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/asn1_encoder.ko 2024-08-24T21:01:10.423 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc-itu-t.ko 2024-08-24T21:01:10.423 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc8.ko 2024-08-24T21:01:10.423 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto 2024-08-24T21:01:10.423 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libaescfb.ko 2024-08-24T21:01:10.423 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libarc4.ko 2024-08-24T21:01:10.423 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libdes.ko 2024-08-24T21:01:10.423 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/libcrc32c.ko 2024-08-24T21:01:10.423 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lru_cache.ko 2024-08-24T21:01:10.423 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4 2024-08-24T21:01:10.423 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4_compress.ko 2024-08-24T21:01:10.423 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4hc_compress.ko 2024-08-24T21:01:10.424 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math 2024-08-24T21:01:10.424 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math/cordic.ko 2024-08-24T21:01:10.424 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6 2024-08-24T21:01:10.424 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6/raid6_pq.ko 2024-08-24T21:01:10.424 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon 2024-08-24T21:01:10.424 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon/reed_solomon.ko 2024-08-24T21:01:10.424 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_bm.ko 2024-08-24T21:01:10.424 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_fsm.ko 2024-08-24T21:01:10.424 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_kmp.ko 2024-08-24T21:01:10.424 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd 2024-08-24T21:01:10.425 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd/zstd_compress.ko 2024-08-24T21:01:10.425 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm 2024-08-24T21:01:10.425 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm/hwpoison-inject.ko 2024-08-24T21:01:10.425 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net 2024-08-24T21:01:10.425 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan 2024-08-24T21:01:10.425 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/6lowpan.ko 2024-08-24T21:01:10.425 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_dest.ko 2024-08-24T21:01:10.425 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_fragment.ko 2024-08-24T21:01:10.425 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_hop.ko 2024-08-24T21:01:10.425 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_ipv6.ko 2024-08-24T21:01:10.425 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_mobility.ko 2024-08-24T21:01:10.425 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_routing.ko 2024-08-24T21:01:10.425 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_udp.ko 2024-08-24T21:01:10.426 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802 2024-08-24T21:01:10.426 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/garp.ko 2024-08-24T21:01:10.426 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/mrp.ko 2024-08-24T21:01:10.426 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/p8022.ko 2024-08-24T21:01:10.426 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/psnap.ko 2024-08-24T21:01:10.426 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/stp.ko 2024-08-24T21:01:10.426 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q 2024-08-24T21:01:10.426 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q/8021q.ko 2024-08-24T21:01:10.426 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p 2024-08-24T21:01:10.426 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet.ko 2024-08-24T21:01:10.426 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_fd.ko 2024-08-24T21:01:10.426 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_rdma.ko 2024-08-24T21:01:10.426 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_virtio.ko 2024-08-24T21:01:10.427 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv 2024-08-24T21:01:10.427 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv/batman-adv.ko 2024-08-24T21:01:10.427 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge 2024-08-24T21:01:10.427 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/br_netfilter.ko 2024-08-24T21:01:10.427 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/bridge.ko 2024-08-24T21:01:10.427 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter 2024-08-24T21:01:10.427 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-08-24T21:01:10.427 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_among.ko 2024-08-24T21:01:10.427 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arp.ko 2024-08-24T21:01:10.427 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-08-24T21:01:10.427 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-08-24T21:01:10.427 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip.ko 2024-08-24T21:01:10.427 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-08-24T21:01:10.428 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_limit.ko 2024-08-24T21:01:10.428 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_log.ko 2024-08-24T21:01:10.428 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark.ko 2024-08-24T21:01:10.428 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-08-24T21:01:10.429 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-08-24T21:01:10.430 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-08-24T21:01:10.430 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-08-24T21:01:10.430 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_snat.ko 2024-08-24T21:01:10.430 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_stp.ko 2024-08-24T21:01:10.430 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-08-24T21:01:10.430 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-08-24T21:01:10.430 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-08-24T21:01:10.430 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-08-24T21:01:10.430 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtables.ko 2024-08-24T21:01:10.430 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-08-24T21:01:10.430 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-08-24T21:01:10.430 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-08-24T21:01:10.431 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph 2024-08-24T21:01:10.431 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph/libceph.ko 2024-08-24T21:01:10.431 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core 2024-08-24T21:01:10.431 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/failover.ko 2024-08-24T21:01:10.431 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/pktgen.ko 2024-08-24T21:01:10.431 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp 2024-08-24T21:01:10.431 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp.ko 2024-08-24T21:01:10.431 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_diag.ko 2024-08-24T21:01:10.431 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv4.ko 2024-08-24T21:01:10.431 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv6.ko 2024-08-24T21:01:10.431 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver 2024-08-24T21:01:10.431 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver/dns_resolver.ko 2024-08-24T21:01:10.431 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa 2024-08-24T21:01:10.432 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/dsa_core.ko 2024-08-24T21:01:10.432 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_brcm.ko 2024-08-24T21:01:10.432 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_dsa.ko 2024-08-24T21:01:10.432 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_none.ko 2024-08-24T21:01:10.432 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_trailer.ko 2024-08-24T21:01:10.432 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154 2024-08-24T21:01:10.432 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan 2024-08-24T21:01:10.432 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-08-24T21:01:10.432 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154.ko 2024-08-24T21:01:10.432 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154_socket.ko 2024-08-24T21:01:10.432 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4 2024-08-24T21:01:10.432 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ah4.ko 2024-08-24T21:01:10.432 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/esp4.ko 2024-08-24T21:01:10.432 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/fou.ko 2024-08-24T21:01:10.433 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/gre.ko 2024-08-24T21:01:10.433 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/inet_diag.ko 2024-08-24T21:01:10.433 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_gre.ko 2024-08-24T21:01:10.433 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_tunnel.ko 2024-08-24T21:01:10.433 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_vti.ko 2024-08-24T21:01:10.433 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipcomp.ko 2024-08-24T21:01:10.433 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipip.ko 2024-08-24T21:01:10.433 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter 2024-08-24T21:01:10.433 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arp_tables.ko 2024-08-24T21:01:10.433 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-08-24T21:01:10.433 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-08-24T21:01:10.433 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-08-24T21:01:10.433 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-08-24T21:01:10.433 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-08-24T21:01:10.434 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-08-24T21:01:10.434 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-08-24T21:01:10.434 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-08-24T21:01:10.434 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-08-24T21:01:10.434 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_security.ko 2024-08-24T21:01:10.434 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-08-24T21:01:10.434 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-08-24T21:01:10.434 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-08-24T21:01:10.434 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-08-24T21:01:10.434 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-08-24T21:01:10.434 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-08-24T21:01:10.435 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-08-24T21:01:10.435 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-08-24T21:01:10.435 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-08-24T21:01:10.435 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-08-24T21:01:10.435 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_bic.ko 2024-08-24T21:01:10.435 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_dctcp.ko 2024-08-24T21:01:10.435 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_diag.ko 2024-08-24T21:01:10.435 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_highspeed.ko 2024-08-24T21:01:10.435 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_htcp.ko 2024-08-24T21:01:10.435 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_hybla.ko 2024-08-24T21:01:10.435 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_illinois.ko 2024-08-24T21:01:10.435 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_lp.ko 2024-08-24T21:01:10.435 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_scalable.ko 2024-08-24T21:01:10.436 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_vegas.ko 2024-08-24T21:01:10.436 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_veno.ko 2024-08-24T21:01:10.436 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_westwood.ko 2024-08-24T21:01:10.436 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_yeah.ko 2024-08-24T21:01:10.436 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tunnel4.ko 2024-08-24T21:01:10.436 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_diag.ko 2024-08-24T21:01:10.436 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_tunnel.ko 2024-08-24T21:01:10.436 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/xfrm4_tunnel.ko 2024-08-24T21:01:10.436 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6 2024-08-24T21:01:10.436 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ah6.ko 2024-08-24T21:01:10.436 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/esp6.ko 2024-08-24T21:01:10.436 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/fou6.ko 2024-08-24T21:01:10.436 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_tunnel.ko 2024-08-24T21:01:10.437 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-08-24T21:01:10.437 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_vti.ko 2024-08-24T21:01:10.437 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ipcomp6.ko 2024-08-24T21:01:10.437 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter 2024-08-24T21:01:10.437 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-08-24T21:01:10.437 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-08-24T21:01:10.437 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-08-24T21:01:10.437 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-08-24T21:01:10.437 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-08-24T21:01:10.437 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-08-24T21:01:10.437 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-08-24T21:01:10.437 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-08-24T21:01:10.438 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-08-24T21:01:10.438 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-08-24T21:01:10.438 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-08-24T21:01:10.438 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-08-24T21:01:10.438 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-08-24T21:01:10.438 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-08-24T21:01:10.438 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-08-24T21:01:10.438 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-08-24T21:01:10.438 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-08-24T21:01:10.438 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-08-24T21:01:10.438 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-08-24T21:01:10.438 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-08-24T21:01:10.438 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-08-24T21:01:10.438 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-08-24T21:01:10.439 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-08-24T21:01:10.439 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-08-24T21:01:10.439 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/sit.ko 2024-08-24T21:01:10.439 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/tunnel6.ko 2024-08-24T21:01:10.439 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/xfrm6_tunnel.ko 2024-08-24T21:01:10.439 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key 2024-08-24T21:01:10.439 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key/af_key.ko 2024-08-24T21:01:10.439 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp 2024-08-24T21:01:10.439 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_core.ko 2024-08-24T21:01:10.439 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_debugfs.ko 2024-08-24T21:01:10.439 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_eth.ko 2024-08-24T21:01:10.439 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip.ko 2024-08-24T21:01:10.439 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip6.ko 2024-08-24T21:01:10.440 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_netlink.ko 2024-08-24T21:01:10.440 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ppp.ko 2024-08-24T21:01:10.440 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc 2024-08-24T21:01:10.440 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc/llc.ko 2024-08-24T21:01:10.440 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154 2024-08-24T21:01:10.440 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154/mac802154.ko 2024-08-24T21:01:10.440 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls 2024-08-24T21:01:10.440 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls/mpls_gso.ko 2024-08-24T21:01:10.440 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter 2024-08-24T21:01:10.440 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset 2024-08-24T21:01:10.440 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set.ko 2024-08-24T21:01:10.440 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-08-24T21:01:10.441 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-08-24T21:01:10.441 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-08-24T21:01:10.441 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-08-24T21:01:10.441 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-08-24T21:01:10.441 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-08-24T21:01:10.441 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-08-24T21:01:10.441 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-08-24T21:01:10.441 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-08-24T21:01:10.441 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-08-24T21:01:10.441 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-08-24T21:01:10.441 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-08-24T21:01:10.441 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-08-24T21:01:10.442 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-08-24T21:01:10.442 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-08-24T21:01:10.442 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs 2024-08-24T21:01:10.442 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs.ko 2024-08-24T21:01:10.442 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-08-24T21:01:10.442 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-08-24T21:01:10.442 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-08-24T21:01:10.442 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-08-24T21:01:10.442 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-08-24T21:01:10.442 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-08-24T21:01:10.442 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-08-24T21:01:10.443 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-08-24T21:01:10.443 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-08-24T21:01:10.443 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-08-24T21:01:10.443 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-08-24T21:01:10.443 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-08-24T21:01:10.443 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-08-24T21:01:10.443 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conncount.ko 2024-08-24T21:01:10.443 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack.ko 2024-08-24T21:01:10.443 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-08-24T21:01:10.443 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-08-24T21:01:10.443 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-08-24T21:01:10.443 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_h323.ko 2024-08-24T21:01:10.443 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_irc.ko 2024-08-24T21:01:10.444 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-08-24T21:01:10.444 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-08-24T21:01:10.444 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-08-24T21:01:10.444 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sane.ko 2024-08-24T21:01:10.444 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sip.ko 2024-08-24T21:01:10.444 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-08-24T21:01:10.444 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-08-24T21:01:10.444 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_dup_netdev.ko 2024-08-24T21:01:10.444 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table.ko 2024-08-24T21:01:10.444 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table_inet.ko 2024-08-24T21:01:10.444 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_log_syslog.ko 2024-08-24T21:01:10.444 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat.ko 2024-08-24T21:01:10.444 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_amanda.ko 2024-08-24T21:01:10.445 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_ftp.ko 2024-08-24T21:01:10.445 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_irc.ko 2024-08-24T21:01:10.445 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_sip.ko 2024-08-24T21:01:10.445 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_tftp.ko 2024-08-24T21:01:10.445 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_synproxy_core.ko 2024-08-24T21:01:10.445 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_tables.ko 2024-08-24T21:01:10.445 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink.ko 2024-08-24T21:01:10.445 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_acct.ko 2024-08-24T21:01:10.445 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_log.ko 2024-08-24T21:01:10.445 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_osf.ko 2024-08-24T21:01:10.445 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_queue.ko 2024-08-24T21:01:10.445 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_chain_nat.ko 2024-08-24T21:01:10.445 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_compat.ko 2024-08-24T21:01:10.446 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_ct.ko 2024-08-24T21:01:10.446 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_dup_netdev.ko 2024-08-24T21:01:10.446 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fib.ko 2024-08-24T21:01:10.446 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fwd_netdev.ko 2024-08-24T21:01:10.446 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_hash.ko 2024-08-24T21:01:10.446 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_limit.ko 2024-08-24T21:01:10.446 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_log.ko 2024-08-24T21:01:10.446 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_masq.ko 2024-08-24T21:01:10.446 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_nat.ko 2024-08-24T21:01:10.446 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_numgen.ko 2024-08-24T21:01:10.446 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_queue.ko 2024-08-24T21:01:10.446 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_quota.ko 2024-08-24T21:01:10.447 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_redir.ko 2024-08-24T21:01:10.447 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject.ko 2024-08-24T21:01:10.447 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject_inet.ko 2024-08-24T21:01:10.447 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_socket.ko 2024-08-24T21:01:10.447 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_tunnel.ko 2024-08-24T21:01:10.447 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_AUDIT.ko 2024-08-24T21:01:10.447 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CHECKSUM.ko 2024-08-24T21:01:10.447 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CLASSIFY.ko 2024-08-24T21:01:10.447 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-08-24T21:01:10.447 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CT.ko 2024-08-24T21:01:10.447 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_DSCP.ko 2024-08-24T21:01:10.447 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HL.ko 2024-08-24T21:01:10.447 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HMARK.ko 2024-08-24T21:01:10.448 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_IDLETIMER.ko 2024-08-24T21:01:10.448 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LED.ko 2024-08-24T21:01:10.448 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LOG.ko 2024-08-24T21:01:10.448 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_MASQUERADE.ko 2024-08-24T21:01:10.448 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NETMAP.ko 2024-08-24T21:01:10.448 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFLOG.ko 2024-08-24T21:01:10.448 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFQUEUE.ko 2024-08-24T21:01:10.448 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_RATEEST.ko 2024-08-24T21:01:10.448 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_REDIRECT.ko 2024-08-24T21:01:10.448 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_SECMARK.ko 2024-08-24T21:01:10.448 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPMSS.ko 2024-08-24T21:01:10.448 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-08-24T21:01:10.448 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TEE.ko 2024-08-24T21:01:10.449 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TPROXY.ko 2024-08-24T21:01:10.449 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TRACE.ko 2024-08-24T21:01:10.449 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_addrtype.ko 2024-08-24T21:01:10.449 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_bpf.ko 2024-08-24T21:01:10.449 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cgroup.ko 2024-08-24T21:01:10.449 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cluster.ko 2024-08-24T21:01:10.449 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_comment.ko 2024-08-24T21:01:10.449 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connbytes.ko 2024-08-24T21:01:10.449 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlabel.ko 2024-08-24T21:01:10.449 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlimit.ko 2024-08-24T21:01:10.449 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connmark.ko 2024-08-24T21:01:10.449 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_conntrack.ko 2024-08-24T21:01:10.449 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cpu.ko 2024-08-24T21:01:10.450 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dccp.ko 2024-08-24T21:01:10.450 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_devgroup.ko 2024-08-24T21:01:10.450 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dscp.ko 2024-08-24T21:01:10.450 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ecn.ko 2024-08-24T21:01:10.450 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_esp.ko 2024-08-24T21:01:10.450 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hashlimit.ko 2024-08-24T21:01:10.450 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_helper.ko 2024-08-24T21:01:10.450 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hl.ko 2024-08-24T21:01:10.450 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipcomp.ko 2024-08-24T21:01:10.450 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_iprange.ko 2024-08-24T21:01:10.450 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipvs.ko 2024-08-24T21:01:10.450 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_l2tp.ko 2024-08-24T21:01:10.450 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_length.ko 2024-08-24T21:01:10.451 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_limit.ko 2024-08-24T21:01:10.451 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mac.ko 2024-08-24T21:01:10.451 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mark.ko 2024-08-24T21:01:10.451 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_multiport.ko 2024-08-24T21:01:10.451 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nat.ko 2024-08-24T21:01:10.451 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nfacct.ko 2024-08-24T21:01:10.451 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_osf.ko 2024-08-24T21:01:10.451 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_owner.ko 2024-08-24T21:01:10.451 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_physdev.ko 2024-08-24T21:01:10.451 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_pkttype.ko 2024-08-24T21:01:10.451 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_policy.ko 2024-08-24T21:01:10.451 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_quota.ko 2024-08-24T21:01:10.452 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_rateest.ko 2024-08-24T21:01:10.452 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_realm.ko 2024-08-24T21:01:10.452 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_recent.ko 2024-08-24T21:01:10.452 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_sctp.ko 2024-08-24T21:01:10.452 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_set.ko 2024-08-24T21:01:10.452 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_socket.ko 2024-08-24T21:01:10.452 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_state.ko 2024-08-24T21:01:10.452 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_statistic.ko 2024-08-24T21:01:10.452 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_string.ko 2024-08-24T21:01:10.452 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_tcpmss.ko 2024-08-24T21:01:10.452 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_time.ko 2024-08-24T21:01:10.452 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_u32.ko 2024-08-24T21:01:10.452 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink 2024-08-24T21:01:10.453 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink/netlink_diag.ko 2024-08-24T21:01:10.453 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh 2024-08-24T21:01:10.453 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh/nsh.ko 2024-08-24T21:01:10.453 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch 2024-08-24T21:01:10.453 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/openvswitch.ko 2024-08-24T21:01:10.453 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-geneve.ko 2024-08-24T21:01:10.453 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-gre.ko 2024-08-24T21:01:10.453 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-vxlan.ko 2024-08-24T21:01:10.453 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet 2024-08-24T21:01:10.453 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet/af_packet_diag.ko 2024-08-24T21:01:10.453 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds 2024-08-24T21:01:10.453 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds.ko 2024-08-24T21:01:10.453 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_rdma.ko 2024-08-24T21:01:10.454 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_tcp.ko 2024-08-24T21:01:10.454 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched 2024-08-24T21:01:10.454 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_csum.ko 2024-08-24T21:01:10.454 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_gact.ko 2024-08-24T21:01:10.454 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_mirred.ko 2024-08-24T21:01:10.454 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_nat.ko 2024-08-24T21:01:10.454 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_pedit.ko 2024-08-24T21:01:10.454 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_police.ko 2024-08-24T21:01:10.454 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_simple.ko 2024-08-24T21:01:10.454 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_skbedit.ko 2024-08-24T21:01:10.454 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_vlan.ko 2024-08-24T21:01:10.454 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_basic.ko 2024-08-24T21:01:10.454 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_bpf.ko 2024-08-24T21:01:10.455 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_flow.ko 2024-08-24T21:01:10.455 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_fw.ko 2024-08-24T21:01:10.455 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_route.ko 2024-08-24T21:01:10.455 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_u32.ko 2024-08-24T21:01:10.455 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_cmp.ko 2024-08-24T21:01:10.455 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_ipset.ko 2024-08-24T21:01:10.455 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_meta.ko 2024-08-24T21:01:10.455 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_nbyte.ko 2024-08-24T21:01:10.455 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_text.ko 2024-08-24T21:01:10.455 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_u32.ko 2024-08-24T21:01:10.455 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_choke.ko 2024-08-24T21:01:10.455 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_codel.ko 2024-08-24T21:01:10.455 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_drr.ko 2024-08-24T21:01:10.456 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_fq.ko 2024-08-24T21:01:10.456 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_gred.ko 2024-08-24T21:01:10.456 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hfsc.ko 2024-08-24T21:01:10.456 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hhf.ko 2024-08-24T21:01:10.456 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_htb.ko 2024-08-24T21:01:10.456 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_ingress.ko 2024-08-24T21:01:10.456 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio.ko 2024-08-24T21:01:10.456 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio_lib.ko 2024-08-24T21:01:10.456 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_multiq.ko 2024-08-24T21:01:10.456 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_netem.ko 2024-08-24T21:01:10.456 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_pie.ko 2024-08-24T21:01:10.456 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_plug.ko 2024-08-24T21:01:10.456 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_prio.ko 2024-08-24T21:01:10.457 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_qfq.ko 2024-08-24T21:01:10.457 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_red.ko 2024-08-24T21:01:10.457 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfb.ko 2024-08-24T21:01:10.457 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfq.ko 2024-08-24T21:01:10.457 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_tbf.ko 2024-08-24T21:01:10.457 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_teql.ko 2024-08-24T21:01:10.457 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp 2024-08-24T21:01:10.457 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp.ko 2024-08-24T21:01:10.457 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp_diag.ko 2024-08-24T21:01:10.457 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc 2024-08-24T21:01:10.457 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss 2024-08-24T21:01:10.457 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-08-24T21:01:10.457 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-08-24T21:01:10.458 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/sunrpc.ko 2024-08-24T21:01:10.458 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma 2024-08-24T21:01:10.458 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-08-24T21:01:10.458 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc 2024-08-24T21:01:10.458 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc.ko 2024-08-24T21:01:10.458 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc_diag.ko 2024-08-24T21:01:10.458 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix 2024-08-24T21:01:10.458 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix/unix_diag.ko 2024-08-24T21:01:10.458 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock 2024-08-24T21:01:10.458 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-08-24T21:01:10.458 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-08-24T21:01:10.458 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock.ko 2024-08-24T21:01:10.458 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_diag.ko 2024-08-24T21:01:10.459 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_loopback.ko 2024-08-24T21:01:10.459 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm 2024-08-24T21:01:10.459 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm/xfrm_ipcomp.ko 2024-08-24T21:01:10.459 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security 2024-08-24T21:01:10.459 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys 2024-08-24T21:01:10.459 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys 2024-08-24T21:01:10.459 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-08-24T21:01:10.459 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys 2024-08-24T21:01:10.459 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys/trusted.ko 2024-08-24T21:01:10.459 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias 2024-08-24T21:01:10.459 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias.bin 2024-08-24T21:01:10.459 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin 2024-08-24T21:01:10.459 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.alias.bin 2024-08-24T21:01:10.460 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.bin 2024-08-24T21:01:10.460 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.modinfo 2024-08-24T21:01:10.460 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep 2024-08-24T21:01:10.460 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep.bin 2024-08-24T21:01:10.460 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.devname 2024-08-24T21:01:10.460 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.order 2024-08-24T21:01:10.460 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.softdep 2024-08-24T21:01:10.460 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols 2024-08-24T21:01:10.460 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols.bin 2024-08-24T21:01:10.460 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.weakdep 2024-08-24T21:01:10.460 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-24T21:01:10.464 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc3-g7503b862ff5b 2024-08-24T21:01:10.464 DEBUG:teuthology.orchestra.run.smithi060:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-08-24T21:01:10.490 INFO:teuthology.orchestra.run.smithi060.stdout:postinstall scriptlet (using /bin/sh): 2024-08-24T21:01:10.490 INFO:teuthology.orchestra.run.smithi060.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-24T21:01:10.490 INFO:teuthology.orchestra.run.smithi060.stdout: /usr/bin/kernel-install add 6.11.0-rc3-g7503b862ff5b /lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-24T21:01:10.490 INFO:teuthology.orchestra.run.smithi060.stdout:fi 2024-08-24T21:01:10.490 INFO:teuthology.orchestra.run.smithi060.stdout:for file in vmlinuz System.map config; do 2024-08-24T21:01:10.490 INFO:teuthology.orchestra.run.smithi060.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b"; then 2024-08-24T21:01:10.490 INFO:teuthology.orchestra.run.smithi060.stdout: cp "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b" 2024-08-24T21:01:10.490 INFO:teuthology.orchestra.run.smithi060.stdout: fi 2024-08-24T21:01:10.491 INFO:teuthology.orchestra.run.smithi060.stdout:done 2024-08-24T21:01:10.491 INFO:teuthology.orchestra.run.smithi060.stdout:if [ -d "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" ] && \ 2024-08-24T21:01:10.491 INFO:teuthology.orchestra.run.smithi060.stdout: ! diff -rq "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" >/dev/null 2>&1; then 2024-08-24T21:01:10.491 INFO:teuthology.orchestra.run.smithi060.stdout: rm -rf "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-24T21:01:10.491 INFO:teuthology.orchestra.run.smithi060.stdout: cp -r "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-24T21:01:10.491 INFO:teuthology.orchestra.run.smithi060.stdout:fi 2024-08-24T21:01:10.491 INFO:teuthology.orchestra.run.smithi060.stdout:if [ ! -e "/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep" ]; then 2024-08-24T21:01:10.491 INFO:teuthology.orchestra.run.smithi060.stdout: /usr/sbin/depmod 6.11.0-rc3-g7503b862ff5b 2024-08-24T21:01:10.491 INFO:teuthology.orchestra.run.smithi060.stdout:fi 2024-08-24T21:01:10.491 INFO:teuthology.orchestra.run.smithi060.stdout:preuninstall scriptlet (using /bin/sh): 2024-08-24T21:01:10.492 INFO:teuthology.orchestra.run.smithi060.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-24T21:01:10.492 INFO:teuthology.orchestra.run.smithi060.stdout:kernel-install remove 6.11.0-rc3-g7503b862ff5b 2024-08-24T21:01:10.492 INFO:teuthology.orchestra.run.smithi060.stdout:fi 2024-08-24T21:01:10.492 DEBUG:teuthology.orchestra.run.smithi060:> sudo rpm -qi grub2-tools 2024-08-24T21:01:10.569 INFO:teuthology.orchestra.run.smithi060.stdout:Name : grub2-tools 2024-08-24T21:01:10.569 INFO:teuthology.orchestra.run.smithi060.stdout:Epoch : 1 2024-08-24T21:01:10.570 INFO:teuthology.orchestra.run.smithi060.stdout:Version : 2.06 2024-08-24T21:01:10.570 INFO:teuthology.orchestra.run.smithi060.stdout:Release : 82.el9 2024-08-24T21:01:10.570 INFO:teuthology.orchestra.run.smithi060.stdout:Architecture: x86_64 2024-08-24T21:01:10.570 INFO:teuthology.orchestra.run.smithi060.stdout:Install Date: Wed 21 Aug 2024 09:12:29 PM UTC 2024-08-24T21:01:10.570 INFO:teuthology.orchestra.run.smithi060.stdout:Group : Unspecified 2024-08-24T21:01:10.570 INFO:teuthology.orchestra.run.smithi060.stdout:Size : 8274670 2024-08-24T21:01:10.570 INFO:teuthology.orchestra.run.smithi060.stdout:License : GPLv3+ 2024-08-24T21:01:10.570 INFO:teuthology.orchestra.run.smithi060.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-08-24T21:01:10.570 INFO:teuthology.orchestra.run.smithi060.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-08-24T21:01:10.570 INFO:teuthology.orchestra.run.smithi060.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-08-24T21:01:10.570 INFO:teuthology.orchestra.run.smithi060.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-08-24T21:01:10.570 INFO:teuthology.orchestra.run.smithi060.stdout:Packager : builder@centos.org 2024-08-24T21:01:10.570 INFO:teuthology.orchestra.run.smithi060.stdout:Vendor : CentOS 2024-08-24T21:01:10.571 INFO:teuthology.orchestra.run.smithi060.stdout:URL : http://www.gnu.org/software/grub/ 2024-08-24T21:01:10.571 INFO:teuthology.orchestra.run.smithi060.stdout:Summary : Support tools for GRUB. 2024-08-24T21:01:10.571 INFO:teuthology.orchestra.run.smithi060.stdout:Description : 2024-08-24T21:01:10.571 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-08-24T21:01:10.571 INFO:teuthology.orchestra.run.smithi060.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-08-24T21:01:10.571 INFO:teuthology.orchestra.run.smithi060.stdout:customizable bootloader with modular architecture. It supports a rich 2024-08-24T21:01:10.571 INFO:teuthology.orchestra.run.smithi060.stdout:variety of kernel formats, file systems, computer architectures and 2024-08-24T21:01:10.571 INFO:teuthology.orchestra.run.smithi060.stdout:hardware devices. 2024-08-24T21:01:10.571 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-08-24T21:01:10.571 INFO:teuthology.orchestra.run.smithi060.stdout:This subpackage provides tools for support of all platforms. 2024-08-24T21:01:10.572 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-08-24T21:01:10.572 INFO:teuthology.task.kernel:Updating grub on smithi060 to boot 6.11.0-rc3-g7503b862ff5b 2024-08-24T21:01:10.572 DEBUG:teuthology.orchestra.run.smithi060:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-08-24T21:01:11.203 INFO:teuthology.orchestra.run.smithi060.stderr:Generating grub configuration file ... 2024-08-24T21:01:11.868 INFO:teuthology.orchestra.run.smithi179.stdout:Verifying... ######################################## 2024-08-24T21:01:12.024 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing... ######################################## 2024-08-24T21:01:12.140 INFO:teuthology.orchestra.run.smithi179.stdout:Updating / installing... 2024-08-24T21:01:12.690 INFO:teuthology.orchestra.run.smithi060.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-08-24T21:01:12.722 INFO:teuthology.orchestra.run.smithi060.stderr:done 2024-08-24T21:01:12.725 DEBUG:teuthology.orchestra.run.smithi060:> mktemp 2024-08-24T21:01:12.745 INFO:teuthology.orchestra.run.smithi060.stdout:/tmp/tmp.cg3P37xLx4 2024-08-24T21:01:12.746 DEBUG:teuthology.orchestra.run.smithi060:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.cg3P37xLx4 2024-08-24T21:01:12.817 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 0666 /tmp/tmp.cg3P37xLx4 2024-08-24T21:01:12.964 DEBUG:teuthology.orchestra.remote:smithi060:/tmp/tmp.cg3P37xLx4 is 6KB 2024-08-24T21:01:13.012 DEBUG:teuthology.orchestra.run.smithi060:> rm -fr /tmp/tmp.cg3P37xLx4 2024-08-24T21:01:13.027 DEBUG:teuthology.orchestra.run.smithi060:> sudo /bin/ls /boot/loader/entries || true 2024-08-24T21:01:13.094 INFO:teuthology.orchestra.run.smithi060.stdout:7acb1e34f9714b649e59f4e98f1746e5-0-rescue.conf 2024-08-24T21:01:13.094 INFO:teuthology.orchestra.run.smithi060.stdout:7acb1e34f9714b649e59f4e98f1746e5-5.14.0-239.el9.x86_64.conf 2024-08-24T21:01:13.094 INFO:teuthology.orchestra.run.smithi060.stdout:7acb1e34f9714b649e59f4e98f1746e5-5.14.0-496.el9.x86_64.conf 2024-08-24T21:01:13.094 INFO:teuthology.orchestra.run.smithi060.stdout:7acb1e34f9714b649e59f4e98f1746e5-6.11.0-rc3-g7503b862ff5b.conf 2024-08-24T21:01:13.095 DEBUG:teuthology.orchestra.run.smithi060:> sudo grub2-set-default 7acb1e34f9714b649e59f4e98f1746e5-6.11.0-rc3-g7503b862ff5b 2024-08-24T21:01:13.244 DEBUG:teuthology.orchestra.run.smithi060:> sudo shutdown -r now 2024-08-24T21:01:20.195 INFO:teuthology.orchestra.run.smithi179.stdout:kernel-6.11.0_rc3_g7503b862ff5b-1 ######################################## 2024-08-24T21:01:38.073 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-08-24T21:01:38.074 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-08-24T21:01:38.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-24T21:01:43.247 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-08-24T21:01:43.247 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-08-24T21:01:43.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-24T21:01:56.543 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-08-24T21:01:58.621 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi179.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-08-24T21:01:58.621 DEBUG:teuthology.orchestra.run.smithi179:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-08-24T21:01:58.707 INFO:teuthology.orchestra.run.smithi179.stdout:/boot/System.map-6.11.0-rc3-g7503b862ff5b 2024-08-24T21:01:58.707 INFO:teuthology.orchestra.run.smithi179.stdout:/boot/config-6.11.0-rc3-g7503b862ff5b 2024-08-24T21:01:58.708 INFO:teuthology.orchestra.run.smithi179.stdout:/boot/vmlinuz-6.11.0-rc3-g7503b862ff5b 2024-08-24T21:01:58.708 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b 2024-08-24T21:01:58.708 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/System.map 2024-08-24T21:01:58.708 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/config 2024-08-24T21:01:58.708 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel 2024-08-24T21:01:58.708 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch 2024-08-24T21:01:58.708 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86 2024-08-24T21:01:58.708 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto 2024-08-24T21:01:58.708 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-08-24T21:01:58.709 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-08-24T21:01:58.709 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-08-24T21:01:58.709 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-08-24T21:01:58.709 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-08-24T21:01:58.709 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-08-24T21:01:58.709 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-08-24T21:01:58.709 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32c-intel.ko 2024-08-24T21:01:58.709 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-08-24T21:01:58.709 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-08-24T21:01:58.709 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-08-24T21:01:58.709 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-08-24T21:01:58.710 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx2.ko 2024-08-24T21:01:58.710 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-08-24T21:01:58.710 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-08-24T21:01:58.710 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-08-24T21:01:58.710 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-08-24T21:01:58.710 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-08-24T21:01:58.710 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-08-24T21:01:58.710 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-08-24T21:01:58.710 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel 2024-08-24T21:01:58.710 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu 2024-08-24T21:01:58.710 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce 2024-08-24T21:01:58.711 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-08-24T21:01:58.711 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm 2024-08-24T21:01:58.711 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-amd.ko 2024-08-24T21:01:58.711 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-intel.ko 2024-08-24T21:01:58.711 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm.ko 2024-08-24T21:01:58.711 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto 2024-08-24T21:01:58.711 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ansi_cprng.ko 2024-08-24T21:01:58.711 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/anubis.ko 2024-08-24T21:01:58.711 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/arc4.ko 2024-08-24T21:01:58.711 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx 2024-08-24T21:01:58.711 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_memcpy.ko 2024-08-24T21:01:58.711 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_pq.ko 2024-08-24T21:01:58.711 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_raid6_recov.ko 2024-08-24T21:01:58.712 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_tx.ko 2024-08-24T21:01:58.712 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_xor.ko 2024-08-24T21:01:58.712 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/raid6test.ko 2024-08-24T21:01:58.712 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authenc.ko 2024-08-24T21:01:58.712 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authencesn.ko 2024-08-24T21:01:58.712 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blake2b_generic.ko 2024-08-24T21:01:58.712 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_common.ko 2024-08-24T21:01:58.712 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_generic.ko 2024-08-24T21:01:58.712 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/camellia_generic.ko 2024-08-24T21:01:58.712 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast5_generic.ko 2024-08-24T21:01:58.712 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast6_generic.ko 2024-08-24T21:01:58.712 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast_common.ko 2024-08-24T21:01:58.713 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ccm.ko 2024-08-24T21:01:58.713 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cmac.ko 2024-08-24T21:01:58.713 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crc32_generic.ko 2024-08-24T21:01:58.713 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_engine.ko 2024-08-24T21:01:58.713 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_user.ko 2024-08-24T21:01:58.713 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cts.ko 2024-08-24T21:01:58.713 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/des_generic.ko 2024-08-24T21:01:58.713 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/dh_generic.ko 2024-08-24T21:01:58.713 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecc.ko 2024-08-24T21:01:58.713 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecdh_generic.ko 2024-08-24T21:01:58.713 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/echainiv.ko 2024-08-24T21:01:58.713 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/essiv.ko 2024-08-24T21:01:58.713 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/fcrypt.ko 2024-08-24T21:01:58.714 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/khazad.ko 2024-08-24T21:01:58.714 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4.ko 2024-08-24T21:01:58.714 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4hc.ko 2024-08-24T21:01:58.714 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/md4.ko 2024-08-24T21:01:58.714 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/michael_mic.ko 2024-08-24T21:01:58.714 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcbc.ko 2024-08-24T21:01:58.714 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcrypt.ko 2024-08-24T21:01:58.714 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/rmd160.ko 2024-08-24T21:01:58.714 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/seed.ko 2024-08-24T21:01:58.714 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/serpent_generic.ko 2024-08-24T21:01:58.715 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tcrypt.ko 2024-08-24T21:01:58.715 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tea.ko 2024-08-24T21:01:58.716 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_common.ko 2024-08-24T21:01:58.716 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_generic.ko 2024-08-24T21:01:58.716 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/vmac.ko 2024-08-24T21:01:58.716 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/wp512.ko 2024-08-24T21:01:58.716 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xcbc.ko 2024-08-24T21:01:58.716 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xor.ko 2024-08-24T21:01:58.716 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xxhash_generic.ko 2024-08-24T21:01:58.716 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers 2024-08-24T21:01:58.716 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi 2024-08-24T21:01:58.716 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_ipmi.ko 2024-08-24T21:01:58.716 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_pad.ko 2024-08-24T21:01:58.716 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/ec_sys.ko 2024-08-24T21:01:58.717 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/platform_profile.ko 2024-08-24T21:01:58.717 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbs.ko 2024-08-24T21:01:58.717 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbshc.ko 2024-08-24T21:01:58.717 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/video.ko 2024-08-24T21:01:58.717 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata 2024-08-24T21:01:58.717 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/acard-ahci.ko 2024-08-24T21:01:58.717 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ahci_platform.ko 2024-08-24T21:01:58.717 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ata_generic.ko 2024-08-24T21:01:58.717 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/libahci_platform.ko 2024-08-24T21:01:58.717 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_acpi.ko 2024-08-24T21:01:58.717 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ali.ko 2024-08-24T21:01:58.717 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_amd.ko 2024-08-24T21:01:58.717 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_artop.ko 2024-08-24T21:01:58.718 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atiixp.ko 2024-08-24T21:01:58.718 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atp867x.ko 2024-08-24T21:01:58.718 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd640.ko 2024-08-24T21:01:58.718 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd64x.ko 2024-08-24T21:01:58.718 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cypress.ko 2024-08-24T21:01:58.718 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_efar.ko 2024-08-24T21:01:58.718 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt366.ko 2024-08-24T21:01:58.718 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt37x.ko 2024-08-24T21:01:58.718 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x2n.ko 2024-08-24T21:01:58.718 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x3.ko 2024-08-24T21:01:58.718 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it8213.ko 2024-08-24T21:01:58.718 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it821x.ko 2024-08-24T21:01:58.718 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_jmicron.ko 2024-08-24T21:01:58.719 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_marvell.ko 2024-08-24T21:01:58.719 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_mpiix.ko 2024-08-24T21:01:58.719 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_netcell.ko 2024-08-24T21:01:58.719 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ninja32.ko 2024-08-24T21:01:58.719 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87410.ko 2024-08-24T21:01:58.719 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87415.ko 2024-08-24T21:01:58.719 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_oldpiix.ko 2024-08-24T21:01:58.719 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_opti.ko 2024-08-24T21:01:58.719 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_optidma.ko 2024-08-24T21:01:58.719 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pcmcia.ko 2024-08-24T21:01:58.719 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc2027x.ko 2024-08-24T21:01:58.719 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-08-24T21:01:58.720 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_piccolo.ko 2024-08-24T21:01:58.720 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_rdc.ko 2024-08-24T21:01:58.720 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sch.ko 2024-08-24T21:01:58.720 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_serverworks.ko 2024-08-24T21:01:58.720 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sil680.ko 2024-08-24T21:01:58.720 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sis.ko 2024-08-24T21:01:58.720 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sl82c105.ko 2024-08-24T21:01:58.720 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_triflex.ko 2024-08-24T21:01:58.720 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_via.ko 2024-08-24T21:01:58.720 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pdc_adma.ko 2024-08-24T21:01:58.720 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_inic162x.ko 2024-08-24T21:01:58.720 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_mv.ko 2024-08-24T21:01:58.720 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_nv.ko 2024-08-24T21:01:58.721 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_promise.ko 2024-08-24T21:01:58.721 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_qstor.ko 2024-08-24T21:01:58.721 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil.ko 2024-08-24T21:01:58.721 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil24.ko 2024-08-24T21:01:58.721 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sis.ko 2024-08-24T21:01:58.721 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_svw.ko 2024-08-24T21:01:58.721 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sx4.ko 2024-08-24T21:01:58.721 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_uli.ko 2024-08-24T21:01:58.721 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_via.ko 2024-08-24T21:01:58.721 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_vsc.ko 2024-08-24T21:01:58.721 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay 2024-08-24T21:01:58.721 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay/ks0108.ko 2024-08-24T21:01:58.721 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base 2024-08-24T21:01:58.722 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap 2024-08-24T21:01:58.722 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-i2c.ko 2024-08-24T21:01:58.722 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-mmio.ko 2024-08-24T21:01:58.722 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma 2024-08-24T21:01:58.722 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma/bcma.ko 2024-08-24T21:01:58.722 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block 2024-08-24T21:01:58.722 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe 2024-08-24T21:01:58.722 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe/aoe.ko 2024-08-24T21:01:58.722 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/brd.ko 2024-08-24T21:01:58.722 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd 2024-08-24T21:01:58.722 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd/drbd.ko 2024-08-24T21:01:58.722 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/floppy.ko 2024-08-24T21:01:58.723 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/loop.ko 2024-08-24T21:01:58.723 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx 2024-08-24T21:01:58.723 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-08-24T21:01:58.723 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/nbd.ko 2024-08-24T21:01:58.723 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk 2024-08-24T21:01:58.723 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk/null_blk.ko 2024-08-24T21:01:58.723 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/pktcdvd.ko 2024-08-24T21:01:58.723 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/rbd.ko 2024-08-24T21:01:58.723 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/virtio_blk.ko 2024-08-24T21:01:58.723 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback 2024-08-24T21:01:58.723 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-08-24T21:01:58.723 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkfront.ko 2024-08-24T21:01:58.723 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram 2024-08-24T21:01:58.724 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram/zram.ko 2024-08-24T21:01:58.724 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char 2024-08-24T21:01:58.724 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hangcheck-timer.ko 2024-08-24T21:01:58.724 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random 2024-08-24T21:01:58.724 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/amd-rng.ko 2024-08-24T21:01:58.724 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/intel-rng.ko 2024-08-24T21:01:58.724 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-08-24T21:01:58.724 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/via-rng.ko 2024-08-24T21:01:58.724 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/virtio-rng.ko 2024-08-24T21:01:58.724 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi 2024-08-24T21:01:58.724 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-08-24T21:01:58.724 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-08-24T21:01:58.724 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-08-24T21:01:58.725 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_si.ko 2024-08-24T21:01:58.725 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-08-24T21:01:58.725 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-08-24T21:01:58.725 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/lp.ko 2024-08-24T21:01:58.725 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave 2024-08-24T21:01:58.725 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave/mwave.ko 2024-08-24T21:01:58.725 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ppdev.ko 2024-08-24T21:01:58.725 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tlclk.ko 2024-08-24T21:01:58.725 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm 2024-08-24T21:01:58.725 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm.ko 2024-08-24T21:01:58.725 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_atmel.ko 2024-08-24T21:01:58.725 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_infineon.ko 2024-08-24T21:01:58.725 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_nsc.ko 2024-08-24T21:01:58.726 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis.ko 2024-08-24T21:01:58.726 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-08-24T21:01:58.726 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/uv_mmtimer.ko 2024-08-24T21:01:58.726 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/virtio_console.ko 2024-08-24T21:01:58.726 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq 2024-08-24T21:01:58.726 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-08-24T21:01:58.726 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-08-24T21:01:58.726 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/p4-clockmod.ko 2024-08-24T21:01:58.726 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-08-24T21:01:58.726 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/powernow-k8.ko 2024-08-24T21:01:58.726 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/speedstep-lib.ko 2024-08-24T21:01:58.726 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto 2024-08-24T21:01:58.726 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp 2024-08-24T21:01:58.726 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-08-24T21:01:58.727 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp.ko 2024-08-24T21:01:58.727 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel 2024-08-24T21:01:58.727 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat 2024-08-24T21:01:58.727 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common 2024-08-24T21:01:58.727 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-08-24T21:01:58.727 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-08-24T21:01:58.727 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-08-24T21:01:58.727 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-aes.ko 2024-08-24T21:01:58.727 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-sha.ko 2024-08-24T21:01:58.727 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio 2024-08-24T21:01:58.727 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-08-24T21:01:58.727 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca 2024-08-24T21:01:58.728 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca/dca.ko 2024-08-24T21:01:58.728 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq 2024-08-24T21:01:58.728 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-08-24T21:01:58.728 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma 2024-08-24T21:01:58.728 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw 2024-08-24T21:01:58.728 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw/dw_dmac.ko 2024-08-24T21:01:58.728 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat 2024-08-24T21:01:58.728 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat/ioatdma.ko 2024-08-24T21:01:58.728 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac 2024-08-24T21:01:58.728 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/amd64_edac.ko 2024-08-24T21:01:58.728 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/e752x_edac.ko 2024-08-24T21:01:58.728 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/edac_mce_amd.ko 2024-08-24T21:01:58.728 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3000_edac.ko 2024-08-24T21:01:58.729 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3200_edac.ko 2024-08-24T21:01:58.729 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5100_edac.ko 2024-08-24T21:01:58.729 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5400_edac.ko 2024-08-24T21:01:58.729 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7300_edac.ko 2024-08-24T21:01:58.729 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7core_edac.ko 2024-08-24T21:01:58.729 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i82975x_edac.ko 2024-08-24T21:01:58.729 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/ie31200_edac.ko 2024-08-24T21:01:58.729 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/sb_edac.ko 2024-08-24T21:01:58.729 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/x38_edac.ko 2024-08-24T21:01:58.729 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware 2024-08-24T21:01:58.729 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/edd.ko 2024-08-24T21:01:58.729 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/iscsi_ibft.ko 2024-08-24T21:01:58.729 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio 2024-08-24T21:01:58.730 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-ich.ko 2024-08-24T21:01:58.730 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-viperboard.ko 2024-08-24T21:01:58.730 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid 2024-08-24T21:01:58.730 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-appleir.ko 2024-08-24T21:01:58.730 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-aureal.ko 2024-08-24T21:01:58.730 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-axff.ko 2024-08-24T21:01:58.730 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-dr.ko 2024-08-24T21:01:58.730 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elecom.ko 2024-08-24T21:01:58.730 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elo.ko 2024-08-24T21:01:58.730 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-emsff.ko 2024-08-24T21:01:58.730 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gaff.ko 2024-08-24T21:01:58.730 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gt683r.ko 2024-08-24T21:01:58.730 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gyration.ko 2024-08-24T21:01:58.731 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-kbd.ko 2024-08-24T21:01:58.731 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-mouse.ko 2024-08-24T21:01:58.731 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtekff.ko 2024-08-24T21:01:58.731 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-hyperv.ko 2024-08-24T21:01:58.731 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-icade.ko 2024-08-24T21:01:58.731 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-keytouch.ko 2024-08-24T21:01:58.731 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-kye.ko 2024-08-24T21:01:58.731 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lcpower.ko 2024-08-24T21:01:58.731 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-led.ko 2024-08-24T21:01:58.731 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lenovo.ko 2024-08-24T21:01:58.731 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-dj.ko 2024-08-24T21:01:58.731 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-08-24T21:01:58.731 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-multitouch.ko 2024-08-24T21:01:58.732 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-ortek.ko 2024-08-24T21:01:58.732 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-penmount.ko 2024-08-24T21:01:58.732 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-petalynx.ko 2024-08-24T21:01:58.732 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-picolcd.ko 2024-08-24T21:01:58.732 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-pl.ko 2024-08-24T21:01:58.732 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-plantronics.ko 2024-08-24T21:01:58.732 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-primax.ko 2024-08-24T21:01:58.732 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-rmi.ko 2024-08-24T21:01:58.732 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-arvo.ko 2024-08-24T21:01:58.732 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-common.ko 2024-08-24T21:01:58.732 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-isku.ko 2024-08-24T21:01:58.732 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kone.ko 2024-08-24T21:01:58.732 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-08-24T21:01:58.733 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-konepure.ko 2024-08-24T21:01:58.733 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-08-24T21:01:58.733 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-lua.ko 2024-08-24T21:01:58.733 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-pyra.ko 2024-08-24T21:01:58.733 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-ryos.ko 2024-08-24T21:01:58.733 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-savu.ko 2024-08-24T21:01:58.733 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat.ko 2024-08-24T21:01:58.733 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-saitek.ko 2024-08-24T21:01:58.733 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-samsung.ko 2024-08-24T21:01:58.733 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sensor-hub.ko 2024-08-24T21:01:58.733 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sjoy.ko 2024-08-24T21:01:58.733 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sony.ko 2024-08-24T21:01:58.733 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-speedlink.ko 2024-08-24T21:01:58.733 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-steelseries.ko 2024-08-24T21:01:58.734 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sunplus.ko 2024-08-24T21:01:58.734 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-thrustmaster.ko 2024-08-24T21:01:58.734 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tivo.ko 2024-08-24T21:01:58.734 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tmff.ko 2024-08-24T21:01:58.734 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-topseed.ko 2024-08-24T21:01:58.734 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-twinhan.ko 2024-08-24T21:01:58.734 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-uclogic.ko 2024-08-24T21:01:58.734 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-waltop.ko 2024-08-24T21:01:58.734 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-wiimote.ko 2024-08-24T21:01:58.734 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-xinmo.ko 2024-08-24T21:01:58.734 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zpff.ko 2024-08-24T21:01:58.734 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zydacron.ko 2024-08-24T21:01:58.734 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/uhid.ko 2024-08-24T21:01:58.735 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/wacom.ko 2024-08-24T21:01:58.735 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv 2024-08-24T21:01:58.735 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_balloon.ko 2024-08-24T21:01:58.735 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_utils.ko 2024-08-24T21:01:58.735 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_vmbus.ko 2024-08-24T21:01:58.735 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon 2024-08-24T21:01:58.735 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru.ko 2024-08-24T21:01:58.735 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru3.ko 2024-08-24T21:01:58.735 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/acpi_power_meter.ko 2024-08-24T21:01:58.735 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7414.ko 2024-08-24T21:01:58.735 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7418.ko 2024-08-24T21:01:58.735 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adc128d818.ko 2024-08-24T21:01:58.735 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1025.ko 2024-08-24T21:01:58.736 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1026.ko 2024-08-24T21:01:58.736 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1029.ko 2024-08-24T21:01:58.736 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1031.ko 2024-08-24T21:01:58.736 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm9240.ko 2024-08-24T21:01:58.736 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ads7828.ko 2024-08-24T21:01:58.736 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7410.ko 2024-08-24T21:01:58.736 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7411.ko 2024-08-24T21:01:58.736 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7462.ko 2024-08-24T21:01:58.736 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7470.ko 2024-08-24T21:01:58.736 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7475.ko 2024-08-24T21:01:58.736 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7x10.ko 2024-08-24T21:01:58.736 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/amc6821.ko 2024-08-24T21:01:58.736 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/applesmc.ko 2024-08-24T21:01:58.737 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asb100.ko 2024-08-24T21:01:58.737 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asc7621.ko 2024-08-24T21:01:58.737 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asus_atk0110.ko 2024-08-24T21:01:58.737 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/atxp1.ko 2024-08-24T21:01:58.737 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/coretemp.ko 2024-08-24T21:01:58.737 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-08-24T21:01:58.737 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dme1737.ko 2024-08-24T21:01:58.737 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds1621.ko 2024-08-24T21:01:58.737 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds620.ko 2024-08-24T21:01:58.737 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc1403.ko 2024-08-24T21:01:58.737 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc6w201.ko 2024-08-24T21:01:58.738 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71805f.ko 2024-08-24T21:01:58.738 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71882fg.ko 2024-08-24T21:01:58.738 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f75375s.ko 2024-08-24T21:01:58.738 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fam15h_power.ko 2024-08-24T21:01:58.738 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fschmd.ko 2024-08-24T21:01:58.738 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g760a.ko 2024-08-24T21:01:58.738 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g762.ko 2024-08-24T21:01:58.738 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl518sm.ko 2024-08-24T21:01:58.738 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl520sm.ko 2024-08-24T21:01:58.738 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/hwmon-vid.ko 2024-08-24T21:01:58.738 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5500_temp.ko 2024-08-24T21:01:58.739 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5k_amb.ko 2024-08-24T21:01:58.739 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmaem.ko 2024-08-24T21:01:58.739 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmpex.ko 2024-08-24T21:01:58.739 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina209.ko 2024-08-24T21:01:58.739 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina2xx.ko 2024-08-24T21:01:58.739 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/it87.ko 2024-08-24T21:01:58.739 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k10temp.ko 2024-08-24T21:01:58.739 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k8temp.ko 2024-08-24T21:01:58.739 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lineage-pem.ko 2024-08-24T21:01:58.739 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm63.ko 2024-08-24T21:01:58.739 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm73.ko 2024-08-24T21:01:58.739 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm75.ko 2024-08-24T21:01:58.739 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm77.ko 2024-08-24T21:01:58.739 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm78.ko 2024-08-24T21:01:58.740 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm80.ko 2024-08-24T21:01:58.740 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm83.ko 2024-08-24T21:01:58.740 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm85.ko 2024-08-24T21:01:58.740 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm87.ko 2024-08-24T21:01:58.740 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm90.ko 2024-08-24T21:01:58.740 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm92.ko 2024-08-24T21:01:58.740 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm93.ko 2024-08-24T21:01:58.740 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95234.ko 2024-08-24T21:01:58.740 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95241.ko 2024-08-24T21:01:58.740 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95245.ko 2024-08-24T21:01:58.740 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc2945.ko 2024-08-24T21:01:58.740 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4151.ko 2024-08-24T21:01:58.740 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4215.ko 2024-08-24T21:01:58.741 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4222.ko 2024-08-24T21:01:58.741 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4245.ko 2024-08-24T21:01:58.741 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4260.ko 2024-08-24T21:01:58.741 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4261.ko 2024-08-24T21:01:58.741 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max16065.ko 2024-08-24T21:01:58.741 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1619.ko 2024-08-24T21:01:58.741 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1668.ko 2024-08-24T21:01:58.741 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max197.ko 2024-08-24T21:01:58.741 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6639.ko 2024-08-24T21:01:58.741 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6650.ko 2024-08-24T21:01:58.741 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6697.ko 2024-08-24T21:01:58.741 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/mcp3021.ko 2024-08-24T21:01:58.741 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6683.ko 2024-08-24T21:01:58.741 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775-core.ko 2024-08-24T21:01:58.742 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775.ko 2024-08-24T21:01:58.742 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct7802.ko 2024-08-24T21:01:58.742 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87360.ko 2024-08-24T21:01:58.742 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87427.ko 2024-08-24T21:01:58.742 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pcf8591.ko 2024-08-24T21:01:58.742 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus 2024-08-24T21:01:58.742 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-08-24T21:01:58.742 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-08-24T21:01:58.742 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-08-24T21:01:58.742 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max16064.ko 2024-08-24T21:01:58.742 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max34440.ko 2024-08-24T21:01:58.742 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max8688.ko 2024-08-24T21:01:58.742 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-08-24T21:01:58.743 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-08-24T21:01:58.743 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-08-24T21:01:58.743 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-08-24T21:01:58.743 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-08-24T21:01:58.743 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-08-24T21:01:58.743 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/powr1220.ko 2024-08-24T21:01:58.743 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5627.ko 2024-08-24T21:01:58.743 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5636.ko 2024-08-24T21:01:58.743 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch56xx-common.ko 2024-08-24T21:01:58.743 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht15.ko 2024-08-24T21:01:58.743 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht21.ko 2024-08-24T21:01:58.743 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/shtc1.ko 2024-08-24T21:01:58.743 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sis5595.ko 2024-08-24T21:01:58.744 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47b397.ko 2024-08-24T21:01:58.744 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m1.ko 2024-08-24T21:01:58.744 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m192.ko 2024-08-24T21:01:58.744 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/thmc50.ko 2024-08-24T21:01:58.744 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp102.ko 2024-08-24T21:01:58.744 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp103.ko 2024-08-24T21:01:58.744 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp401.ko 2024-08-24T21:01:58.744 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp421.ko 2024-08-24T21:01:58.744 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via-cputemp.ko 2024-08-24T21:01:58.744 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via686a.ko 2024-08-24T21:01:58.744 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt1211.ko 2024-08-24T21:01:58.744 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt8231.ko 2024-08-24T21:01:58.744 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627ehf.ko 2024-08-24T21:01:58.744 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627hf.ko 2024-08-24T21:01:58.745 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83781d.ko 2024-08-24T21:01:58.745 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83791d.ko 2024-08-24T21:01:58.745 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83792d.ko 2024-08-24T21:01:58.745 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83793.ko 2024-08-24T21:01:58.745 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83795.ko 2024-08-24T21:01:58.745 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l785ts.ko 2024-08-24T21:01:58.745 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l786ng.ko 2024-08-24T21:01:58.745 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c 2024-08-24T21:01:58.745 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos 2024-08-24T21:01:58.745 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-08-24T21:01:58.745 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-08-24T21:01:58.745 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses 2024-08-24T21:01:58.745 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-08-24T21:01:58.746 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-08-24T21:01:58.746 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-08-24T21:01:58.746 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-08-24T21:01:58.746 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-08-24T21:01:58.746 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-08-24T21:01:58.746 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-08-24T21:01:58.746 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-08-24T21:01:58.746 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-i801.ko 2024-08-24T21:01:58.746 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-isch.ko 2024-08-24T21:01:58.746 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-08-24T21:01:58.746 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-08-24T21:01:58.746 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-08-24T21:01:58.746 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-parport.ko 2024-08-24T21:01:58.747 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-08-24T21:01:58.747 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-08-24T21:01:58.747 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-08-24T21:01:58.747 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-08-24T21:01:58.747 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-08-24T21:01:58.747 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-08-24T21:01:58.747 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-via.ko 2024-08-24T21:01:58.747 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-08-24T21:01:58.747 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-08-24T21:01:58.747 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-dev.ko 2024-08-24T21:01:58.747 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-mux.ko 2024-08-24T21:01:58.747 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-08-24T21:01:58.748 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-smbus.ko 2024-08-24T21:01:58.748 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-stub.ko 2024-08-24T21:01:58.748 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband 2024-08-24T21:01:58.748 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core 2024-08-24T21:01:58.748 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_cm.ko 2024-08-24T21:01:58.748 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_core.ko 2024-08-24T21:01:58.748 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_umad.ko 2024-08-24T21:01:58.748 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-08-24T21:01:58.748 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/iw_cm.ko 2024-08-24T21:01:58.748 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_cm.ko 2024-08-24T21:01:58.748 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-08-24T21:01:58.748 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw 2024-08-24T21:01:58.748 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4 2024-08-24T21:01:58.749 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-08-24T21:01:58.749 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4 2024-08-24T21:01:58.749 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-08-24T21:01:58.749 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5 2024-08-24T21:01:58.749 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-08-24T21:01:58.749 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca 2024-08-24T21:01:58.749 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-08-24T21:01:58.749 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp 2024-08-24T21:01:58.749 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib 2024-08-24T21:01:58.749 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-08-24T21:01:58.749 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser 2024-08-24T21:01:58.749 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-08-24T21:01:58.750 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert 2024-08-24T21:01:58.750 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-08-24T21:01:58.750 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp 2024-08-24T21:01:58.750 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-08-24T21:01:58.750 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt 2024-08-24T21:01:58.750 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-08-24T21:01:58.750 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input 2024-08-24T21:01:58.750 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport 2024-08-24T21:01:58.750 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-08-24T21:01:58.750 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/fm801-gp.ko 2024-08-24T21:01:58.750 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/gameport.ko 2024-08-24T21:01:58.750 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/joydev.ko 2024-08-24T21:01:58.750 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard 2024-08-24T21:01:58.751 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/gpio_keys.ko 2024-08-24T21:01:58.751 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse 2024-08-24T21:01:58.751 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/appletouch.ko 2024-08-24T21:01:58.751 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/bcm5974.ko 2024-08-24T21:01:58.751 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/cyapatp.ko 2024-08-24T21:01:58.751 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/elan_i2c.ko 2024-08-24T21:01:58.751 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/sermouse.ko 2024-08-24T21:01:58.751 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-08-24T21:01:58.751 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_usb.ko 2024-08-24T21:01:58.751 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/vsxxxaa.ko 2024-08-24T21:01:58.751 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4 2024-08-24T21:01:58.751 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4/rmi_core.ko 2024-08-24T21:01:58.752 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio 2024-08-24T21:01:58.752 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/altera_ps2.ko 2024-08-24T21:01:58.752 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/arc_ps2.ko 2024-08-24T21:01:58.752 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-08-24T21:01:58.752 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/serio_raw.ko 2024-08-24T21:01:58.752 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/sparse-keymap.ko 2024-08-24T21:01:58.752 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds 2024-08-24T21:01:58.752 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-blinkm.ko 2024-08-24T21:01:58.752 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lm3530.ko 2024-08-24T21:01:58.752 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lp3944.ko 2024-08-24T21:01:58.752 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-ss4200.ko 2024-08-24T21:01:58.752 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger 2024-08-24T21:01:58.752 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-08-24T21:01:58.752 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-08-24T21:01:58.753 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-08-24T21:01:58.753 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-08-24T21:01:58.753 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-08-24T21:01:58.753 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-08-24T21:01:58.753 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-08-24T21:01:58.753 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-08-24T21:01:58.753 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md 2024-08-24T21:01:58.753 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache 2024-08-24T21:01:58.753 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache/bcache.ko 2024-08-24T21:01:58.753 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-bio-prison.ko 2024-08-24T21:01:58.753 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache-smq.ko 2024-08-24T21:01:58.753 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache.ko 2024-08-24T21:01:58.753 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-crypt.ko 2024-08-24T21:01:58.753 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-delay.ko 2024-08-24T21:01:58.754 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-flakey.ko 2024-08-24T21:01:58.754 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-log-userspace.ko 2024-08-24T21:01:58.754 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-multipath.ko 2024-08-24T21:01:58.754 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-queue-length.ko 2024-08-24T21:01:58.754 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-raid.ko 2024-08-24T21:01:58.754 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-round-robin.ko 2024-08-24T21:01:58.754 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-service-time.ko 2024-08-24T21:01:58.754 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-switch.ko 2024-08-24T21:01:58.754 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-thin-pool.ko 2024-08-24T21:01:58.754 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-verity.ko 2024-08-24T21:01:58.754 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data 2024-08-24T21:01:58.754 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-08-24T21:01:58.755 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid0.ko 2024-08-24T21:01:58.755 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid1.ko 2024-08-24T21:01:58.755 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid10.ko 2024-08-24T21:01:58.755 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid456.ko 2024-08-24T21:01:58.755 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message 2024-08-24T21:01:58.755 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion 2024-08-24T21:01:58.755 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptbase.ko 2024-08-24T21:01:58.755 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptctl.ko 2024-08-24T21:01:58.755 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptfc.ko 2024-08-24T21:01:58.755 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptlan.ko 2024-08-24T21:01:58.755 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptsas.ko 2024-08-24T21:01:58.755 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptscsih.ko 2024-08-24T21:01:58.755 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptspi.ko 2024-08-24T21:01:58.756 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd 2024-08-24T21:01:58.756 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_ich.ko 2024-08-24T21:01:58.756 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_sch.ko 2024-08-24T21:01:58.756 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/mfd-core.ko 2024-08-24T21:01:58.756 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/sm501.ko 2024-08-24T21:01:58.756 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/viperboard.ko 2024-08-24T21:01:58.756 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/vx855.ko 2024-08-24T21:01:58.756 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/wl1273-core.ko 2024-08-24T21:01:58.756 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc 2024-08-24T21:01:58.756 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl 2024-08-24T21:01:58.756 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-08-24T21:01:58.756 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds9802als.ko 2024-08-24T21:01:58.756 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds990x.ko 2024-08-24T21:01:58.757 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/bh1770glc.ko 2024-08-24T21:01:58.757 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710 2024-08-24T21:01:58.757 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710/cb710.ko 2024-08-24T21:01:58.757 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom 2024-08-24T21:01:58.757 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/at24.ko 2024-08-24T21:01:58.757 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-08-24T21:01:58.757 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/max6875.ko 2024-08-24T21:01:58.757 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/enclosure.ko 2024-08-24T21:01:58.757 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/hpilo.ko 2024-08-24T21:01:58.757 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29003.ko 2024-08-24T21:01:58.757 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29020.ko 2024-08-24T21:01:58.757 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d 2024-08-24T21:01:58.757 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-08-24T21:01:58.757 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-08-24T21:01:58.758 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei 2024-08-24T21:01:58.758 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-me.ko 2024-08-24T21:01:58.758 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-txe.ko 2024-08-24T21:01:58.758 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei.ko 2024-08-24T21:01:58.758 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru 2024-08-24T21:01:58.758 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru/gru.ko 2024-08-24T21:01:58.758 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp 2024-08-24T21:01:58.758 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xp.ko 2024-08-24T21:01:58.758 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpc.ko 2024-08-24T21:01:58.758 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-08-24T21:01:58.758 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_7xx1.ko 2024-08-24T21:01:58.758 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_core.ko 2024-08-24T21:01:58.758 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tsl2550.ko 2024-08-24T21:01:58.759 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_balloon.ko 2024-08-24T21:01:58.759 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci 2024-08-24T21:01:58.759 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-08-24T21:01:58.759 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net 2024-08-24T21:01:58.759 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding 2024-08-24T21:01:58.759 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding/bonding.ko 2024-08-24T21:01:58.759 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa 2024-08-24T21:01:58.759 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53 2024-08-24T21:01:58.759 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53/b53_common.ko 2024-08-24T21:01:58.759 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/bcm-sf2.ko 2024-08-24T21:01:58.759 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6060.ko 2024-08-24T21:01:58.759 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx 2024-08-24T21:01:58.759 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-08-24T21:01:58.760 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dummy.ko 2024-08-24T21:01:58.760 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/eql.ko 2024-08-24T21:01:58.760 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet 2024-08-24T21:01:58.760 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com 2024-08-24T21:01:58.760 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-08-24T21:01:58.760 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-08-24T21:01:58.760 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-08-24T21:01:58.760 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-08-24T21:01:58.760 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390 2024-08-24T21:01:58.760 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/8390.ko 2024-08-24T21:01:58.760 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-08-24T21:01:58.760 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-08-24T21:01:58.760 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-08-24T21:01:58.760 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec 2024-08-24T21:01:58.761 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-08-24T21:01:58.761 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere 2024-08-24T21:01:58.761 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere/et131x.ko 2024-08-24T21:01:58.761 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon 2024-08-24T21:01:58.761 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-08-24T21:01:58.761 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera 2024-08-24T21:01:58.761 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-08-24T21:01:58.761 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd 2024-08-24T21:01:58.761 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-08-24T21:01:58.761 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-08-24T21:01:58.761 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-08-24T21:01:58.761 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros 2024-08-24T21:01:58.761 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx 2024-08-24T21:01:58.761 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-08-24T21:01:58.762 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c 2024-08-24T21:01:58.762 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-08-24T21:01:58.762 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e 2024-08-24T21:01:58.762 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-08-24T21:01:58.762 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx 2024-08-24T21:01:58.762 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-08-24T21:01:58.762 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-08-24T21:01:58.762 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom 2024-08-24T21:01:58.762 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-08-24T21:01:58.762 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-08-24T21:01:58.762 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-08-24T21:01:58.762 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-08-24T21:01:58.763 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-08-24T21:01:58.763 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet 2024-08-24T21:01:58.763 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-08-24T21:01:58.763 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-08-24T21:01:58.763 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade 2024-08-24T21:01:58.763 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna 2024-08-24T21:01:58.763 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-08-24T21:01:58.766 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio 2024-08-24T21:01:58.767 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb 2024-08-24T21:01:58.767 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-08-24T21:01:58.767 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-08-24T21:01:58.767 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-08-24T21:01:58.767 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-08-24T21:01:58.767 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-08-24T21:01:58.767 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-08-24T21:01:58.767 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-08-24T21:01:58.767 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-08-24T21:01:58.767 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-08-24T21:01:58.767 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco 2024-08-24T21:01:58.767 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic 2024-08-24T21:01:58.767 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-08-24T21:01:58.768 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec 2024-08-24T21:01:58.768 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip 2024-08-24T21:01:58.768 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-08-24T21:01:58.768 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-08-24T21:01:58.768 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-08-24T21:01:58.768 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-08-24T21:01:58.768 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-08-24T21:01:58.768 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-08-24T21:01:58.768 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink 2024-08-24T21:01:58.768 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-08-24T21:01:58.768 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-08-24T21:01:58.768 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dnet.ko 2024-08-24T21:01:58.768 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex 2024-08-24T21:01:58.769 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet 2024-08-24T21:01:58.769 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-08-24T21:01:58.769 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ethoc.ko 2024-08-24T21:01:58.769 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/fealnx.ko 2024-08-24T21:01:58.769 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel 2024-08-24T21:01:58.769 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e100.ko 2024-08-24T21:01:58.769 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000 2024-08-24T21:01:58.769 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-08-24T21:01:58.769 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e 2024-08-24T21:01:58.769 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-08-24T21:01:58.769 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k 2024-08-24T21:01:58.769 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-08-24T21:01:58.769 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e 2024-08-24T21:01:58.769 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-08-24T21:01:58.770 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf 2024-08-24T21:01:58.770 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-08-24T21:01:58.770 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb 2024-08-24T21:01:58.770 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-08-24T21:01:58.770 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf 2024-08-24T21:01:58.770 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-08-24T21:01:58.770 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe 2024-08-24T21:01:58.770 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-08-24T21:01:58.770 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf 2024-08-24T21:01:58.770 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-08-24T21:01:58.770 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth 2024-08-24T21:01:58.770 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-08-24T21:01:58.770 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie 2024-08-24T21:01:58.771 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-08-24T21:01:58.771 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/jme.ko 2024-08-24T21:01:58.771 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell 2024-08-24T21:01:58.771 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-08-24T21:01:58.771 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/skge.ko 2024-08-24T21:01:58.771 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-08-24T21:01:58.771 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox 2024-08-24T21:01:58.771 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4 2024-08-24T21:01:58.771 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-08-24T21:01:58.771 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-08-24T21:01:58.771 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5 2024-08-24T21:01:58.771 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-08-24T21:01:58.771 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-08-24T21:01:58.772 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel 2024-08-24T21:01:58.772 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-08-24T21:01:58.772 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom 2024-08-24T21:01:58.772 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge 2024-08-24T21:01:58.772 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-08-24T21:01:58.772 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi 2024-08-24T21:01:58.772 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-08-24T21:01:58.772 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-08-24T21:01:58.772 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion 2024-08-24T21:01:58.772 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-08-24T21:01:58.772 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia 2024-08-24T21:01:58.772 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-08-24T21:01:58.772 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines 2024-08-24T21:01:58.773 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-08-24T21:01:58.773 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-08-24T21:01:58.773 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic 2024-08-24T21:01:58.773 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen 2024-08-24T21:01:58.773 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-08-24T21:01:58.773 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-08-24T21:01:58.773 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-08-24T21:01:58.773 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-08-24T21:01:58.773 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc 2024-08-24T21:01:58.773 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-08-24T21:01:58.773 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek 2024-08-24T21:01:58.773 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-08-24T21:01:58.773 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-08-24T21:01:58.774 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/atp.ko 2024-08-24T21:01:58.774 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-08-24T21:01:58.774 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker 2024-08-24T21:01:58.774 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-08-24T21:01:58.774 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc 2024-08-24T21:01:58.774 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-08-24T21:01:58.774 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan 2024-08-24T21:01:58.774 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-08-24T21:01:58.774 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis 2024-08-24T21:01:58.774 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis190.ko 2024-08-24T21:01:58.774 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis900.ko 2024-08-24T21:01:58.774 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc 2024-08-24T21:01:58.774 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-08-24T21:01:58.775 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-08-24T21:01:58.775 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-08-24T21:01:58.775 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-08-24T21:01:58.775 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro 2024-08-24T21:01:58.775 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac 2024-08-24T21:01:58.775 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-08-24T21:01:58.775 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-08-24T21:01:58.775 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun 2024-08-24T21:01:58.775 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/cassini.ko 2024-08-24T21:01:58.775 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/niu.ko 2024-08-24T21:01:58.775 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sungem.ko 2024-08-24T21:01:58.775 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-08-24T21:01:58.775 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti 2024-08-24T21:01:58.775 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-08-24T21:01:58.776 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti 2024-08-24T21:01:58.776 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti/tlan.ko 2024-08-24T21:01:58.776 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via 2024-08-24T21:01:58.776 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-08-24T21:01:58.776 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-08-24T21:01:58.776 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet 2024-08-24T21:01:58.776 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-08-24T21:01:58.776 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-08-24T21:01:58.776 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom 2024-08-24T21:01:58.777 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-08-24T21:01:58.777 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/geneve.ko 2024-08-24T21:01:58.777 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv 2024-08-24T21:01:58.777 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-08-24T21:01:58.777 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154 2024-08-24T21:01:58.777 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154/fakelb.ko 2024-08-24T21:01:58.777 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ifb.ko 2024-08-24T21:01:58.777 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan 2024-08-24T21:01:58.777 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan/ipvlan.ko 2024-08-24T21:01:58.777 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvlan.ko 2024-08-24T21:01:58.778 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvtap.ko 2024-08-24T21:01:58.778 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio 2024-08-24T21:01:58.778 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio.ko 2024-08-24T21:01:58.778 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-08-24T21:01:58.778 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-08-24T21:01:58.778 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-regmap.ko 2024-08-24T21:01:58.778 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mii.ko 2024-08-24T21:01:58.778 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/net_failover.ko 2024-08-24T21:01:58.778 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/netconsole.ko 2024-08-24T21:01:58.778 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/nlmon.ko 2024-08-24T21:01:58.778 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs 2024-08-24T21:01:58.778 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs-lynx.ko 2024-08-24T21:01:58.778 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-08-24T21:01:58.779 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy 2024-08-24T21:01:58.779 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/amd.ko 2024-08-24T21:01:58.779 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-08-24T21:01:58.779 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-08-24T21:01:58.779 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm7xxx.ko 2024-08-24T21:01:58.779 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm87xx.ko 2024-08-24T21:01:58.779 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/broadcom.ko 2024-08-24T21:01:58.779 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/cicada.ko 2024-08-24T21:01:58.779 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/davicom.ko 2024-08-24T21:01:58.779 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/dp83640.ko 2024-08-24T21:01:58.779 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/et1011c.ko 2024-08-24T21:01:58.779 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/icplus.ko 2024-08-24T21:01:58.779 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/lxt.ko 2024-08-24T21:01:58.779 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/marvell.ko 2024-08-24T21:01:58.780 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/micrel.ko 2024-08-24T21:01:58.780 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/national.ko 2024-08-24T21:01:58.780 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/phylink.ko 2024-08-24T21:01:58.780 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/qsemi.ko 2024-08-24T21:01:58.780 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/realtek.ko 2024-08-24T21:01:58.780 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/smsc.ko 2024-08-24T21:01:58.780 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/ste10Xp.ko 2024-08-24T21:01:58.780 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/vitesse.ko 2024-08-24T21:01:58.780 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp 2024-08-24T21:01:58.781 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/bsd_comp.ko 2024-08-24T21:01:58.781 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_async.ko 2024-08-24T21:01:58.781 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_deflate.ko 2024-08-24T21:01:58.781 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_generic.ko 2024-08-24T21:01:58.781 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_mppe.ko 2024-08-24T21:01:58.781 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_synctty.ko 2024-08-24T21:01:58.781 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppoe.ko 2024-08-24T21:01:58.781 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppox.ko 2024-08-24T21:01:58.781 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pptp.ko 2024-08-24T21:01:58.781 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip 2024-08-24T21:01:58.781 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slhc.ko 2024-08-24T21:01:58.781 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slip.ko 2024-08-24T21:01:58.781 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/sungem_phy.ko 2024-08-24T21:01:58.782 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tap.ko 2024-08-24T21:01:58.782 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team 2024-08-24T21:01:58.782 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team.ko 2024-08-24T21:01:58.782 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_activebackup.ko 2024-08-24T21:01:58.782 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_broadcast.ko 2024-08-24T21:01:58.782 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-08-24T21:01:58.782 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_random.ko 2024-08-24T21:01:58.782 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-08-24T21:01:58.782 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tun.ko 2024-08-24T21:01:58.782 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/veth.ko 2024-08-24T21:01:58.783 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/virtio_net.ko 2024-08-24T21:01:58.783 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3 2024-08-24T21:01:58.783 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-08-24T21:01:58.783 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan 2024-08-24T21:01:58.783 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan/vxlan.ko 2024-08-24T21:01:58.783 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback 2024-08-24T21:01:58.783 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback/xen-netback.ko 2024-08-24T21:01:58.783 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netfront.ko 2024-08-24T21:01:58.783 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb 2024-08-24T21:01:58.783 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb/ntb.ko 2024-08-24T21:01:58.783 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme 2024-08-24T21:01:58.783 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host 2024-08-24T21:01:58.783 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme-core.ko 2024-08-24T21:01:58.784 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme.ko 2024-08-24T21:01:58.784 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport 2024-08-24T21:01:58.784 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport.ko 2024-08-24T21:01:58.784 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_cs.ko 2024-08-24T21:01:58.784 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_pc.ko 2024-08-24T21:01:58.784 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_serial.ko 2024-08-24T21:01:58.784 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci 2024-08-24T21:01:58.784 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug 2024-08-24T21:01:58.784 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-08-24T21:01:58.784 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie 2024-08-24T21:01:58.784 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie/aer_inject.ko 2024-08-24T21:01:58.784 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/xen-pcifront.ko 2024-08-24T21:01:58.784 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia 2024-08-24T21:01:58.784 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/i82092.ko 2024-08-24T21:01:58.785 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/pd6729.ko 2024-08-24T21:01:58.785 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/yenta_socket.ko 2024-08-24T21:01:58.785 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl 2024-08-24T21:01:58.785 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel 2024-08-24T21:01:58.785 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-08-24T21:01:58.785 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform 2024-08-24T21:01:58.785 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86 2024-08-24T21:01:58.785 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acer-wmi.ko 2024-08-24T21:01:58.785 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acerhdf.ko 2024-08-24T21:01:58.785 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/apple-gmux.ko 2024-08-24T21:01:58.785 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-laptop.ko 2024-08-24T21:01:58.785 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-08-24T21:01:58.786 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-wmi.ko 2024-08-24T21:01:58.786 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/classmate-laptop.ko 2024-08-24T21:01:58.786 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-08-24T21:01:58.786 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-08-24T21:01:58.786 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-08-24T21:01:58.786 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-08-24T21:01:58.786 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/hdaps.ko 2024-08-24T21:01:58.787 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel 2024-08-24T21:01:58.787 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-08-24T21:01:58.787 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel_ips.ko 2024-08-24T21:01:58.787 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/msi-wmi.ko 2024-08-24T21:01:58.787 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/mxm-wmi.ko 2024-08-24T21:01:58.787 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-08-24T21:01:58.787 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-laptop.ko 2024-08-24T21:01:58.787 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-q10.ko 2024-08-24T21:01:58.787 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/topstar-laptop.ko 2024-08-24T21:01:58.787 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-08-24T21:01:58.787 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_haps.ko 2024-08-24T21:01:58.787 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi-bmof.ko 2024-08-24T21:01:58.787 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi.ko 2024-08-24T21:01:58.788 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap 2024-08-24T21:01:58.788 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_common.ko 2024-08-24T21:01:58.788 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_msr.ko 2024-08-24T21:01:58.788 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps 2024-08-24T21:01:58.788 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients 2024-08-24T21:01:58.788 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-gpio.ko 2024-08-24T21:01:58.788 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-ldisc.ko 2024-08-24T21:01:58.788 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps_parport.ko 2024-08-24T21:01:58.788 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/pps_core.ko 2024-08-24T21:01:58.788 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp 2024-08-24T21:01:58.788 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp.ko 2024-08-24T21:01:58.788 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp_kvm.ko 2024-08-24T21:01:58.788 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras 2024-08-24T21:01:58.789 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd 2024-08-24T21:01:58.789 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl 2024-08-24T21:01:58.789 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-08-24T21:01:58.789 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/fmpm.ko 2024-08-24T21:01:58.789 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc 2024-08-24T21:01:58.789 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-bq32k.ko 2024-08-24T21:01:58.789 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1286.ko 2024-08-24T21:01:58.789 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1307.ko 2024-08-24T21:01:58.789 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1374.ko 2024-08-24T21:01:58.789 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1511.ko 2024-08-24T21:01:58.789 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1553.ko 2024-08-24T21:01:58.789 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1672.ko 2024-08-24T21:01:58.789 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1742.ko 2024-08-24T21:01:58.790 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds2404.ko 2024-08-24T21:01:58.790 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds3232.ko 2024-08-24T21:01:58.790 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-em3027.ko 2024-08-24T21:01:58.790 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-fm3130.ko 2024-08-24T21:01:58.790 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl12022.ko 2024-08-24T21:01:58.790 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl1208.ko 2024-08-24T21:01:58.790 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m41t80.ko 2024-08-24T21:01:58.790 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t35.ko 2024-08-24T21:01:58.790 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t59.ko 2024-08-24T21:01:58.790 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-max6900.ko 2024-08-24T21:01:58.790 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-msm6242.ko 2024-08-24T21:01:58.790 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf2127.ko 2024-08-24T21:01:58.790 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf85063.ko 2024-08-24T21:01:58.790 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8523.ko 2024-08-24T21:01:58.791 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8563.ko 2024-08-24T21:01:58.791 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8583.ko 2024-08-24T21:01:58.791 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rp5c01.ko 2024-08-24T21:01:58.791 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rs5c372.ko 2024-08-24T21:01:58.791 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-08-24T21:01:58.791 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8025.ko 2024-08-24T21:01:58.791 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8581.ko 2024-08-24T21:01:58.791 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-08-24T21:01:58.791 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-x1205.ko 2024-08-24T21:01:58.791 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi 2024-08-24T21:01:58.791 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-9xxx.ko 2024-08-24T21:01:58.791 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-sas.ko 2024-08-24T21:01:58.791 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-xxxx.ko 2024-08-24T21:01:58.792 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/BusLogic.ko 2024-08-24T21:01:58.792 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/a100u2w.ko 2024-08-24T21:01:58.792 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid 2024-08-24T21:01:58.792 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid/aacraid.ko 2024-08-24T21:01:58.792 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/advansys.ko 2024-08-24T21:01:58.792 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx 2024-08-24T21:01:58.792 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-08-24T21:01:58.792 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-08-24T21:01:58.792 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/am53c974.ko 2024-08-24T21:01:58.792 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr 2024-08-24T21:01:58.792 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-08-24T21:01:58.793 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/atp870u.ko 2024-08-24T21:01:58.793 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi 2024-08-24T21:01:58.793 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-08-24T21:01:58.793 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa 2024-08-24T21:01:58.793 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa/bfa.ko 2024-08-24T21:01:58.793 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc 2024-08-24T21:01:58.793 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-08-24T21:01:58.793 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i 2024-08-24T21:01:58.794 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-08-24T21:01:58.794 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ch.ko 2024-08-24T21:01:58.794 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor 2024-08-24T21:01:58.794 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor/csiostor.ko 2024-08-24T21:01:58.794 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi 2024-08-24T21:01:58.794 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i 2024-08-24T21:01:58.795 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-08-24T21:01:58.795 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i 2024-08-24T21:01:58.795 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-08-24T21:01:58.795 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-08-24T21:01:58.795 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dc395x.ko 2024-08-24T21:01:58.795 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler 2024-08-24T21:01:58.795 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-08-24T21:01:58.795 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-08-24T21:01:58.795 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-08-24T21:01:58.795 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-08-24T21:01:58.795 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dmx3191d.ko 2024-08-24T21:01:58.795 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r 2024-08-24T21:01:58.795 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r/esas2r.ko 2024-08-24T21:01:58.796 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esp_scsi.ko 2024-08-24T21:01:58.796 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe 2024-08-24T21:01:58.796 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/fcoe.ko 2024-08-24T21:01:58.796 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-08-24T21:01:58.796 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic 2024-08-24T21:01:58.796 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic/fnic.ko 2024-08-24T21:01:58.796 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hpsa.ko 2024-08-24T21:01:58.796 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hptiop.ko 2024-08-24T21:01:58.796 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hv_storvsc.ko 2024-08-24T21:01:58.796 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/initio.ko 2024-08-24T21:01:58.796 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ipr.ko 2024-08-24T21:01:58.796 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ips.ko 2024-08-24T21:01:58.797 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci 2024-08-24T21:01:58.797 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci/isci.ko 2024-08-24T21:01:58.797 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-08-24T21:01:58.797 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_tcp.ko 2024-08-24T21:01:58.797 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc 2024-08-24T21:01:58.797 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc/libfc.ko 2024-08-24T21:01:58.797 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi.ko 2024-08-24T21:01:58.797 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi_tcp.ko 2024-08-24T21:01:58.798 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas 2024-08-24T21:01:58.798 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas/libsas.ko 2024-08-24T21:01:58.798 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc 2024-08-24T21:01:58.798 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc/lpfc.ko 2024-08-24T21:01:58.798 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid 2024-08-24T21:01:58.798 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid.ko 2024-08-24T21:01:58.798 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-08-24T21:01:58.798 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-08-24T21:01:58.798 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-08-24T21:01:58.798 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas 2024-08-24T21:01:58.798 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-08-24T21:01:58.798 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas 2024-08-24T21:01:58.798 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas/mvsas.ko 2024-08-24T21:01:58.799 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvumi.ko 2024-08-24T21:01:58.799 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001 2024-08-24T21:01:58.799 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-08-24T21:01:58.799 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pmcraid.ko 2024-08-24T21:01:58.799 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla1280.ko 2024-08-24T21:01:58.799 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx 2024-08-24T21:01:58.799 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-08-24T21:01:58.800 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-08-24T21:01:58.800 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx 2024-08-24T21:01:58.800 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-08-24T21:01:58.800 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/raid_class.ko 2024-08-24T21:01:58.800 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_debug.ko 2024-08-24T21:01:58.800 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_fc.ko 2024-08-24T21:01:58.800 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-08-24T21:01:58.800 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_sas.ko 2024-08-24T21:01:58.800 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_spi.ko 2024-08-24T21:01:58.800 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_srp.ko 2024-08-24T21:01:58.800 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ses.ko 2024-08-24T21:01:58.800 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/st.ko 2024-08-24T21:01:58.800 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/stex.ko 2024-08-24T21:01:58.800 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2 2024-08-24T21:01:58.801 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-08-24T21:01:58.801 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/virtio_scsi.ko 2024-08-24T21:01:58.801 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/vmw_pvscsi.ko 2024-08-24T21:01:58.801 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/wd719x.ko 2024-08-24T21:01:58.801 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb 2024-08-24T21:01:58.801 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb/ssb.ko 2024-08-24T21:01:58.801 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target 2024-08-24T21:01:58.801 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi 2024-08-24T21:01:58.801 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-08-24T21:01:58.801 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback 2024-08-24T21:01:58.801 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback/tcm_loop.ko 2024-08-24T21:01:58.801 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_file.ko 2024-08-24T21:01:58.801 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_iblock.ko 2024-08-24T21:01:58.802 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_mod.ko 2024-08-24T21:01:58.802 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_pscsi.ko 2024-08-24T21:01:58.802 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_user.ko 2024-08-24T21:01:58.802 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc 2024-08-24T21:01:58.802 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-08-24T21:01:58.802 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal 2024-08-24T21:01:58.802 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel 2024-08-24T21:01:58.802 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal 2024-08-24T21:01:58.802 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-08-24T21:01:58.802 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-08-24T21:01:58.802 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-08-24T21:01:58.802 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-08-24T21:01:58.803 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-08-24T21:01:58.803 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-08-24T21:01:58.803 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-08-24T21:01:58.803 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-08-24T21:01:58.803 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-08-24T21:01:58.803 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-08-24T21:01:58.803 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-08-24T21:01:58.803 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-08-24T21:01:58.803 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-08-24T21:01:58.803 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-08-24T21:01:58.803 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-08-24T21:01:58.803 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-08-24T21:01:58.803 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-08-24T21:01:58.804 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-08-24T21:01:58.804 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty 2024-08-24T21:01:58.804 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless 2024-08-24T21:01:58.804 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-08-24T21:01:58.804 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_gsm.ko 2024-08-24T21:01:58.804 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_hdlc.ko 2024-08-24T21:01:58.804 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/nozomi.ko 2024-08-24T21:01:58.804 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial 2024-08-24T21:01:58.804 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250 2024-08-24T21:01:58.804 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-08-24T21:01:58.804 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/arc_uart.ko 2024-08-24T21:01:58.804 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm 2024-08-24T21:01:58.804 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm/jsm.ko 2024-08-24T21:01:58.804 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs 2024-08-24T21:01:58.805 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core 2024-08-24T21:01:58.805 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core/ufshcd-core.ko 2024-08-24T21:01:58.805 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host 2024-08-24T21:01:58.805 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-08-24T21:01:58.805 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio 2024-08-24T21:01:58.805 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio.ko 2024-08-24T21:01:58.805 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_aec.ko 2024-08-24T21:01:58.805 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_cif.ko 2024-08-24T21:01:58.805 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_pci_generic.ko 2024-08-24T21:01:58.805 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_sercos3.ko 2024-08-24T21:01:58.805 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb 2024-08-24T21:01:58.805 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class 2024-08-24T21:01:58.805 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-acm.ko 2024-08-24T21:01:58.806 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-wdm.ko 2024-08-24T21:01:58.806 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usblp.ko 2024-08-24T21:01:58.806 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usbtmc.ko 2024-08-24T21:01:58.806 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host 2024-08-24T21:01:58.806 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host/sl811-hcd.ko 2024-08-24T21:01:58.806 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image 2024-08-24T21:01:58.806 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/mdc800.ko 2024-08-24T21:01:58.806 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/microtek.ko 2024-08-24T21:01:58.806 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc 2024-08-24T21:01:58.806 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/adutux.ko 2024-08-24T21:01:58.806 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/appledisplay.ko 2024-08-24T21:01:58.806 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi26.ko 2024-08-24T21:01:58.806 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi62.ko 2024-08-24T21:01:58.807 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ezusb.ko 2024-08-24T21:01:58.807 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/idmouse.ko 2024-08-24T21:01:58.807 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/iowarrior.ko 2024-08-24T21:01:58.807 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/isight_firmware.ko 2024-08-24T21:01:58.807 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ldusb.ko 2024-08-24T21:01:58.807 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/legousbtower.ko 2024-08-24T21:01:58.807 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga 2024-08-24T21:01:58.807 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-08-24T21:01:58.807 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/trancevibrator.ko 2024-08-24T21:01:58.807 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usb3503.ko 2024-08-24T21:01:58.807 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usblcd.ko 2024-08-24T21:01:58.807 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usbsevseg.ko 2024-08-24T21:01:58.807 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/uss720.ko 2024-08-24T21:01:58.808 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/yurex.ko 2024-08-24T21:01:58.808 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy 2024-08-24T21:01:58.808 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy/phy-generic.ko 2024-08-24T21:01:58.808 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial 2024-08-24T21:01:58.808 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/aircable.ko 2024-08-24T21:01:58.808 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ark3116.ko 2024-08-24T21:01:58.808 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/belkin_sa.ko 2024-08-24T21:01:58.808 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ch341.ko 2024-08-24T21:01:58.808 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cp210x.ko 2024-08-24T21:01:58.808 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cyberjack.ko 2024-08-24T21:01:58.808 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cypress_m8.ko 2024-08-24T21:01:58.808 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/digi_acceleport.ko 2024-08-24T21:01:58.808 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/empeg.ko 2024-08-24T21:01:58.808 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ftdi_sio.ko 2024-08-24T21:01:58.809 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/garmin_gps.ko 2024-08-24T21:01:58.809 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_edgeport.ko 2024-08-24T21:01:58.809 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_ti.ko 2024-08-24T21:01:58.809 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipaq.ko 2024-08-24T21:01:58.809 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipw.ko 2024-08-24T21:01:58.809 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ir-usb.ko 2024-08-24T21:01:58.809 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-08-24T21:01:58.809 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan.ko 2024-08-24T21:01:58.809 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan_pda.ko 2024-08-24T21:01:58.809 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kl5kusb105.ko 2024-08-24T21:01:58.809 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kobil_sct.ko 2024-08-24T21:01:58.809 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mct_u232.ko 2024-08-24T21:01:58.809 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7720.ko 2024-08-24T21:01:58.809 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7840.ko 2024-08-24T21:01:58.810 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/navman.ko 2024-08-24T21:01:58.810 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/omninet.ko 2024-08-24T21:01:58.810 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/opticon.ko 2024-08-24T21:01:58.810 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/option.ko 2024-08-24T21:01:58.810 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/oti6858.ko 2024-08-24T21:01:58.810 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/pl2303.ko 2024-08-24T21:01:58.810 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcaux.ko 2024-08-24T21:01:58.810 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcserial.ko 2024-08-24T21:01:58.810 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/quatech2.ko 2024-08-24T21:01:58.810 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/safe_serial.ko 2024-08-24T21:01:58.810 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/sierra.ko 2024-08-24T21:01:58.810 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/spcp8x5.ko 2024-08-24T21:01:58.811 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ssu100.ko 2024-08-24T21:01:58.811 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/symbolserial.ko 2024-08-24T21:01:58.811 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-08-24T21:01:58.811 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-08-24T21:01:58.811 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_debug.ko 2024-08-24T21:01:58.811 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_wwan.ko 2024-08-24T21:01:58.811 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/visor.ko 2024-08-24T21:01:58.811 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/whiteheat.ko 2024-08-24T21:01:58.811 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/xsens_mt.ko 2024-08-24T21:01:58.811 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage 2024-08-24T21:01:58.811 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/uas.ko 2024-08-24T21:01:58.811 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-alauda.ko 2024-08-24T21:01:58.811 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-cypress.ko 2024-08-24T21:01:58.811 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-datafab.ko 2024-08-24T21:01:58.812 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-08-24T21:01:58.812 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-freecom.ko 2024-08-24T21:01:58.812 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-isd200.ko 2024-08-24T21:01:58.812 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-08-24T21:01:58.812 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-karma.ko 2024-08-24T21:01:58.812 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-onetouch.ko 2024-08-24T21:01:58.812 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-realtek.ko 2024-08-24T21:01:58.812 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr09.ko 2024-08-24T21:01:58.812 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr55.ko 2024-08-24T21:01:58.812 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-usbat.ko 2024-08-24T21:01:58.812 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/usb-storage.ko 2024-08-24T21:01:58.812 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip 2024-08-24T21:01:58.812 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-core.ko 2024-08-24T21:01:58.813 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-host.ko 2024-08-24T21:01:58.813 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-08-24T21:01:58.813 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio 2024-08-24T21:01:58.813 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci 2024-08-24T21:01:58.813 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-08-24T21:01:58.813 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci.ko 2024-08-24T21:01:58.813 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio.ko 2024-08-24T21:01:58.813 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-08-24T21:01:58.813 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost 2024-08-24T21:01:58.813 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost.ko 2024-08-24T21:01:58.813 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_iotlb.ko 2024-08-24T21:01:58.813 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_net.ko 2024-08-24T21:01:58.813 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_scsi.ko 2024-08-24T21:01:58.813 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video 2024-08-24T21:01:58.814 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight 2024-08-24T21:01:58.814 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/apple_bl.ko 2024-08-24T21:01:58.814 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/lcd.ko 2024-08-24T21:01:58.814 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/platform_lcd.ko 2024-08-24T21:01:58.814 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio 2024-08-24T21:01:58.814 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio.ko 2024-08-24T21:01:58.814 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_balloon.ko 2024-08-24T21:01:58.814 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_mmio.ko 2024-08-24T21:01:58.814 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci.ko 2024-08-24T21:01:58.814 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-08-24T21:01:58.814 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-08-24T21:01:58.814 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_ring.ko 2024-08-24T21:01:58.814 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1 2024-08-24T21:01:58.815 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters 2024-08-24T21:01:58.815 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2482.ko 2024-08-24T21:01:58.815 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2490.ko 2024-08-24T21:01:58.815 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves 2024-08-24T21:01:58.815 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-08-24T21:01:58.815 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-08-24T21:01:58.815 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-08-24T21:01:58.815 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-08-24T21:01:58.815 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-08-24T21:01:58.815 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-08-24T21:01:58.815 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-08-24T21:01:58.815 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-08-24T21:01:58.816 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-08-24T21:01:58.816 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_smem.ko 2024-08-24T21:01:58.816 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_therm.ko 2024-08-24T21:01:58.816 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/wire.ko 2024-08-24T21:01:58.816 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog 2024-08-24T21:01:58.816 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim1535_wdt.ko 2024-08-24T21:01:58.816 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim7101_wdt.ko 2024-08-24T21:01:58.816 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/f71808e_wdt.ko 2024-08-24T21:01:58.816 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/hpwdt.ko 2024-08-24T21:01:58.816 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/i6300esb.ko 2024-08-24T21:01:58.816 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-08-24T21:01:58.816 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_wdt.ko 2024-08-24T21:01:58.817 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ib700wdt.ko 2024-08-24T21:01:58.817 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ibmasr.ko 2024-08-24T21:01:58.817 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-08-24T21:01:58.817 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it8712f_wdt.ko 2024-08-24T21:01:58.817 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it87_wdt.ko 2024-08-24T21:01:58.817 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/machzwd.ko 2024-08-24T21:01:58.817 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/nv_tco.ko 2024-08-24T21:01:58.817 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_pci.ko 2024-08-24T21:01:58.817 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_usb.ko 2024-08-24T21:01:58.817 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-08-24T21:01:58.817 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sch311x_wdt.ko 2024-08-24T21:01:58.817 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/softdog.ko 2024-08-24T21:01:58.817 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sp5100_tco.ko 2024-08-24T21:01:58.817 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/via_wdt.ko 2024-08-24T21:01:58.818 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-08-24T21:01:58.818 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83877f_wdt.ko 2024-08-24T21:01:58.818 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83977f_wdt.ko 2024-08-24T21:01:58.818 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/wdt_pci.ko 2024-08-24T21:01:58.818 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/xen_wdt.ko 2024-08-24T21:01:58.818 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen 2024-08-24T21:01:58.818 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-acpi-processor.ko 2024-08-24T21:01:58.818 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-evtchn.ko 2024-08-24T21:01:58.818 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntalloc.ko 2024-08-24T21:01:58.818 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntdev.ko 2024-08-24T21:01:58.818 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback 2024-08-24T21:01:58.818 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-08-24T21:01:58.818 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-privcmd.ko 2024-08-24T21:01:58.819 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs 2024-08-24T21:01:58.819 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs/xenfs.ko 2024-08-24T21:01:58.819 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs 2024-08-24T21:01:58.819 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p 2024-08-24T21:01:58.819 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p/9p.ko 2024-08-24T21:01:58.819 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs 2024-08-24T21:01:58.819 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs/affs.ko 2024-08-24T21:01:58.819 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs 2024-08-24T21:01:58.819 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs/befs.ko 2024-08-24T21:01:58.819 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/binfmt_misc.ko 2024-08-24T21:01:58.819 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs 2024-08-24T21:01:58.819 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs/btrfs.ko 2024-08-24T21:01:58.819 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles 2024-08-24T21:01:58.820 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles/cachefiles.ko 2024-08-24T21:01:58.820 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph 2024-08-24T21:01:58.820 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph/ceph.ko 2024-08-24T21:01:58.820 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda 2024-08-24T21:01:58.820 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda/coda.ko 2024-08-24T21:01:58.820 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs 2024-08-24T21:01:58.820 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs/cramfs.ko 2024-08-24T21:01:58.820 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm 2024-08-24T21:01:58.820 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm/dlm.ko 2024-08-24T21:01:58.820 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs 2024-08-24T21:01:58.820 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs/ecryptfs.ko 2024-08-24T21:01:58.820 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs 2024-08-24T21:01:58.820 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs/f2fs.ko 2024-08-24T21:01:58.821 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat 2024-08-24T21:01:58.821 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/fat.ko 2024-08-24T21:01:58.821 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/msdos.ko 2024-08-24T21:01:58.821 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/vfat.ko 2024-08-24T21:01:58.821 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse 2024-08-24T21:01:58.821 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/cuse.ko 2024-08-24T21:01:58.821 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/fuse.ko 2024-08-24T21:01:58.821 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2 2024-08-24T21:01:58.821 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2/gfs2.ko 2024-08-24T21:01:58.821 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs 2024-08-24T21:01:58.821 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs/hfs.ko 2024-08-24T21:01:58.821 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus 2024-08-24T21:01:58.821 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus/hfsplus.ko 2024-08-24T21:01:58.821 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs 2024-08-24T21:01:58.822 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs/isofs.ko 2024-08-24T21:01:58.822 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs 2024-08-24T21:01:58.822 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs/jfs.ko 2024-08-24T21:01:58.822 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd 2024-08-24T21:01:58.822 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd/lockd.ko 2024-08-24T21:01:58.822 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix 2024-08-24T21:01:58.822 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix/minix.ko 2024-08-24T21:01:58.822 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs 2024-08-24T21:01:58.822 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs/netfs.ko 2024-08-24T21:01:58.822 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs 2024-08-24T21:01:58.822 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout 2024-08-24T21:01:58.822 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-08-24T21:01:58.822 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout 2024-08-24T21:01:58.823 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-08-24T21:01:58.823 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout 2024-08-24T21:01:58.823 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-08-24T21:01:58.823 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfs.ko 2024-08-24T21:01:58.823 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv3.ko 2024-08-24T21:01:58.823 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv4.ko 2024-08-24T21:01:58.823 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common 2024-08-24T21:01:58.823 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/grace.ko 2024-08-24T21:01:58.823 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/nfs_acl.ko 2024-08-24T21:01:58.823 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd 2024-08-24T21:01:58.823 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd/nfsd.ko 2024-08-24T21:01:58.823 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2 2024-08-24T21:01:58.823 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2/nilfs2.ko 2024-08-24T21:01:58.824 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls 2024-08-24T21:01:58.824 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-celtic.ko 2024-08-24T21:01:58.824 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-centeuro.ko 2024-08-24T21:01:58.824 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-croatian.ko 2024-08-24T21:01:58.824 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-cyrillic.ko 2024-08-24T21:01:58.824 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-gaelic.ko 2024-08-24T21:01:58.824 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-greek.ko 2024-08-24T21:01:58.824 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-iceland.ko 2024-08-24T21:01:58.824 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-inuit.ko 2024-08-24T21:01:58.824 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-roman.ko 2024-08-24T21:01:58.824 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-romanian.ko 2024-08-24T21:01:58.824 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-turkish.ko 2024-08-24T21:01:58.824 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1250.ko 2024-08-24T21:01:58.824 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1251.ko 2024-08-24T21:01:58.825 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1255.ko 2024-08-24T21:01:58.825 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp737.ko 2024-08-24T21:01:58.825 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp775.ko 2024-08-24T21:01:58.825 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp850.ko 2024-08-24T21:01:58.825 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp852.ko 2024-08-24T21:01:58.825 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp855.ko 2024-08-24T21:01:58.825 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp857.ko 2024-08-24T21:01:58.825 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp860.ko 2024-08-24T21:01:58.825 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp861.ko 2024-08-24T21:01:58.825 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp862.ko 2024-08-24T21:01:58.825 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp863.ko 2024-08-24T21:01:58.825 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp864.ko 2024-08-24T21:01:58.825 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp865.ko 2024-08-24T21:01:58.825 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp866.ko 2024-08-24T21:01:58.826 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp869.ko 2024-08-24T21:01:58.826 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp874.ko 2024-08-24T21:01:58.826 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp932.ko 2024-08-24T21:01:58.826 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp936.ko 2024-08-24T21:01:58.826 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp949.ko 2024-08-24T21:01:58.826 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp950.ko 2024-08-24T21:01:58.826 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_euc-jp.ko 2024-08-24T21:01:58.826 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-1.ko 2024-08-24T21:01:58.826 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-13.ko 2024-08-24T21:01:58.826 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-14.ko 2024-08-24T21:01:58.826 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-15.ko 2024-08-24T21:01:58.826 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-2.ko 2024-08-24T21:01:58.826 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-3.ko 2024-08-24T21:01:58.827 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-4.ko 2024-08-24T21:01:58.827 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-5.ko 2024-08-24T21:01:58.827 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-6.ko 2024-08-24T21:01:58.827 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-7.ko 2024-08-24T21:01:58.827 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-9.ko 2024-08-24T21:01:58.827 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-r.ko 2024-08-24T21:01:58.827 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-ru.ko 2024-08-24T21:01:58.827 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-u.ko 2024-08-24T21:01:58.827 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_ucs2_utils.ko 2024-08-24T21:01:58.827 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_utf8.ko 2024-08-24T21:01:58.827 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2 2024-08-24T21:01:58.827 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster 2024-08-24T21:01:58.827 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-08-24T21:01:58.828 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm 2024-08-24T21:01:58.828 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-08-24T21:01:58.828 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs 2024-08-24T21:01:58.828 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-08-24T21:01:58.828 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2.ko 2024-08-24T21:01:58.828 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-08-24T21:01:58.828 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-08-24T21:01:58.828 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-08-24T21:01:58.828 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs 2024-08-24T21:01:58.828 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs/overlay.ko 2024-08-24T21:01:58.828 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore 2024-08-24T21:01:58.828 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore/ramoops.ko 2024-08-24T21:01:58.828 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs 2024-08-24T21:01:58.829 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs/reiserfs.ko 2024-08-24T21:01:58.829 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs 2024-08-24T21:01:58.829 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs/romfs.ko 2024-08-24T21:01:58.829 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb 2024-08-24T21:01:58.829 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client 2024-08-24T21:01:58.829 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client/cifs.ko 2024-08-24T21:01:58.829 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common 2024-08-24T21:01:58.829 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_arc4.ko 2024-08-24T21:01:58.829 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_md4.ko 2024-08-24T21:01:58.829 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs 2024-08-24T21:01:58.829 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs/squashfs.ko 2024-08-24T21:01:58.829 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv 2024-08-24T21:01:58.829 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv/sysv.ko 2024-08-24T21:01:58.829 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf 2024-08-24T21:01:58.830 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf/udf.ko 2024-08-24T21:01:58.830 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs 2024-08-24T21:01:58.830 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs/ufs.ko 2024-08-24T21:01:58.830 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs 2024-08-24T21:01:58.830 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs/xfs.ko 2024-08-24T21:01:58.830 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel 2024-08-24T21:01:58.830 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu 2024-08-24T21:01:58.830 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu/rcutorture.ko 2024-08-24T21:01:58.830 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/torture.ko 2024-08-24T21:01:58.830 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace 2024-08-24T21:01:58.830 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-08-24T21:01:58.830 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib 2024-08-24T21:01:58.830 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/asn1_encoder.ko 2024-08-24T21:01:58.831 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc-itu-t.ko 2024-08-24T21:01:58.831 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc8.ko 2024-08-24T21:01:58.831 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto 2024-08-24T21:01:58.831 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libaescfb.ko 2024-08-24T21:01:58.831 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libarc4.ko 2024-08-24T21:01:58.831 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libdes.ko 2024-08-24T21:01:58.831 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/libcrc32c.ko 2024-08-24T21:01:58.831 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lru_cache.ko 2024-08-24T21:01:58.831 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4 2024-08-24T21:01:58.831 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4_compress.ko 2024-08-24T21:01:58.831 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4hc_compress.ko 2024-08-24T21:01:58.831 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math 2024-08-24T21:01:58.831 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math/cordic.ko 2024-08-24T21:01:58.832 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6 2024-08-24T21:01:58.832 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6/raid6_pq.ko 2024-08-24T21:01:58.832 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon 2024-08-24T21:01:58.832 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon/reed_solomon.ko 2024-08-24T21:01:58.832 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_bm.ko 2024-08-24T21:01:58.832 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_fsm.ko 2024-08-24T21:01:58.832 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_kmp.ko 2024-08-24T21:01:58.832 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd 2024-08-24T21:01:58.832 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd/zstd_compress.ko 2024-08-24T21:01:58.832 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm 2024-08-24T21:01:58.832 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm/hwpoison-inject.ko 2024-08-24T21:01:58.832 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net 2024-08-24T21:01:58.832 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan 2024-08-24T21:01:58.833 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/6lowpan.ko 2024-08-24T21:01:58.833 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_dest.ko 2024-08-24T21:01:58.833 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_fragment.ko 2024-08-24T21:01:58.833 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_hop.ko 2024-08-24T21:01:58.833 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_ipv6.ko 2024-08-24T21:01:58.833 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_mobility.ko 2024-08-24T21:01:58.833 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_routing.ko 2024-08-24T21:01:58.833 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_udp.ko 2024-08-24T21:01:58.833 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802 2024-08-24T21:01:58.833 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/garp.ko 2024-08-24T21:01:58.833 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/mrp.ko 2024-08-24T21:01:58.833 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/p8022.ko 2024-08-24T21:01:58.833 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/psnap.ko 2024-08-24T21:01:58.833 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/stp.ko 2024-08-24T21:01:58.834 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q 2024-08-24T21:01:58.834 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q/8021q.ko 2024-08-24T21:01:58.834 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p 2024-08-24T21:01:58.834 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet.ko 2024-08-24T21:01:58.834 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_fd.ko 2024-08-24T21:01:58.834 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_rdma.ko 2024-08-24T21:01:58.834 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_virtio.ko 2024-08-24T21:01:58.834 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv 2024-08-24T21:01:58.834 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv/batman-adv.ko 2024-08-24T21:01:58.834 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge 2024-08-24T21:01:58.834 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/br_netfilter.ko 2024-08-24T21:01:58.834 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/bridge.ko 2024-08-24T21:01:58.834 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter 2024-08-24T21:01:58.835 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-08-24T21:01:58.835 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_among.ko 2024-08-24T21:01:58.835 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arp.ko 2024-08-24T21:01:58.835 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-08-24T21:01:58.835 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-08-24T21:01:58.835 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip.ko 2024-08-24T21:01:58.835 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-08-24T21:01:58.835 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_limit.ko 2024-08-24T21:01:58.835 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_log.ko 2024-08-24T21:01:58.835 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark.ko 2024-08-24T21:01:58.835 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-08-24T21:01:58.835 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-08-24T21:01:58.835 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-08-24T21:01:58.835 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-08-24T21:01:58.836 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_snat.ko 2024-08-24T21:01:58.836 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_stp.ko 2024-08-24T21:01:58.836 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-08-24T21:01:58.836 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-08-24T21:01:58.836 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-08-24T21:01:58.836 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-08-24T21:01:58.836 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtables.ko 2024-08-24T21:01:58.836 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-08-24T21:01:58.836 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-08-24T21:01:58.836 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-08-24T21:01:58.836 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph 2024-08-24T21:01:58.836 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph/libceph.ko 2024-08-24T21:01:58.836 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core 2024-08-24T21:01:58.836 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/failover.ko 2024-08-24T21:01:58.837 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/pktgen.ko 2024-08-24T21:01:58.837 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp 2024-08-24T21:01:58.837 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp.ko 2024-08-24T21:01:58.837 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_diag.ko 2024-08-24T21:01:58.837 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv4.ko 2024-08-24T21:01:58.837 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv6.ko 2024-08-24T21:01:58.837 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver 2024-08-24T21:01:58.837 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver/dns_resolver.ko 2024-08-24T21:01:58.837 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa 2024-08-24T21:01:58.837 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/dsa_core.ko 2024-08-24T21:01:58.837 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_brcm.ko 2024-08-24T21:01:58.837 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_dsa.ko 2024-08-24T21:01:58.837 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_none.ko 2024-08-24T21:01:58.837 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_trailer.ko 2024-08-24T21:01:58.838 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154 2024-08-24T21:01:58.838 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan 2024-08-24T21:01:58.838 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-08-24T21:01:58.838 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154.ko 2024-08-24T21:01:58.838 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154_socket.ko 2024-08-24T21:01:58.838 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4 2024-08-24T21:01:58.838 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ah4.ko 2024-08-24T21:01:58.838 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/esp4.ko 2024-08-24T21:01:58.839 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/fou.ko 2024-08-24T21:01:58.839 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/gre.ko 2024-08-24T21:01:58.839 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/inet_diag.ko 2024-08-24T21:01:58.839 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_gre.ko 2024-08-24T21:01:58.839 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_tunnel.ko 2024-08-24T21:01:58.839 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_vti.ko 2024-08-24T21:01:58.839 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipcomp.ko 2024-08-24T21:01:58.839 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipip.ko 2024-08-24T21:01:58.839 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter 2024-08-24T21:01:58.839 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arp_tables.ko 2024-08-24T21:01:58.839 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-08-24T21:01:58.839 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-08-24T21:01:58.839 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-08-24T21:01:58.840 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-08-24T21:01:58.840 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-08-24T21:01:58.840 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-08-24T21:01:58.840 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-08-24T21:01:58.840 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-08-24T21:01:58.840 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-08-24T21:01:58.840 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_security.ko 2024-08-24T21:01:58.840 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-08-24T21:01:58.840 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-08-24T21:01:58.840 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-08-24T21:01:58.840 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-08-24T21:01:58.840 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-08-24T21:01:58.840 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-08-24T21:01:58.840 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-08-24T21:01:58.841 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-08-24T21:01:58.841 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-08-24T21:01:58.841 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-08-24T21:01:58.841 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_bic.ko 2024-08-24T21:01:58.841 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_dctcp.ko 2024-08-24T21:01:58.841 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_diag.ko 2024-08-24T21:01:58.841 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_highspeed.ko 2024-08-24T21:01:58.841 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_htcp.ko 2024-08-24T21:01:58.841 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_hybla.ko 2024-08-24T21:01:58.841 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_illinois.ko 2024-08-24T21:01:58.841 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_lp.ko 2024-08-24T21:01:58.841 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_scalable.ko 2024-08-24T21:01:58.841 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_vegas.ko 2024-08-24T21:01:58.842 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_veno.ko 2024-08-24T21:01:58.842 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_westwood.ko 2024-08-24T21:01:58.842 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_yeah.ko 2024-08-24T21:01:58.842 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tunnel4.ko 2024-08-24T21:01:58.842 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_diag.ko 2024-08-24T21:01:58.842 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_tunnel.ko 2024-08-24T21:01:58.842 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/xfrm4_tunnel.ko 2024-08-24T21:01:58.842 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6 2024-08-24T21:01:58.842 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ah6.ko 2024-08-24T21:01:58.842 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/esp6.ko 2024-08-24T21:01:58.842 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/fou6.ko 2024-08-24T21:01:58.842 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_tunnel.ko 2024-08-24T21:01:58.842 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-08-24T21:01:58.843 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_vti.ko 2024-08-24T21:01:58.843 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ipcomp6.ko 2024-08-24T21:01:58.843 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter 2024-08-24T21:01:58.843 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-08-24T21:01:58.843 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-08-24T21:01:58.843 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-08-24T21:01:58.843 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-08-24T21:01:58.843 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-08-24T21:01:58.843 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-08-24T21:01:58.843 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-08-24T21:01:58.843 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-08-24T21:01:58.843 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-08-24T21:01:58.843 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-08-24T21:01:58.843 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-08-24T21:01:58.844 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-08-24T21:01:58.844 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-08-24T21:01:58.844 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-08-24T21:01:58.844 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-08-24T21:01:58.844 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-08-24T21:01:58.844 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-08-24T21:01:58.844 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-08-24T21:01:58.844 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-08-24T21:01:58.844 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-08-24T21:01:58.844 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-08-24T21:01:58.844 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-08-24T21:01:58.844 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-08-24T21:01:58.844 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-08-24T21:01:58.844 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/sit.ko 2024-08-24T21:01:58.845 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/tunnel6.ko 2024-08-24T21:01:58.845 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/xfrm6_tunnel.ko 2024-08-24T21:01:58.845 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key 2024-08-24T21:01:58.845 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key/af_key.ko 2024-08-24T21:01:58.845 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp 2024-08-24T21:01:58.845 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_core.ko 2024-08-24T21:01:58.845 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_debugfs.ko 2024-08-24T21:01:58.845 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_eth.ko 2024-08-24T21:01:58.845 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip.ko 2024-08-24T21:01:58.845 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip6.ko 2024-08-24T21:01:58.845 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_netlink.ko 2024-08-24T21:01:58.845 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ppp.ko 2024-08-24T21:01:58.845 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc 2024-08-24T21:01:58.846 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc/llc.ko 2024-08-24T21:01:58.846 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154 2024-08-24T21:01:58.846 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154/mac802154.ko 2024-08-24T21:01:58.846 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls 2024-08-24T21:01:58.846 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls/mpls_gso.ko 2024-08-24T21:01:58.846 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter 2024-08-24T21:01:58.846 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset 2024-08-24T21:01:58.846 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set.ko 2024-08-24T21:01:58.846 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-08-24T21:01:58.846 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-08-24T21:01:58.846 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-08-24T21:01:58.846 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-08-24T21:01:58.846 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-08-24T21:01:58.847 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-08-24T21:01:58.847 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-08-24T21:01:58.847 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-08-24T21:01:58.847 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-08-24T21:01:58.847 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-08-24T21:01:58.847 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-08-24T21:01:58.847 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-08-24T21:01:58.847 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-08-24T21:01:58.847 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-08-24T21:01:58.847 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-08-24T21:01:58.847 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs 2024-08-24T21:01:58.847 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs.ko 2024-08-24T21:01:58.847 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-08-24T21:01:58.847 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-08-24T21:01:58.848 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-08-24T21:01:58.848 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-08-24T21:01:58.848 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-08-24T21:01:58.848 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-08-24T21:01:58.848 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-08-24T21:01:58.848 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-08-24T21:01:58.848 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-08-24T21:01:58.848 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-08-24T21:01:58.848 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-08-24T21:01:58.848 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-08-24T21:01:58.848 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-08-24T21:01:58.848 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conncount.ko 2024-08-24T21:01:58.848 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack.ko 2024-08-24T21:01:58.849 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-08-24T21:01:58.849 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-08-24T21:01:58.849 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-08-24T21:01:58.849 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_h323.ko 2024-08-24T21:01:58.849 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_irc.ko 2024-08-24T21:01:58.849 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-08-24T21:01:58.849 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-08-24T21:01:58.849 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-08-24T21:01:58.849 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sane.ko 2024-08-24T21:01:58.849 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sip.ko 2024-08-24T21:01:58.849 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-08-24T21:01:58.849 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-08-24T21:01:58.850 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_dup_netdev.ko 2024-08-24T21:01:58.850 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table.ko 2024-08-24T21:01:58.850 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table_inet.ko 2024-08-24T21:01:58.850 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_log_syslog.ko 2024-08-24T21:01:58.850 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat.ko 2024-08-24T21:01:58.850 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_amanda.ko 2024-08-24T21:01:58.850 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_ftp.ko 2024-08-24T21:01:58.850 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_irc.ko 2024-08-24T21:01:58.850 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_sip.ko 2024-08-24T21:01:58.850 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_tftp.ko 2024-08-24T21:01:58.850 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_synproxy_core.ko 2024-08-24T21:01:58.850 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_tables.ko 2024-08-24T21:01:58.850 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink.ko 2024-08-24T21:01:58.851 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_acct.ko 2024-08-24T21:01:58.851 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_log.ko 2024-08-24T21:01:58.851 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_osf.ko 2024-08-24T21:01:58.851 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_queue.ko 2024-08-24T21:01:58.851 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_chain_nat.ko 2024-08-24T21:01:58.851 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_compat.ko 2024-08-24T21:01:58.851 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_ct.ko 2024-08-24T21:01:58.851 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_dup_netdev.ko 2024-08-24T21:01:58.851 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fib.ko 2024-08-24T21:01:58.851 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fwd_netdev.ko 2024-08-24T21:01:58.851 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_hash.ko 2024-08-24T21:01:58.851 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_limit.ko 2024-08-24T21:01:58.851 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_log.ko 2024-08-24T21:01:58.851 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_masq.ko 2024-08-24T21:01:58.852 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_nat.ko 2024-08-24T21:01:58.852 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_numgen.ko 2024-08-24T21:01:58.852 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_queue.ko 2024-08-24T21:01:58.852 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_quota.ko 2024-08-24T21:01:58.852 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_redir.ko 2024-08-24T21:01:58.852 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject.ko 2024-08-24T21:01:58.852 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject_inet.ko 2024-08-24T21:01:58.852 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_socket.ko 2024-08-24T21:01:58.852 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_tunnel.ko 2024-08-24T21:01:58.852 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_AUDIT.ko 2024-08-24T21:01:58.852 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CHECKSUM.ko 2024-08-24T21:01:58.852 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CLASSIFY.ko 2024-08-24T21:01:58.852 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-08-24T21:01:58.852 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CT.ko 2024-08-24T21:01:58.853 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_DSCP.ko 2024-08-24T21:01:58.853 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HL.ko 2024-08-24T21:01:58.853 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HMARK.ko 2024-08-24T21:01:58.853 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_IDLETIMER.ko 2024-08-24T21:01:58.853 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LED.ko 2024-08-24T21:01:58.853 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LOG.ko 2024-08-24T21:01:58.853 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_MASQUERADE.ko 2024-08-24T21:01:58.853 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NETMAP.ko 2024-08-24T21:01:58.853 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFLOG.ko 2024-08-24T21:01:58.853 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFQUEUE.ko 2024-08-24T21:01:58.853 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_RATEEST.ko 2024-08-24T21:01:58.853 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_REDIRECT.ko 2024-08-24T21:01:58.853 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_SECMARK.ko 2024-08-24T21:01:58.853 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPMSS.ko 2024-08-24T21:01:58.854 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-08-24T21:01:58.854 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TEE.ko 2024-08-24T21:01:58.854 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TPROXY.ko 2024-08-24T21:01:58.854 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TRACE.ko 2024-08-24T21:01:58.854 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_addrtype.ko 2024-08-24T21:01:58.854 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_bpf.ko 2024-08-24T21:01:58.854 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cgroup.ko 2024-08-24T21:01:58.854 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cluster.ko 2024-08-24T21:01:58.854 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_comment.ko 2024-08-24T21:01:58.854 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connbytes.ko 2024-08-24T21:01:58.854 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlabel.ko 2024-08-24T21:01:58.854 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlimit.ko 2024-08-24T21:01:58.854 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connmark.ko 2024-08-24T21:01:58.855 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_conntrack.ko 2024-08-24T21:01:58.855 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cpu.ko 2024-08-24T21:01:58.855 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dccp.ko 2024-08-24T21:01:58.855 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_devgroup.ko 2024-08-24T21:01:58.855 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dscp.ko 2024-08-24T21:01:58.855 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ecn.ko 2024-08-24T21:01:58.855 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_esp.ko 2024-08-24T21:01:58.855 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hashlimit.ko 2024-08-24T21:01:58.855 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_helper.ko 2024-08-24T21:01:58.855 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hl.ko 2024-08-24T21:01:58.855 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipcomp.ko 2024-08-24T21:01:58.855 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_iprange.ko 2024-08-24T21:01:58.855 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipvs.ko 2024-08-24T21:01:58.856 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_l2tp.ko 2024-08-24T21:01:58.856 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_length.ko 2024-08-24T21:01:58.856 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_limit.ko 2024-08-24T21:01:58.856 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mac.ko 2024-08-24T21:01:58.856 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mark.ko 2024-08-24T21:01:58.856 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_multiport.ko 2024-08-24T21:01:58.856 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nat.ko 2024-08-24T21:01:58.856 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nfacct.ko 2024-08-24T21:01:58.856 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_osf.ko 2024-08-24T21:01:58.856 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_owner.ko 2024-08-24T21:01:58.857 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_physdev.ko 2024-08-24T21:01:58.857 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_pkttype.ko 2024-08-24T21:01:58.857 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_policy.ko 2024-08-24T21:01:58.857 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_quota.ko 2024-08-24T21:01:58.857 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_rateest.ko 2024-08-24T21:01:58.857 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_realm.ko 2024-08-24T21:01:58.857 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_recent.ko 2024-08-24T21:01:58.857 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_sctp.ko 2024-08-24T21:01:58.857 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_set.ko 2024-08-24T21:01:58.857 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_socket.ko 2024-08-24T21:01:58.857 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_state.ko 2024-08-24T21:01:58.858 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_statistic.ko 2024-08-24T21:01:58.858 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_string.ko 2024-08-24T21:01:58.858 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_tcpmss.ko 2024-08-24T21:01:58.858 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_time.ko 2024-08-24T21:01:58.858 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_u32.ko 2024-08-24T21:01:58.858 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink 2024-08-24T21:01:58.858 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink/netlink_diag.ko 2024-08-24T21:01:58.858 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh 2024-08-24T21:01:58.858 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh/nsh.ko 2024-08-24T21:01:58.858 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch 2024-08-24T21:01:58.858 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/openvswitch.ko 2024-08-24T21:01:58.858 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-geneve.ko 2024-08-24T21:01:58.859 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-gre.ko 2024-08-24T21:01:58.859 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-vxlan.ko 2024-08-24T21:01:58.859 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet 2024-08-24T21:01:58.859 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet/af_packet_diag.ko 2024-08-24T21:01:58.859 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds 2024-08-24T21:01:58.859 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds.ko 2024-08-24T21:01:58.859 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_rdma.ko 2024-08-24T21:01:58.859 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_tcp.ko 2024-08-24T21:01:58.859 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched 2024-08-24T21:01:58.859 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_csum.ko 2024-08-24T21:01:58.859 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_gact.ko 2024-08-24T21:01:58.860 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_mirred.ko 2024-08-24T21:01:58.860 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_nat.ko 2024-08-24T21:01:58.860 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_pedit.ko 2024-08-24T21:01:58.860 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_police.ko 2024-08-24T21:01:58.860 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_simple.ko 2024-08-24T21:01:58.860 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_skbedit.ko 2024-08-24T21:01:58.860 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_vlan.ko 2024-08-24T21:01:58.860 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_basic.ko 2024-08-24T21:01:58.860 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_bpf.ko 2024-08-24T21:01:58.860 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_flow.ko 2024-08-24T21:01:58.860 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_fw.ko 2024-08-24T21:01:58.860 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_route.ko 2024-08-24T21:01:58.860 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_u32.ko 2024-08-24T21:01:58.861 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_cmp.ko 2024-08-24T21:01:58.861 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_ipset.ko 2024-08-24T21:01:58.861 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_meta.ko 2024-08-24T21:01:58.861 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_nbyte.ko 2024-08-24T21:01:58.861 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_text.ko 2024-08-24T21:01:58.861 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_u32.ko 2024-08-24T21:01:58.861 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_choke.ko 2024-08-24T21:01:58.861 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_codel.ko 2024-08-24T21:01:58.861 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_drr.ko 2024-08-24T21:01:58.861 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_fq.ko 2024-08-24T21:01:58.861 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_gred.ko 2024-08-24T21:01:58.861 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hfsc.ko 2024-08-24T21:01:58.862 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hhf.ko 2024-08-24T21:01:58.862 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_htb.ko 2024-08-24T21:01:58.862 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_ingress.ko 2024-08-24T21:01:58.862 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio.ko 2024-08-24T21:01:58.862 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio_lib.ko 2024-08-24T21:01:58.862 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_multiq.ko 2024-08-24T21:01:58.862 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_netem.ko 2024-08-24T21:01:58.862 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_pie.ko 2024-08-24T21:01:58.862 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_plug.ko 2024-08-24T21:01:58.862 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_prio.ko 2024-08-24T21:01:58.862 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_qfq.ko 2024-08-24T21:01:58.862 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_red.ko 2024-08-24T21:01:58.862 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfb.ko 2024-08-24T21:01:58.863 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfq.ko 2024-08-24T21:01:58.863 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_tbf.ko 2024-08-24T21:01:58.863 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_teql.ko 2024-08-24T21:01:58.863 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp 2024-08-24T21:01:58.863 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp.ko 2024-08-24T21:01:58.863 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp_diag.ko 2024-08-24T21:01:58.863 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc 2024-08-24T21:01:58.863 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss 2024-08-24T21:01:58.863 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-08-24T21:01:58.863 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-08-24T21:01:58.863 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/sunrpc.ko 2024-08-24T21:01:58.863 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma 2024-08-24T21:01:58.863 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-08-24T21:01:58.864 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc 2024-08-24T21:01:58.864 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc.ko 2024-08-24T21:01:58.864 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc_diag.ko 2024-08-24T21:01:58.864 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix 2024-08-24T21:01:58.864 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix/unix_diag.ko 2024-08-24T21:01:58.864 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock 2024-08-24T21:01:58.864 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-08-24T21:01:58.864 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-08-24T21:01:58.864 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock.ko 2024-08-24T21:01:58.864 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_diag.ko 2024-08-24T21:01:58.864 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_loopback.ko 2024-08-24T21:01:58.864 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm 2024-08-24T21:01:58.864 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm/xfrm_ipcomp.ko 2024-08-24T21:01:58.865 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security 2024-08-24T21:01:58.865 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys 2024-08-24T21:01:58.865 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys 2024-08-24T21:01:58.865 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-08-24T21:01:58.865 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys 2024-08-24T21:01:58.865 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys/trusted.ko 2024-08-24T21:01:58.865 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias 2024-08-24T21:01:58.865 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias.bin 2024-08-24T21:01:58.865 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin 2024-08-24T21:01:58.865 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.alias.bin 2024-08-24T21:01:58.865 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.bin 2024-08-24T21:01:58.865 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.modinfo 2024-08-24T21:01:58.865 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep 2024-08-24T21:01:58.866 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep.bin 2024-08-24T21:01:58.866 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.devname 2024-08-24T21:01:58.866 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.order 2024-08-24T21:01:58.866 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.softdep 2024-08-24T21:01:58.866 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols 2024-08-24T21:01:58.866 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols.bin 2024-08-24T21:01:58.866 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.weakdep 2024-08-24T21:01:58.866 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-24T21:01:58.870 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc3-g7503b862ff5b 2024-08-24T21:01:58.870 DEBUG:teuthology.orchestra.run.smithi179:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-08-24T21:01:58.894 INFO:teuthology.orchestra.run.smithi179.stdout:postinstall scriptlet (using /bin/sh): 2024-08-24T21:01:58.894 INFO:teuthology.orchestra.run.smithi179.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-24T21:01:58.894 INFO:teuthology.orchestra.run.smithi179.stdout: /usr/bin/kernel-install add 6.11.0-rc3-g7503b862ff5b /lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-24T21:01:58.895 INFO:teuthology.orchestra.run.smithi179.stdout:fi 2024-08-24T21:01:58.895 INFO:teuthology.orchestra.run.smithi179.stdout:for file in vmlinuz System.map config; do 2024-08-24T21:01:58.895 INFO:teuthology.orchestra.run.smithi179.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b"; then 2024-08-24T21:01:58.895 INFO:teuthology.orchestra.run.smithi179.stdout: cp "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b" 2024-08-24T21:01:58.895 INFO:teuthology.orchestra.run.smithi179.stdout: fi 2024-08-24T21:01:58.895 INFO:teuthology.orchestra.run.smithi179.stdout:done 2024-08-24T21:01:58.895 INFO:teuthology.orchestra.run.smithi179.stdout:if [ -d "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" ] && \ 2024-08-24T21:01:58.895 INFO:teuthology.orchestra.run.smithi179.stdout: ! diff -rq "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" >/dev/null 2>&1; then 2024-08-24T21:01:58.895 INFO:teuthology.orchestra.run.smithi179.stdout: rm -rf "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-24T21:01:58.895 INFO:teuthology.orchestra.run.smithi179.stdout: cp -r "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-24T21:01:58.895 INFO:teuthology.orchestra.run.smithi179.stdout:fi 2024-08-24T21:01:58.895 INFO:teuthology.orchestra.run.smithi179.stdout:if [ ! -e "/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep" ]; then 2024-08-24T21:01:58.895 INFO:teuthology.orchestra.run.smithi179.stdout: /usr/sbin/depmod 6.11.0-rc3-g7503b862ff5b 2024-08-24T21:01:58.896 INFO:teuthology.orchestra.run.smithi179.stdout:fi 2024-08-24T21:01:58.896 INFO:teuthology.orchestra.run.smithi179.stdout:preuninstall scriptlet (using /bin/sh): 2024-08-24T21:01:58.896 INFO:teuthology.orchestra.run.smithi179.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-24T21:01:58.896 INFO:teuthology.orchestra.run.smithi179.stdout:kernel-install remove 6.11.0-rc3-g7503b862ff5b 2024-08-24T21:01:58.896 INFO:teuthology.orchestra.run.smithi179.stdout:fi 2024-08-24T21:01:58.896 DEBUG:teuthology.orchestra.run.smithi179:> sudo rpm -qi grub2-tools 2024-08-24T21:01:58.977 INFO:teuthology.orchestra.run.smithi179.stdout:Name : grub2-tools 2024-08-24T21:01:58.978 INFO:teuthology.orchestra.run.smithi179.stdout:Epoch : 1 2024-08-24T21:01:58.978 INFO:teuthology.orchestra.run.smithi179.stdout:Version : 2.06 2024-08-24T21:01:58.978 INFO:teuthology.orchestra.run.smithi179.stdout:Release : 82.el9 2024-08-24T21:01:58.978 INFO:teuthology.orchestra.run.smithi179.stdout:Architecture: x86_64 2024-08-24T21:01:58.978 INFO:teuthology.orchestra.run.smithi179.stdout:Install Date: Wed 21 Aug 2024 09:12:29 PM UTC 2024-08-24T21:01:58.978 INFO:teuthology.orchestra.run.smithi179.stdout:Group : Unspecified 2024-08-24T21:01:58.978 INFO:teuthology.orchestra.run.smithi179.stdout:Size : 8274670 2024-08-24T21:01:58.978 INFO:teuthology.orchestra.run.smithi179.stdout:License : GPLv3+ 2024-08-24T21:01:58.978 INFO:teuthology.orchestra.run.smithi179.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-08-24T21:01:58.978 INFO:teuthology.orchestra.run.smithi179.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-08-24T21:01:58.979 INFO:teuthology.orchestra.run.smithi179.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-08-24T21:01:58.979 INFO:teuthology.orchestra.run.smithi179.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-08-24T21:01:58.979 INFO:teuthology.orchestra.run.smithi179.stdout:Packager : builder@centos.org 2024-08-24T21:01:58.979 INFO:teuthology.orchestra.run.smithi179.stdout:Vendor : CentOS 2024-08-24T21:01:58.979 INFO:teuthology.orchestra.run.smithi179.stdout:URL : http://www.gnu.org/software/grub/ 2024-08-24T21:01:58.979 INFO:teuthology.orchestra.run.smithi179.stdout:Summary : Support tools for GRUB. 2024-08-24T21:01:58.979 INFO:teuthology.orchestra.run.smithi179.stdout:Description : 2024-08-24T21:01:58.979 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-08-24T21:01:58.979 INFO:teuthology.orchestra.run.smithi179.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-08-24T21:01:58.979 INFO:teuthology.orchestra.run.smithi179.stdout:customizable bootloader with modular architecture. It supports a rich 2024-08-24T21:01:58.979 INFO:teuthology.orchestra.run.smithi179.stdout:variety of kernel formats, file systems, computer architectures and 2024-08-24T21:01:58.979 INFO:teuthology.orchestra.run.smithi179.stdout:hardware devices. 2024-08-24T21:01:58.979 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-08-24T21:01:58.980 INFO:teuthology.orchestra.run.smithi179.stdout:This subpackage provides tools for support of all platforms. 2024-08-24T21:01:58.981 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-08-24T21:01:58.981 INFO:teuthology.task.kernel:Updating grub on smithi179 to boot 6.11.0-rc3-g7503b862ff5b 2024-08-24T21:01:58.981 DEBUG:teuthology.orchestra.run.smithi179:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-08-24T21:01:59.555 INFO:teuthology.orchestra.run.smithi179.stderr:Generating grub configuration file ... 2024-08-24T21:02:00.844 INFO:teuthology.orchestra.run.smithi179.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-08-24T21:02:00.871 INFO:teuthology.orchestra.run.smithi179.stderr:done 2024-08-24T21:02:00.878 DEBUG:teuthology.orchestra.run.smithi179:> mktemp 2024-08-24T21:02:00.913 INFO:teuthology.orchestra.run.smithi179.stdout:/tmp/tmp.ALRghqkQks 2024-08-24T21:02:00.914 DEBUG:teuthology.orchestra.run.smithi179:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.ALRghqkQks 2024-08-24T21:02:00.981 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 0666 /tmp/tmp.ALRghqkQks 2024-08-24T21:02:01.112 DEBUG:teuthology.orchestra.remote:smithi179:/tmp/tmp.ALRghqkQks is 6KB 2024-08-24T21:02:01.161 DEBUG:teuthology.orchestra.run.smithi179:> rm -fr /tmp/tmp.ALRghqkQks 2024-08-24T21:02:01.176 DEBUG:teuthology.orchestra.run.smithi179:> sudo /bin/ls /boot/loader/entries || true 2024-08-24T21:02:01.239 INFO:teuthology.orchestra.run.smithi179.stdout:7acb1e34f9714b649e59f4e98f1746e5-0-rescue.conf 2024-08-24T21:02:01.240 INFO:teuthology.orchestra.run.smithi179.stdout:7acb1e34f9714b649e59f4e98f1746e5-5.14.0-239.el9.x86_64.conf 2024-08-24T21:02:01.240 INFO:teuthology.orchestra.run.smithi179.stdout:7acb1e34f9714b649e59f4e98f1746e5-5.14.0-496.el9.x86_64.conf 2024-08-24T21:02:01.240 INFO:teuthology.orchestra.run.smithi179.stdout:7acb1e34f9714b649e59f4e98f1746e5-6.11.0-rc3-g7503b862ff5b.conf 2024-08-24T21:02:01.241 DEBUG:teuthology.orchestra.run.smithi179:> sudo grub2-set-default 7acb1e34f9714b649e59f4e98f1746e5-6.11.0-rc3-g7503b862ff5b 2024-08-24T21:02:01.387 DEBUG:teuthology.orchestra.run.smithi179:> sudo shutdown -r now 2024-08-24T21:02:01.659 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.60 2024-08-24T21:02:05.547 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-08-24T21:02:05.547 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-24T21:02:08.603 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-08-24T21:02:10.662 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-08-24T21:02:10.662 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-24T21:02:20.611 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-08-24T21:02:20.612 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-24T21:02:29.051 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.60 2024-08-24T21:02:31.391 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-08-24T21:02:31.392 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-08-24T21:02:31.392 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-24T21:02:41.056 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-08-24T21:02:41.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-24T21:02:44.123 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.60 2024-08-24T21:02:46.794 ERROR:teuthology.orchestra.connection:Error authenticating with smithi179.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-08-24T21:02:50.906 ERROR:teuthology.orchestra.connection:Error authenticating with smithi179.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-08-24T21:02:52.415 DEBUG:teuthology.orchestra.run.smithi119:> true 2024-08-24T21:02:52.941 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-08-24T21:02:52.941 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.11.0-rc3-g7503b862ff5b"... 2024-08-24T21:02:52.941 DEBUG:teuthology.orchestra.run.smithi119:> uname -r 2024-08-24T21:02:52.976 INFO:teuthology.orchestra.run.smithi119.stdout:6.11.0-rc3-g7503b862ff5b 2024-08-24T21:02:52.976 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc3-g7503b862ff5b vs 6.11.0-rc3-g7503b862ff5b 2024-08-24T21:02:52.976 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-24T21:02:52.976 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-08-24T21:02:53.977 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-08-24T21:02:53.978 DEBUG:teuthology.orchestra.run.smithi119:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-08-24T21:02:54.100 INFO:teuthology.orchestra.run.smithi119.stdout:ttyS1 2024-08-24T21:02:54.125 DEBUG:teuthology.parallel:result is None 2024-08-24T21:02:57.980 ERROR:teuthology.orchestra.connection:Error authenticating with smithi179.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-08-24T21:02:59.124 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-08-24T21:02:59.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-24T21:02:59.547 DEBUG:teuthology.orchestra.run.smithi060:> true 2024-08-24T21:03:00.092 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-08-24T21:03:00.092 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.11.0-rc3-g7503b862ff5b"... 2024-08-24T21:03:00.092 DEBUG:teuthology.orchestra.run.smithi060:> uname -r 2024-08-24T21:03:00.126 INFO:teuthology.orchestra.run.smithi060.stdout:6.11.0-rc3-g7503b862ff5b 2024-08-24T21:03:00.126 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc3-g7503b862ff5b vs 6.11.0-rc3-g7503b862ff5b 2024-08-24T21:03:00.126 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-24T21:03:00.126 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-08-24T21:03:01.127 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-08-24T21:03:01.127 DEBUG:teuthology.orchestra.run.smithi060:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-08-24T21:03:01.267 INFO:teuthology.orchestra.run.smithi060.stdout:ttyS1 2024-08-24T21:03:01.298 DEBUG:teuthology.parallel:result is None 2024-08-24T21:03:23.438 ERROR:teuthology.orchestra.connection:Error authenticating with smithi179.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-08-24T21:03:36.548 ERROR:teuthology.orchestra.connection:Error authenticating with smithi179.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-08-24T21:03:52.605 ERROR:teuthology.orchestra.connection:Error authenticating with smithi179.front.sepia.ceph.com: BadHostKeyException('smithi179.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:ConA7hZ0KmfF2p9duOB7herUBjTcsx/5Bzp/+Zsk+XI), PKey(alg=ED25519, bits=256, fp=SHA256:W+6Y/LgnRby4510vqEHFE/6fAReT8MdM2qNnjG5ecjQ)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/connection.py", line 109, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/virtualenv/lib/python3.10/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi179.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMt35kufurQGUGaYOaFAVZsx0Pahs2/dKmDXBhGCmQGis4a8xthNk55ayTBSkn8JqT4XyWK0FdduhxOtB8tkxkI=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIDnVB65LQ2ZrorCmRDXT/imYcIqttYXGdAR7PyxJCGep' 2024-08-24T21:04:11.633 ERROR:teuthology.orchestra.connection:Error authenticating with smithi179.front.sepia.ceph.com: BadHostKeyException('smithi179.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:ConA7hZ0KmfF2p9duOB7herUBjTcsx/5Bzp/+Zsk+XI), PKey(alg=ED25519, bits=256, fp=SHA256:W+6Y/LgnRby4510vqEHFE/6fAReT8MdM2qNnjG5ecjQ)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/connection.py", line 109, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/virtualenv/lib/python3.10/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi179.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMt35kufurQGUGaYOaFAVZsx0Pahs2/dKmDXBhGCmQGis4a8xthNk55ayTBSkn8JqT4XyWK0FdduhxOtB8tkxkI=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIDnVB65LQ2ZrorCmRDXT/imYcIqttYXGdAR7PyxJCGep' 2024-08-24T21:04:33.660 ERROR:teuthology.orchestra.connection:Error authenticating with smithi179.front.sepia.ceph.com: BadHostKeyException('smithi179.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:ConA7hZ0KmfF2p9duOB7herUBjTcsx/5Bzp/+Zsk+XI), PKey(alg=ED25519, bits=256, fp=SHA256:W+6Y/LgnRby4510vqEHFE/6fAReT8MdM2qNnjG5ecjQ)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/connection.py", line 109, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/virtualenv/lib/python3.10/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi179.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMt35kufurQGUGaYOaFAVZsx0Pahs2/dKmDXBhGCmQGis4a8xthNk55ayTBSkn8JqT4XyWK0FdduhxOtB8tkxkI=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIDnVB65LQ2ZrorCmRDXT/imYcIqttYXGdAR7PyxJCGep' 2024-08-24T21:04:58.686 ERROR:teuthology.orchestra.connection:Error authenticating with smithi179.front.sepia.ceph.com: BadHostKeyException('smithi179.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:ConA7hZ0KmfF2p9duOB7herUBjTcsx/5Bzp/+Zsk+XI), PKey(alg=ED25519, bits=256, fp=SHA256:W+6Y/LgnRby4510vqEHFE/6fAReT8MdM2qNnjG5ecjQ)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/connection.py", line 109, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/virtualenv/lib/python3.10/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi179.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMt35kufurQGUGaYOaFAVZsx0Pahs2/dKmDXBhGCmQGis4a8xthNk55ayTBSkn8JqT4XyWK0FdduhxOtB8tkxkI=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIDnVB65LQ2ZrorCmRDXT/imYcIqttYXGdAR7PyxJCGep' 2024-08-24T21:05:26.714 ERROR:teuthology.orchestra.connection:Error authenticating with smithi179.front.sepia.ceph.com: BadHostKeyException('smithi179.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:ConA7hZ0KmfF2p9duOB7herUBjTcsx/5Bzp/+Zsk+XI), PKey(alg=ED25519, bits=256, fp=SHA256:W+6Y/LgnRby4510vqEHFE/6fAReT8MdM2qNnjG5ecjQ)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/connection.py", line 109, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/virtualenv/lib/python3.10/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi179.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMt35kufurQGUGaYOaFAVZsx0Pahs2/dKmDXBhGCmQGis4a8xthNk55ayTBSkn8JqT4XyWK0FdduhxOtB8tkxkI=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIDnVB65LQ2ZrorCmRDXT/imYcIqttYXGdAR7PyxJCGep' 2024-08-24T21:05:26.715 DEBUG:teuthology.orchestra.remote:'connect to smithi179.front.sepia.ceph.com' reached maximum tries (10) after waiting for 145 seconds 2024-08-24T21:05:35.716 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-08-24T21:05:35.717 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-24T21:05:36.102 DEBUG:teuthology.orchestra.run.smithi179:> true 2024-08-24T21:05:36.606 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-08-24T21:05:36.606 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc3-g7503b862ff5b"... 2024-08-24T21:05:36.607 DEBUG:teuthology.orchestra.run.smithi179:> uname -r 2024-08-24T21:05:36.640 INFO:teuthology.orchestra.run.smithi179.stdout:6.11.0-rc3-g7503b862ff5b 2024-08-24T21:05:36.641 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc3-g7503b862ff5b vs 6.11.0-rc3-g7503b862ff5b 2024-08-24T21:05:36.641 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-24T21:05:36.641 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-08-24T21:05:37.641 INFO:teuthology.task.kernel:Enabling kdb on client.0... 2024-08-24T21:05:37.642 DEBUG:teuthology.orchestra.run.smithi179:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-08-24T21:05:37.747 INFO:teuthology.orchestra.run.smithi179.stdout:ttyS1 2024-08-24T21:05:37.794 DEBUG:teuthology.parallel:result is None 2024-08-24T21:05:37.794 INFO:teuthology.run_tasks:Running task internal.base... 2024-08-24T21:05:37.801 INFO:teuthology.task.internal:Creating test directory... 2024-08-24T21:05:37.801 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-24T21:05:37.806 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-24T21:05:37.811 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-24T21:05:37.847 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-08-24T21:05:37.853 INFO:teuthology.run_tasks:Running task internal.archive... 2024-08-24T21:05:37.893 INFO:teuthology.task.internal:Creating archive directory... 2024-08-24T21:05:37.893 DEBUG:teuthology.orchestra.run.smithi060:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-24T21:05:37.897 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-24T21:05:37.901 DEBUG:teuthology.orchestra.run.smithi179:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-24T21:05:37.957 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-08-24T21:05:37.965 INFO:teuthology.task.internal:Enabling coredump saving... 2024-08-24T21:05:37.966 DEBUG:teuthology.orchestra.run.smithi060:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-24T21:05:37.971 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-24T21:05:37.987 DEBUG:teuthology.orchestra.run.smithi179:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-24T21:05:38.028 INFO:teuthology.orchestra.run.smithi060.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-24T21:05:38.049 INFO:teuthology.orchestra.run.smithi179.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-24T21:05:38.051 INFO:teuthology.orchestra.run.smithi060.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-24T21:05:38.053 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-24T21:05:38.071 INFO:teuthology.orchestra.run.smithi179.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-24T21:05:38.075 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-24T21:05:38.079 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-08-24T21:05:38.090 INFO:teuthology.task.internal:Configuring sudo... 2024-08-24T21:05:38.090 DEBUG:teuthology.orchestra.run.smithi060:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-24T21:05:38.094 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-24T21:05:38.098 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-24T21:05:38.153 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-08-24T21:05:38.162 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-08-24T21:05:38.163 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-24T21:05:38.166 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-24T21:05:38.170 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-24T21:05:38.205 DEBUG:teuthology.orchestra.run.smithi060:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-24T21:05:38.300 DEBUG:teuthology.orchestra.run.smithi060:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-24T21:05:38.401 DEBUG:teuthology.orchestra.run.smithi060:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-24T21:05:38.463 DEBUG:teuthology.orchestra.run.smithi060:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-24T21:05:38.534 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-08-24T21:05:38.534 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-24T21:05:38.589 DEBUG:teuthology.orchestra.run.smithi119:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-24T21:05:38.653 DEBUG:teuthology.orchestra.run.smithi119:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-24T21:05:38.758 DEBUG:teuthology.orchestra.run.smithi119:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-24T21:05:38.820 DEBUG:teuthology.orchestra.run.smithi119:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-24T21:05:38.891 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-08-24T21:05:38.891 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-24T21:05:38.944 DEBUG:teuthology.orchestra.run.smithi179:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-24T21:05:39.008 DEBUG:teuthology.orchestra.run.smithi179:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-24T21:05:39.091 DEBUG:teuthology.orchestra.run.smithi179:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-24T21:05:39.155 DEBUG:teuthology.orchestra.run.smithi179:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-24T21:05:39.224 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-08-24T21:05:39.224 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-24T21:05:39.278 DEBUG:teuthology.orchestra.run.smithi060:> sudo service rsyslog restart 2024-08-24T21:05:39.282 DEBUG:teuthology.orchestra.run.smithi119:> sudo service rsyslog restart 2024-08-24T21:05:39.286 DEBUG:teuthology.orchestra.run.smithi179:> sudo service rsyslog restart 2024-08-24T21:05:39.365 INFO:teuthology.orchestra.run.smithi060.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-24T21:05:39.371 INFO:teuthology.orchestra.run.smithi119.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-24T21:05:39.394 INFO:teuthology.orchestra.run.smithi179.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-24T21:05:39.807 INFO:teuthology.run_tasks:Running task internal.timer... 2024-08-24T21:05:39.814 INFO:teuthology.task.internal:Starting timer... 2024-08-24T21:05:39.814 INFO:teuthology.run_tasks:Running task pcp... 2024-08-24T21:05:39.850 INFO:teuthology.run_tasks:Running task selinux... 2024-08-24T21:05:39.887 DEBUG:teuthology.orchestra.run.smithi060:> sudo service auditd rotate 2024-08-24T21:05:39.990 INFO:teuthology.orchestra.run.smithi060.stdout:Rotating logs: 2024-08-24T21:05:39.993 DEBUG:teuthology.orchestra.run.smithi119:> sudo service auditd rotate 2024-08-24T21:05:40.134 INFO:teuthology.orchestra.run.smithi119.stdout:Rotating logs: 2024-08-24T21:05:40.138 DEBUG:teuthology.orchestra.run.smithi179:> sudo service auditd rotate 2024-08-24T21:05:40.240 INFO:teuthology.orchestra.run.smithi179.stdout:Rotating logs: 2024-08-24T21:05:40.244 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-08-24T21:05:40.244 DEBUG:teuthology.orchestra.run.smithi060:> /usr/sbin/getenforce 2024-08-24T21:05:40.295 INFO:teuthology.orchestra.run.smithi060.stdout:Permissive 2024-08-24T21:05:40.295 DEBUG:teuthology.orchestra.run.smithi119:> /usr/sbin/getenforce 2024-08-24T21:05:40.346 INFO:teuthology.orchestra.run.smithi119.stdout:Permissive 2024-08-24T21:05:40.347 DEBUG:teuthology.orchestra.run.smithi179:> /usr/sbin/getenforce 2024-08-24T21:05:40.389 INFO:teuthology.orchestra.run.smithi179.stdout:Permissive 2024-08-24T21:05:40.389 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi060.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi119.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi179.front.sepia.ceph.com': 'permissive'} 2024-08-24T21:05:40.390 DEBUG:teuthology.orchestra.run.smithi060:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-24T21:05:40.448 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-24T21:05:40.449 DEBUG:teuthology.orchestra.run.smithi119:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-24T21:05:40.506 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-24T21:05:40.506 DEBUG:teuthology.orchestra.run.smithi179:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-24T21:05:40.563 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-24T21:05:40.564 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-08-24T21:05:40.564 DEBUG:teuthology.orchestra.run.smithi060:> sudo /usr/sbin/setenforce permissive 2024-08-24T21:05:40.620 DEBUG:teuthology.orchestra.run.smithi119:> sudo /usr/sbin/setenforce permissive 2024-08-24T21:05:40.675 DEBUG:teuthology.orchestra.run.smithi179:> sudo /usr/sbin/setenforce permissive 2024-08-24T21:05:40.733 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-08-24T21:05:40.742 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-08-24T21:05:40.754 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-08-24T21:05:40.755 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi060.front.sepia.ceph.com,smithi119.front.sepia.ceph.com,smithi179.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-08-24T21:07:49.022 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi060.front.sepia.ceph.com'), Remote(name='ubuntu@smithi119.front.sepia.ceph.com'), Remote(name='ubuntu@smithi179.front.sepia.ceph.com')] 2024-08-24T21:07:49.024 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-08-24T21:07:49.026 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-24T21:07:49.122 DEBUG:teuthology.orchestra.run.smithi060:> true 2024-08-24T21:07:49.234 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-08-24T21:07:49.234 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-08-24T21:07:49.235 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-24T21:07:49.328 DEBUG:teuthology.orchestra.run.smithi119:> true 2024-08-24T21:07:49.447 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-08-24T21:07:49.447 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-08-24T21:07:49.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-24T21:07:49.538 DEBUG:teuthology.orchestra.run.smithi179:> true 2024-08-24T21:07:49.649 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-08-24T21:07:49.649 INFO:teuthology.run_tasks:Running task clock... 2024-08-24T21:07:50.027 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-08-24T21:07:50.028 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-24T21:07:50.028 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-24T21:07:50.033 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-24T21:07:50.033 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-24T21:07:50.038 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-24T21:07:50.039 DEBUG:teuthology.orchestra.run.smithi179:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-24T21:07:50.096 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-24T21:07:50.101 INFO:teuthology.orchestra.run.smithi179.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-24T21:07:50.103 INFO:teuthology.orchestra.run.smithi119.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-24T21:07:50.127 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-24T21:07:50.130 INFO:teuthology.orchestra.run.smithi179.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-24T21:07:50.140 INFO:teuthology.orchestra.run.smithi119.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-24T21:07:50.181 INFO:teuthology.orchestra.run.smithi060.stderr:sudo: ntpd: command not found 2024-08-24T21:07:50.181 INFO:teuthology.orchestra.run.smithi179.stderr:sudo: ntpd: command not found 2024-08-24T21:07:50.195 INFO:teuthology.orchestra.run.smithi119.stderr:sudo: ntpd: command not found 2024-08-24T21:07:50.205 INFO:teuthology.orchestra.run.smithi179.stdout:506 Cannot talk to daemon 2024-08-24T21:07:50.205 INFO:teuthology.orchestra.run.smithi060.stdout:506 Cannot talk to daemon 2024-08-24T21:07:50.219 INFO:teuthology.orchestra.run.smithi119.stdout:506 Cannot talk to daemon 2024-08-24T21:07:50.234 INFO:teuthology.orchestra.run.smithi179.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-24T21:07:50.235 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-24T21:07:50.247 INFO:teuthology.orchestra.run.smithi119.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-24T21:07:50.263 INFO:teuthology.orchestra.run.smithi179.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-24T21:07:50.265 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-24T21:07:50.276 INFO:teuthology.orchestra.run.smithi119.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-24T21:07:50.364 INFO:teuthology.orchestra.run.smithi179.stderr:bash: line 1: ntpq: command not found 2024-08-24T21:07:50.366 INFO:teuthology.orchestra.run.smithi060.stderr:bash: line 1: ntpq: command not found 2024-08-24T21:07:50.368 INFO:teuthology.orchestra.run.smithi119.stderr:bash: line 1: ntpq: command not found 2024-08-24T21:07:50.370 INFO:teuthology.orchestra.run.smithi179.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-24T21:07:50.371 INFO:teuthology.orchestra.run.smithi179.stdout:=============================================================================== 2024-08-24T21:07:50.371 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-24T21:07:50.371 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-24T21:07:50.371 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-24T21:07:50.371 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-24T21:07:50.372 INFO:teuthology.orchestra.run.smithi060.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-24T21:07:50.372 INFO:teuthology.orchestra.run.smithi060.stdout:=============================================================================== 2024-08-24T21:07:50.372 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-24T21:07:50.372 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-24T21:07:50.372 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-24T21:07:50.373 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-24T21:07:50.374 INFO:teuthology.orchestra.run.smithi119.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-24T21:07:50.374 INFO:teuthology.orchestra.run.smithi119.stdout:=============================================================================== 2024-08-24T21:07:50.374 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-24T21:07:50.374 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-24T21:07:50.374 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-24T21:07:50.374 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-24T21:07:50.375 INFO:teuthology.run_tasks:Running task install... 2024-08-24T21:07:50.386 DEBUG:teuthology.task.install:project ceph 2024-08-24T21:07:50.386 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '4887e20f48210b9f64d81c80656e954e16f399f3'}, 'extra_system_packages': ['pv']} 2024-08-24T21:07:50.386 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '4887e20f48210b9f64d81c80656e954e16f399f3', 'extra_system_packages': ['pv']} 2024-08-24T21:07:50.386 INFO:teuthology.task.install:Using flavor: default 2024-08-24T21:07:50.392 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-08-24T21:07:50.393 INFO:teuthology.task.install:extra packages: [] 2024-08-24T21:07:50.393 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': ['pv'], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4887e20f48210b9f64d81c80656e954e16f399f3', 'tag': None, 'wait_for_package': False} 2024-08-24T21:07:50.394 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=4887e20f48210b9f64d81c80656e954e16f399f3 2024-08-24T21:07:50.396 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': ['pv'], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4887e20f48210b9f64d81c80656e954e16f399f3', 'tag': None, 'wait_for_package': False} 2024-08-24T21:07:50.396 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=4887e20f48210b9f64d81c80656e954e16f399f3 2024-08-24T21:07:50.397 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': ['pv'], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4887e20f48210b9f64d81c80656e954e16f399f3', 'tag': None, 'wait_for_package': False} 2024-08-24T21:07:50.397 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=4887e20f48210b9f64d81c80656e954e16f399f3 2024-08-24T21:07:50.544 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/main/4887e20f48210b9f64d81c80656e954e16f399f3/centos/9/flavors/default/ 2024-08-24T21:07:50.544 INFO:teuthology.task.install.rpm:Package version is 19.0.0-5842.g4887e20f 2024-08-24T21:07:50.548 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/main/4887e20f48210b9f64d81c80656e954e16f399f3/centos/9/flavors/default/ 2024-08-24T21:07:50.548 INFO:teuthology.task.install.rpm:Package version is 19.0.0-5842.g4887e20f 2024-08-24T21:07:50.553 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/main/4887e20f48210b9f64d81c80656e954e16f399f3/centos/9/flavors/default/ 2024-08-24T21:07:50.553 INFO:teuthology.task.install.rpm:Package version is 19.0.0-5842.g4887e20f 2024-08-24T21:07:50.656 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/main/4887e20f48210b9f64d81c80656e954e16f399f3/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/main/4887e20f48210b9f64d81c80656e954e16f399f3/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/main/4887e20f48210b9f64d81c80656e954e16f399f3/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-24T21:07:50.657 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-08-24T21:07:50.657 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-24T21:07:50.674 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/main/4887e20f48210b9f64d81c80656e954e16f399f3/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/main/4887e20f48210b9f64d81c80656e954e16f399f3/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/main/4887e20f48210b9f64d81c80656e954e16f399f3/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-24T21:07:50.675 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-08-24T21:07:50.675 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-24T21:07:50.677 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/main/4887e20f48210b9f64d81c80656e954e16f399f3/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/main/4887e20f48210b9f64d81c80656e954e16f399f3/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/main/4887e20f48210b9f64d81c80656e954e16f399f3/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-24T21:07:50.677 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-08-24T21:07:50.677 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-24T21:07:50.714 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, pv, pv, pv, pv on remote rpm x86_64 2024-08-24T21:07:50.714 DEBUG:teuthology.orchestra.run.smithi060:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4887e20f48210b9f64d81c80656e954e16f399f3/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-24T21:07:50.733 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, pv, pv, pv, pv, pv on remote rpm x86_64 2024-08-24T21:07:50.733 DEBUG:teuthology.orchestra.run.smithi119:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4887e20f48210b9f64d81c80656e954e16f399f3/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-24T21:07:50.734 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, pv, pv, pv, pv, pv, pv on remote rpm x86_64 2024-08-24T21:07:50.734 DEBUG:teuthology.orchestra.run.smithi179:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4887e20f48210b9f64d81c80656e954e16f399f3/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-24T21:07:50.812 DEBUG:teuthology.orchestra.run.smithi060:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-24T21:07:50.831 DEBUG:teuthology.orchestra.run.smithi119:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-24T21:07:50.832 DEBUG:teuthology.orchestra.run.smithi179:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-24T21:07:50.891 DEBUG:teuthology.orchestra.run.smithi060:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-24T21:07:50.909 DEBUG:teuthology.orchestra.run.smithi119:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-24T21:07:50.910 DEBUG:teuthology.orchestra.run.smithi179:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-24T21:07:50.947 INFO:teuthology.orchestra.run.smithi060.stdout:check_obsoletes = 1 2024-08-24T21:07:50.950 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum clean all 2024-08-24T21:07:50.965 INFO:teuthology.orchestra.run.smithi179.stdout:check_obsoletes = 1 2024-08-24T21:07:50.965 INFO:teuthology.orchestra.run.smithi119.stdout:check_obsoletes = 1 2024-08-24T21:07:50.968 DEBUG:teuthology.orchestra.run.smithi179:> sudo yum clean all 2024-08-24T21:07:50.969 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum clean all 2024-08-24T21:07:51.226 INFO:teuthology.orchestra.run.smithi060.stdout:45 files removed 2024-08-24T21:07:51.238 INFO:teuthology.orchestra.run.smithi119.stdout:45 files removed 2024-08-24T21:07:51.242 INFO:teuthology.orchestra.run.smithi179.stdout:45 files removed 2024-08-24T21:07:51.260 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd pv pv pv pv pv pv 2024-08-24T21:07:51.271 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd pv pv pv pv pv pv 2024-08-24T21:07:51.277 DEBUG:teuthology.orchestra.run.smithi179:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd pv pv pv pv pv pv 2024-08-24T21:07:51.947 INFO:teuthology.orchestra.run.smithi179.stdout:ceph packages for x86_64 300 kB/s | 84 kB 00:00 2024-08-24T21:07:51.954 INFO:teuthology.orchestra.run.smithi060.stdout:ceph packages for x86_64 297 kB/s | 84 kB 00:00 2024-08-24T21:07:51.987 INFO:teuthology.orchestra.run.smithi119.stdout:ceph packages for x86_64 257 kB/s | 84 kB 00:00 2024-08-24T21:07:52.255 INFO:teuthology.orchestra.run.smithi060.stdout:ceph noarch packages 95 kB/s | 24 kB 00:00 2024-08-24T21:07:52.255 INFO:teuthology.orchestra.run.smithi179.stdout:ceph noarch packages 91 kB/s | 24 kB 00:00 2024-08-24T21:07:52.287 INFO:teuthology.orchestra.run.smithi119.stdout:ceph noarch packages 94 kB/s | 24 kB 00:00 2024-08-24T21:07:52.533 INFO:teuthology.orchestra.run.smithi179.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-08-24T21:07:52.547 INFO:teuthology.orchestra.run.smithi060.stdout:ceph source packages 7.6 kB/s | 1.9 kB 00:00 2024-08-24T21:07:52.571 INFO:teuthology.orchestra.run.smithi119.stdout:ceph source packages 7.8 kB/s | 1.9 kB 00:00 2024-08-24T21:07:53.259 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.2 MB 00:00 2024-08-24T21:07:54.030 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - BaseOS 5.8 MB/s | 8.2 MB 00:01 2024-08-24T21:07:54.175 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 9 - BaseOS 5.1 MB/s | 8.2 MB 00:01 2024-08-24T21:07:55.573 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - AppStream 17 MB/s | 20 MB 00:01 2024-08-24T21:07:56.160 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 9 - AppStream 24 MB/s | 20 MB 00:00 2024-08-24T21:07:56.772 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - AppStream 12 MB/s | 20 MB 00:01 2024-08-24T21:08:00.719 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.6 MB 00:00 2024-08-24T21:08:01.407 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - CRB 3.8 MB/s | 6.6 MB 00:01 2024-08-24T21:08:02.223 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - CRB 4.5 MB/s | 6.6 MB 00:01 2024-08-24T21:08:02.361 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 9 - Extras packages 62 kB/s | 18 kB 00:00 2024-08-24T21:08:03.091 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - Extras packages 62 kB/s | 18 kB 00:00 2024-08-24T21:08:03.341 INFO:teuthology.orchestra.run.smithi179.stdout:Extra Packages for Enterprise Linux 26 MB/s | 22 MB 00:00 2024-08-24T21:08:03.807 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - Extras packages 80 kB/s | 18 kB 00:00 2024-08-24T21:08:03.970 INFO:teuthology.orchestra.run.smithi060.stdout:Extra Packages for Enterprise Linux 30 MB/s | 22 MB 00:00 2024-08-24T21:08:04.903 INFO:teuthology.orchestra.run.smithi119.stdout:Extra Packages for Enterprise Linux 23 MB/s | 22 MB 00:00 2024-08-24T21:08:09.605 INFO:teuthology.orchestra.run.smithi179.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-08-24T21:08:10.601 INFO:teuthology.orchestra.run.smithi060.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-08-24T21:08:11.100 INFO:teuthology.orchestra.run.smithi119.stdout:lab-extras 19 kB/s | 1.7 kB 00:00 2024-08-24T21:08:12.006 INFO:teuthology.orchestra.run.smithi179.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-24T21:08:12.007 INFO:teuthology.orchestra.run.smithi179.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-24T21:08:12.071 INFO:teuthology.orchestra.run.smithi179.stdout:Dependencies resolved. 2024-08-24T21:08:12.084 INFO:teuthology.orchestra.run.smithi179.stdout:======================================================================================= 2024-08-24T21:08:12.084 INFO:teuthology.orchestra.run.smithi179.stdout: Package Arch Version Repository Size 2024-08-24T21:08:12.085 INFO:teuthology.orchestra.run.smithi179.stdout:======================================================================================= 2024-08-24T21:08:12.085 INFO:teuthology.orchestra.run.smithi179.stdout:Installing: 2024-08-24T21:08:12.085 INFO:teuthology.orchestra.run.smithi179.stdout: ceph x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 6.6 k 2024-08-24T21:08:12.085 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-base x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 5.5 M 2024-08-24T21:08:12.085 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-fuse x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 901 k 2024-08-24T21:08:12.085 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 145 k 2024-08-24T21:08:12.085 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 1.5 M 2024-08-24T21:08:12.085 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-cephadm noarch 2:19.0.0-5842.g4887e20f.el9 ceph-noarch 150 k 2024-08-24T21:08:12.085 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-dashboard noarch 2:19.0.0-5842.g4887e20f.el9 ceph-noarch 14 M 2024-08-24T21:08:12.085 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-5842.g4887e20f.el9 ceph-noarch 7.4 M 2024-08-24T21:08:12.086 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-rook noarch 2:19.0.0-5842.g4887e20f.el9 ceph-noarch 49 k 2024-08-24T21:08:12.086 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-radosgw x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 11 M 2024-08-24T21:08:12.086 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-test x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 50 M 2024-08-24T21:08:12.086 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-volume noarch 2:19.0.0-5842.g4887e20f.el9 ceph-noarch 285 k 2024-08-24T21:08:12.086 INFO:teuthology.orchestra.run.smithi179.stdout: cephadm noarch 2:19.0.0-5842.g4887e20f.el9 ceph-noarch 772 k 2024-08-24T21:08:12.086 INFO:teuthology.orchestra.run.smithi179.stdout: libcephfs-devel x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 32 k 2024-08-24T21:08:12.086 INFO:teuthology.orchestra.run.smithi179.stdout: libcephfs2 x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 755 k 2024-08-24T21:08:12.086 INFO:teuthology.orchestra.run.smithi179.stdout: librados-devel x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 127 k 2024-08-24T21:08:12.086 INFO:teuthology.orchestra.run.smithi179.stdout: pv x86_64 1.6.20-1.el9 epel 65 k 2024-08-24T21:08:12.086 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cephfs x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 188 k 2024-08-24T21:08:12.086 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rados x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 372 k 2024-08-24T21:08:12.086 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rbd x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 355 k 2024-08-24T21:08:12.087 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rgw x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 116 k 2024-08-24T21:08:12.087 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-fuse x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 85 k 2024-08-24T21:08:12.087 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-mirror x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 3.2 M 2024-08-24T21:08:12.087 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-nbd x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 170 k 2024-08-24T21:08:12.087 INFO:teuthology.orchestra.run.smithi179.stdout:Upgrading: 2024-08-24T21:08:12.087 INFO:teuthology.orchestra.run.smithi179.stdout: librados2 x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 3.5 M 2024-08-24T21:08:12.087 INFO:teuthology.orchestra.run.smithi179.stdout: librbd1 x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 3.2 M 2024-08-24T21:08:12.087 INFO:teuthology.orchestra.run.smithi179.stdout:Installing dependencies: 2024-08-24T21:08:12.087 INFO:teuthology.orchestra.run.smithi179.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-08-24T21:08:12.087 INFO:teuthology.orchestra.run.smithi179.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-08-24T21:08:12.087 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-common x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 22 M 2024-08-24T21:08:12.088 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-grafana-dashboards noarch 2:19.0.0-5842.g4887e20f.el9 ceph-noarch 34 k 2024-08-24T21:08:12.088 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mds x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 2.4 M 2024-08-24T21:08:12.088 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-modules-core noarch 2:19.0.0-5842.g4887e20f.el9 ceph-noarch 284 k 2024-08-24T21:08:12.088 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mon x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 4.8 M 2024-08-24T21:08:12.088 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-osd x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 17 M 2024-08-24T21:08:12.088 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-prometheus-alerts noarch 2:19.0.0-5842.g4887e20f.el9 ceph-noarch 16 k 2024-08-24T21:08:12.088 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-selinux x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 25 k 2024-08-24T21:08:12.088 INFO:teuthology.orchestra.run.smithi179.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-24T21:08:12.088 INFO:teuthology.orchestra.run.smithi179.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-24T21:08:12.088 INFO:teuthology.orchestra.run.smithi179.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-24T21:08:12.088 INFO:teuthology.orchestra.run.smithi179.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-24T21:08:12.089 INFO:teuthology.orchestra.run.smithi179.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-24T21:08:12.089 INFO:teuthology.orchestra.run.smithi179.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-08-24T21:08:12.089 INFO:teuthology.orchestra.run.smithi179.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-08-24T21:08:12.089 INFO:teuthology.orchestra.run.smithi179.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-08-24T21:08:12.089 INFO:teuthology.orchestra.run.smithi179.stdout: libcephsqlite x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 163 k 2024-08-24T21:08:12.089 INFO:teuthology.orchestra.run.smithi179.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-08-24T21:08:12.089 INFO:teuthology.orchestra.run.smithi179.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-24T21:08:12.089 INFO:teuthology.orchestra.run.smithi179.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-24T21:08:12.089 INFO:teuthology.orchestra.run.smithi179.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-08-24T21:08:12.089 INFO:teuthology.orchestra.run.smithi179.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-24T21:08:12.089 INFO:teuthology.orchestra.run.smithi179.stdout: libradosstriper1 x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 508 k 2024-08-24T21:08:12.090 INFO:teuthology.orchestra.run.smithi179.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-24T21:08:12.090 INFO:teuthology.orchestra.run.smithi179.stdout: librgw2 x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 5.5 M 2024-08-24T21:08:12.090 INFO:teuthology.orchestra.run.smithi179.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-24T21:08:12.090 INFO:teuthology.orchestra.run.smithi179.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-24T21:08:12.090 INFO:teuthology.orchestra.run.smithi179.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-08-24T21:08:12.090 INFO:teuthology.orchestra.run.smithi179.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-08-24T21:08:12.090 INFO:teuthology.orchestra.run.smithi179.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-08-24T21:08:12.090 INFO:teuthology.orchestra.run.smithi179.stdout: openblas x86_64 0.3.26-1.el9 appstream 38 k 2024-08-24T21:08:12.090 INFO:teuthology.orchestra.run.smithi179.stdout: openblas-openmp x86_64 0.3.26-1.el9 appstream 4.9 M 2024-08-24T21:08:12.090 INFO:teuthology.orchestra.run.smithi179.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-08-24T21:08:12.090 INFO:teuthology.orchestra.run.smithi179.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-08-24T21:08:12.090 INFO:teuthology.orchestra.run.smithi179.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-08-24T21:08:12.091 INFO:teuthology.orchestra.run.smithi179.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-24T21:08:12.091 INFO:teuthology.orchestra.run.smithi179.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-24T21:08:12.091 INFO:teuthology.orchestra.run.smithi179.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-24T21:08:12.091 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-24T21:08:12.091 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-argparse x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 45 k 2024-08-24T21:08:12.091 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-common x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 138 k 2024-08-24T21:08:12.091 INFO:teuthology.orchestra.run.smithi179.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-24T21:08:12.091 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-24T21:08:12.091 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-24T21:08:12.091 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-24T21:08:12.091 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-24T21:08:12.092 INFO:teuthology.orchestra.run.smithi179.stdout: python3-devel x86_64 3.9.19-7.el9 appstream 245 k 2024-08-24T21:08:12.092 INFO:teuthology.orchestra.run.smithi179.stdout: python3-google-auth noarch 1:2.33.0-1.el9 epel 220 k 2024-08-24T21:08:12.092 INFO:teuthology.orchestra.run.smithi179.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-08-24T21:08:12.092 INFO:teuthology.orchestra.run.smithi179.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-08-24T21:08:12.092 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-24T21:08:12.092 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-24T21:08:12.092 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-24T21:08:12.092 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-24T21:08:12.092 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-24T21:08:12.092 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-24T21:08:12.092 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-24T21:08:12.092 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-24T21:08:12.092 INFO:teuthology.orchestra.run.smithi179.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-24T21:08:12.093 INFO:teuthology.orchestra.run.smithi179.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-24T21:08:12.093 INFO:teuthology.orchestra.run.smithi179.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-24T21:08:12.093 INFO:teuthology.orchestra.run.smithi179.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-24T21:08:12.093 INFO:teuthology.orchestra.run.smithi179.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-24T21:08:12.093 INFO:teuthology.orchestra.run.smithi179.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-24T21:08:12.093 INFO:teuthology.orchestra.run.smithi179.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-24T21:08:12.093 INFO:teuthology.orchestra.run.smithi179.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-24T21:08:12.093 INFO:teuthology.orchestra.run.smithi179.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-24T21:08:12.093 INFO:teuthology.orchestra.run.smithi179.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-24T21:08:12.093 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-24T21:08:12.093 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-24T21:08:12.093 INFO:teuthology.orchestra.run.smithi179.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-24T21:08:12.094 INFO:teuthology.orchestra.run.smithi179.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-24T21:08:12.094 INFO:teuthology.orchestra.run.smithi179.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-08-24T21:08:12.094 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-24T21:08:12.094 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-24T21:08:12.094 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-24T21:08:12.094 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-24T21:08:12.094 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-24T21:08:12.094 INFO:teuthology.orchestra.run.smithi179.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-24T21:08:12.094 INFO:teuthology.orchestra.run.smithi179.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-24T21:08:12.094 INFO:teuthology.orchestra.run.smithi179.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-24T21:08:12.094 INFO:teuthology.orchestra.run.smithi179.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-24T21:08:12.094 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-24T21:08:12.095 INFO:teuthology.orchestra.run.smithi179.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-24T21:08:12.095 INFO:teuthology.orchestra.run.smithi179.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-24T21:08:12.095 INFO:teuthology.orchestra.run.smithi179.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-24T21:08:12.095 INFO:teuthology.orchestra.run.smithi179.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-24T21:08:12.095 INFO:teuthology.orchestra.run.smithi179.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-24T21:08:12.095 INFO:teuthology.orchestra.run.smithi179.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-08-24T21:08:12.095 INFO:teuthology.orchestra.run.smithi179.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-24T21:08:12.095 INFO:teuthology.orchestra.run.smithi179.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-24T21:08:12.095 INFO:teuthology.orchestra.run.smithi179.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-24T21:08:12.095 INFO:teuthology.orchestra.run.smithi179.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-08-24T21:08:12.095 INFO:teuthology.orchestra.run.smithi179.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-08-24T21:08:12.095 INFO:teuthology.orchestra.run.smithi179.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-08-24T21:08:12.095 INFO:teuthology.orchestra.run.smithi179.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-24T21:08:12.096 INFO:teuthology.orchestra.run.smithi179.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-24T21:08:12.096 INFO:teuthology.orchestra.run.smithi179.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-24T21:08:12.096 INFO:teuthology.orchestra.run.smithi179.stdout:Installing weak dependencies: 2024-08-24T21:08:12.096 INFO:teuthology.orchestra.run.smithi179.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-08-24T21:08:12.096 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-08-24T21:08:12.096 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction Summary 2024-08-24T21:08:12.096 INFO:teuthology.orchestra.run.smithi179.stdout:======================================================================================= 2024-08-24T21:08:12.096 INFO:teuthology.orchestra.run.smithi179.stdout:Install 125 Packages 2024-08-24T21:08:12.096 INFO:teuthology.orchestra.run.smithi179.stdout:Upgrade 2 Packages 2024-08-24T21:08:12.096 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-08-24T21:08:12.097 INFO:teuthology.orchestra.run.smithi179.stdout:Total download size: 216 M 2024-08-24T21:08:12.097 INFO:teuthology.orchestra.run.smithi179.stdout:Downloading Packages: 2024-08-24T21:08:12.990 INFO:teuthology.orchestra.run.smithi179.stdout:(1/127): ceph-19.0.0-5842.g4887e20f.el9.x86_64. 18 kB/s | 6.6 kB 00:00 2024-08-24T21:08:13.051 INFO:teuthology.orchestra.run.smithi060.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-24T21:08:13.052 INFO:teuthology.orchestra.run.smithi060.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-24T21:08:13.121 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-08-24T21:08:13.136 INFO:teuthology.orchestra.run.smithi060.stdout:======================================================================================= 2024-08-24T21:08:13.136 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repository Size 2024-08-24T21:08:13.136 INFO:teuthology.orchestra.run.smithi060.stdout:======================================================================================= 2024-08-24T21:08:13.136 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2024-08-24T21:08:13.136 INFO:teuthology.orchestra.run.smithi060.stdout: ceph x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 6.6 k 2024-08-24T21:08:13.136 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-base x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 5.5 M 2024-08-24T21:08:13.136 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-fuse x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 901 k 2024-08-24T21:08:13.137 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 145 k 2024-08-24T21:08:13.137 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 1.5 M 2024-08-24T21:08:13.137 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-cephadm noarch 2:19.0.0-5842.g4887e20f.el9 ceph-noarch 150 k 2024-08-24T21:08:13.137 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-dashboard noarch 2:19.0.0-5842.g4887e20f.el9 ceph-noarch 14 M 2024-08-24T21:08:13.137 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-5842.g4887e20f.el9 ceph-noarch 7.4 M 2024-08-24T21:08:13.137 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-rook noarch 2:19.0.0-5842.g4887e20f.el9 ceph-noarch 49 k 2024-08-24T21:08:13.137 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-radosgw x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 11 M 2024-08-24T21:08:13.137 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-test x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 50 M 2024-08-24T21:08:13.137 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-volume noarch 2:19.0.0-5842.g4887e20f.el9 ceph-noarch 285 k 2024-08-24T21:08:13.137 INFO:teuthology.orchestra.run.smithi060.stdout: cephadm noarch 2:19.0.0-5842.g4887e20f.el9 ceph-noarch 772 k 2024-08-24T21:08:13.137 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs-devel x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 32 k 2024-08-24T21:08:13.137 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs2 x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 755 k 2024-08-24T21:08:13.137 INFO:teuthology.orchestra.run.smithi060.stdout: librados-devel x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 127 k 2024-08-24T21:08:13.137 INFO:teuthology.orchestra.run.smithi060.stdout: pv x86_64 1.6.20-1.el9 epel 65 k 2024-08-24T21:08:13.138 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cephfs x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 188 k 2024-08-24T21:08:13.138 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rados x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 372 k 2024-08-24T21:08:13.138 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rbd x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 355 k 2024-08-24T21:08:13.138 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rgw x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 116 k 2024-08-24T21:08:13.138 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-fuse x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 85 k 2024-08-24T21:08:13.138 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-mirror x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 3.2 M 2024-08-24T21:08:13.138 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-nbd x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 170 k 2024-08-24T21:08:13.138 INFO:teuthology.orchestra.run.smithi060.stdout:Upgrading: 2024-08-24T21:08:13.138 INFO:teuthology.orchestra.run.smithi060.stdout: librados2 x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 3.5 M 2024-08-24T21:08:13.138 INFO:teuthology.orchestra.run.smithi060.stdout: librbd1 x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 3.2 M 2024-08-24T21:08:13.138 INFO:teuthology.orchestra.run.smithi060.stdout:Installing dependencies: 2024-08-24T21:08:13.138 INFO:teuthology.orchestra.run.smithi060.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-08-24T21:08:13.138 INFO:teuthology.orchestra.run.smithi060.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-08-24T21:08:13.139 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-common x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 22 M 2024-08-24T21:08:13.139 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-grafana-dashboards noarch 2:19.0.0-5842.g4887e20f.el9 ceph-noarch 34 k 2024-08-24T21:08:13.139 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mds x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 2.4 M 2024-08-24T21:08:13.139 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-modules-core noarch 2:19.0.0-5842.g4887e20f.el9 ceph-noarch 284 k 2024-08-24T21:08:13.139 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mon x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 4.8 M 2024-08-24T21:08:13.139 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-osd x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 17 M 2024-08-24T21:08:13.139 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-prometheus-alerts noarch 2:19.0.0-5842.g4887e20f.el9 ceph-noarch 16 k 2024-08-24T21:08:13.139 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-selinux x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 25 k 2024-08-24T21:08:13.139 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-24T21:08:13.139 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-24T21:08:13.139 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-24T21:08:13.139 INFO:teuthology.orchestra.run.smithi060.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-24T21:08:13.139 INFO:teuthology.orchestra.run.smithi060.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-24T21:08:13.139 INFO:teuthology.orchestra.run.smithi060.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-08-24T21:08:13.140 INFO:teuthology.orchestra.run.smithi060.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-08-24T21:08:13.140 INFO:teuthology.orchestra.run.smithi060.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-08-24T21:08:13.140 INFO:teuthology.orchestra.run.smithi060.stdout: libcephsqlite x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 163 k 2024-08-24T21:08:13.140 INFO:teuthology.orchestra.run.smithi060.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-08-24T21:08:13.140 INFO:teuthology.orchestra.run.smithi060.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-24T21:08:13.140 INFO:teuthology.orchestra.run.smithi060.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-24T21:08:13.140 INFO:teuthology.orchestra.run.smithi060.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-08-24T21:08:13.140 INFO:teuthology.orchestra.run.smithi060.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-24T21:08:13.140 INFO:teuthology.orchestra.run.smithi060.stdout: libradosstriper1 x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 508 k 2024-08-24T21:08:13.140 INFO:teuthology.orchestra.run.smithi060.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-24T21:08:13.140 INFO:teuthology.orchestra.run.smithi060.stdout: librgw2 x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 5.5 M 2024-08-24T21:08:13.140 INFO:teuthology.orchestra.run.smithi060.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-24T21:08:13.140 INFO:teuthology.orchestra.run.smithi060.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-24T21:08:13.140 INFO:teuthology.orchestra.run.smithi060.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-08-24T21:08:13.141 INFO:teuthology.orchestra.run.smithi060.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-08-24T21:08:13.141 INFO:teuthology.orchestra.run.smithi060.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-08-24T21:08:13.141 INFO:teuthology.orchestra.run.smithi060.stdout: openblas x86_64 0.3.26-1.el9 appstream 38 k 2024-08-24T21:08:13.141 INFO:teuthology.orchestra.run.smithi060.stdout: openblas-openmp x86_64 0.3.26-1.el9 appstream 4.9 M 2024-08-24T21:08:13.141 INFO:teuthology.orchestra.run.smithi060.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-08-24T21:08:13.141 INFO:teuthology.orchestra.run.smithi060.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-08-24T21:08:13.141 INFO:teuthology.orchestra.run.smithi060.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-08-24T21:08:13.141 INFO:teuthology.orchestra.run.smithi060.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-24T21:08:13.141 INFO:teuthology.orchestra.run.smithi060.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-24T21:08:13.141 INFO:teuthology.orchestra.run.smithi060.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-24T21:08:13.141 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-24T21:08:13.141 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-argparse x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 45 k 2024-08-24T21:08:13.142 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-common x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 138 k 2024-08-24T21:08:13.142 INFO:teuthology.orchestra.run.smithi060.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-24T21:08:13.142 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-24T21:08:13.142 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-24T21:08:13.142 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-24T21:08:13.142 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-24T21:08:13.142 INFO:teuthology.orchestra.run.smithi060.stdout: python3-devel x86_64 3.9.19-7.el9 appstream 245 k 2024-08-24T21:08:13.142 INFO:teuthology.orchestra.run.smithi060.stdout: python3-google-auth noarch 1:2.33.0-1.el9 epel 220 k 2024-08-24T21:08:13.142 INFO:teuthology.orchestra.run.smithi060.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-08-24T21:08:13.142 INFO:teuthology.orchestra.run.smithi060.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-08-24T21:08:13.142 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-24T21:08:13.142 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-24T21:08:13.142 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-24T21:08:13.143 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-24T21:08:13.143 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-24T21:08:13.143 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-24T21:08:13.143 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-24T21:08:13.143 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-24T21:08:13.143 INFO:teuthology.orchestra.run.smithi060.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-24T21:08:13.143 INFO:teuthology.orchestra.run.smithi060.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-24T21:08:13.143 INFO:teuthology.orchestra.run.smithi060.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-24T21:08:13.143 INFO:teuthology.orchestra.run.smithi060.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-24T21:08:13.143 INFO:teuthology.orchestra.run.smithi060.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-24T21:08:13.143 INFO:teuthology.orchestra.run.smithi060.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-24T21:08:13.143 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-24T21:08:13.143 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-24T21:08:13.144 INFO:teuthology.orchestra.run.smithi060.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-24T21:08:13.144 INFO:teuthology.orchestra.run.smithi060.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-24T21:08:13.144 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-24T21:08:13.144 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-24T21:08:13.144 INFO:teuthology.orchestra.run.smithi060.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-24T21:08:13.144 INFO:teuthology.orchestra.run.smithi060.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-24T21:08:13.144 INFO:teuthology.orchestra.run.smithi060.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-08-24T21:08:13.144 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-24T21:08:13.144 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-24T21:08:13.144 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-24T21:08:13.144 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-24T21:08:13.144 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-24T21:08:13.144 INFO:teuthology.orchestra.run.smithi060.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-24T21:08:13.144 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-24T21:08:13.145 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-24T21:08:13.145 INFO:teuthology.orchestra.run.smithi060.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-24T21:08:13.145 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-24T21:08:13.145 INFO:teuthology.orchestra.run.smithi060.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-24T21:08:13.145 INFO:teuthology.orchestra.run.smithi060.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-24T21:08:13.145 INFO:teuthology.orchestra.run.smithi060.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-24T21:08:13.145 INFO:teuthology.orchestra.run.smithi060.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-24T21:08:13.145 INFO:teuthology.orchestra.run.smithi060.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-24T21:08:13.145 INFO:teuthology.orchestra.run.smithi060.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-08-24T21:08:13.145 INFO:teuthology.orchestra.run.smithi060.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-24T21:08:13.145 INFO:teuthology.orchestra.run.smithi060.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-24T21:08:13.145 INFO:teuthology.orchestra.run.smithi060.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-24T21:08:13.145 INFO:teuthology.orchestra.run.smithi060.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-08-24T21:08:13.146 INFO:teuthology.orchestra.run.smithi060.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-08-24T21:08:13.146 INFO:teuthology.orchestra.run.smithi060.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-08-24T21:08:13.146 INFO:teuthology.orchestra.run.smithi060.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-24T21:08:13.146 INFO:teuthology.orchestra.run.smithi060.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-24T21:08:13.146 INFO:teuthology.orchestra.run.smithi060.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-24T21:08:13.146 INFO:teuthology.orchestra.run.smithi060.stdout:Installing weak dependencies: 2024-08-24T21:08:13.146 INFO:teuthology.orchestra.run.smithi060.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-08-24T21:08:13.146 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-08-24T21:08:13.146 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-08-24T21:08:13.146 INFO:teuthology.orchestra.run.smithi060.stdout:======================================================================================= 2024-08-24T21:08:13.146 INFO:teuthology.orchestra.run.smithi060.stdout:Install 125 Packages 2024-08-24T21:08:13.146 INFO:teuthology.orchestra.run.smithi060.stdout:Upgrade 2 Packages 2024-08-24T21:08:13.146 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-08-24T21:08:13.147 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 216 M 2024-08-24T21:08:13.147 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2024-08-24T21:08:13.498 INFO:teuthology.orchestra.run.smithi119.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-24T21:08:13.499 INFO:teuthology.orchestra.run.smithi119.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-24T21:08:13.563 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-08-24T21:08:13.587 INFO:teuthology.orchestra.run.smithi119.stdout:======================================================================================= 2024-08-24T21:08:13.587 INFO:teuthology.orchestra.run.smithi119.stdout: Package Arch Version Repository Size 2024-08-24T21:08:13.587 INFO:teuthology.orchestra.run.smithi119.stdout:======================================================================================= 2024-08-24T21:08:13.587 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2024-08-24T21:08:13.587 INFO:teuthology.orchestra.run.smithi119.stdout: ceph x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 6.6 k 2024-08-24T21:08:13.588 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-base x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 5.5 M 2024-08-24T21:08:13.588 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-fuse x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 901 k 2024-08-24T21:08:13.588 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 145 k 2024-08-24T21:08:13.588 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 1.5 M 2024-08-24T21:08:13.588 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-cephadm noarch 2:19.0.0-5842.g4887e20f.el9 ceph-noarch 150 k 2024-08-24T21:08:13.588 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-dashboard noarch 2:19.0.0-5842.g4887e20f.el9 ceph-noarch 14 M 2024-08-24T21:08:13.588 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-5842.g4887e20f.el9 ceph-noarch 7.4 M 2024-08-24T21:08:13.588 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-rook noarch 2:19.0.0-5842.g4887e20f.el9 ceph-noarch 49 k 2024-08-24T21:08:13.588 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-radosgw x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 11 M 2024-08-24T21:08:13.588 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-test x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 50 M 2024-08-24T21:08:13.588 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-volume noarch 2:19.0.0-5842.g4887e20f.el9 ceph-noarch 285 k 2024-08-24T21:08:13.588 INFO:teuthology.orchestra.run.smithi119.stdout: cephadm noarch 2:19.0.0-5842.g4887e20f.el9 ceph-noarch 772 k 2024-08-24T21:08:13.588 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs-devel x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 32 k 2024-08-24T21:08:13.588 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs2 x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 755 k 2024-08-24T21:08:13.589 INFO:teuthology.orchestra.run.smithi119.stdout: librados-devel x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 127 k 2024-08-24T21:08:13.589 INFO:teuthology.orchestra.run.smithi119.stdout: pv x86_64 1.6.20-1.el9 epel 65 k 2024-08-24T21:08:13.589 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cephfs x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 188 k 2024-08-24T21:08:13.589 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rados x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 372 k 2024-08-24T21:08:13.589 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rbd x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 355 k 2024-08-24T21:08:13.589 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rgw x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 116 k 2024-08-24T21:08:13.589 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-fuse x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 85 k 2024-08-24T21:08:13.589 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-mirror x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 3.2 M 2024-08-24T21:08:13.589 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-nbd x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 170 k 2024-08-24T21:08:13.589 INFO:teuthology.orchestra.run.smithi119.stdout:Upgrading: 2024-08-24T21:08:13.589 INFO:teuthology.orchestra.run.smithi119.stdout: librados2 x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 3.5 M 2024-08-24T21:08:13.589 INFO:teuthology.orchestra.run.smithi119.stdout: librbd1 x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 3.2 M 2024-08-24T21:08:13.589 INFO:teuthology.orchestra.run.smithi119.stdout:Installing dependencies: 2024-08-24T21:08:13.590 INFO:teuthology.orchestra.run.smithi119.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-08-24T21:08:13.590 INFO:teuthology.orchestra.run.smithi119.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-08-24T21:08:13.590 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-common x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 22 M 2024-08-24T21:08:13.590 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-grafana-dashboards noarch 2:19.0.0-5842.g4887e20f.el9 ceph-noarch 34 k 2024-08-24T21:08:13.590 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mds x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 2.4 M 2024-08-24T21:08:13.590 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-modules-core noarch 2:19.0.0-5842.g4887e20f.el9 ceph-noarch 284 k 2024-08-24T21:08:13.590 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mon x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 4.8 M 2024-08-24T21:08:13.590 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-osd x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 17 M 2024-08-24T21:08:13.590 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-prometheus-alerts noarch 2:19.0.0-5842.g4887e20f.el9 ceph-noarch 16 k 2024-08-24T21:08:13.590 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-selinux x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 25 k 2024-08-24T21:08:13.590 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-24T21:08:13.590 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-24T21:08:13.591 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-24T21:08:13.591 INFO:teuthology.orchestra.run.smithi119.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-24T21:08:13.591 INFO:teuthology.orchestra.run.smithi119.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-24T21:08:13.591 INFO:teuthology.orchestra.run.smithi119.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-08-24T21:08:13.591 INFO:teuthology.orchestra.run.smithi119.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-08-24T21:08:13.591 INFO:teuthology.orchestra.run.smithi119.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-08-24T21:08:13.591 INFO:teuthology.orchestra.run.smithi119.stdout: libcephsqlite x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 163 k 2024-08-24T21:08:13.591 INFO:teuthology.orchestra.run.smithi119.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-08-24T21:08:13.591 INFO:teuthology.orchestra.run.smithi119.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-24T21:08:13.591 INFO:teuthology.orchestra.run.smithi119.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-24T21:08:13.591 INFO:teuthology.orchestra.run.smithi119.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-08-24T21:08:13.591 INFO:teuthology.orchestra.run.smithi119.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-24T21:08:13.592 INFO:teuthology.orchestra.run.smithi119.stdout: libradosstriper1 x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 508 k 2024-08-24T21:08:13.592 INFO:teuthology.orchestra.run.smithi119.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-24T21:08:13.592 INFO:teuthology.orchestra.run.smithi119.stdout: librgw2 x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 5.5 M 2024-08-24T21:08:13.592 INFO:teuthology.orchestra.run.smithi119.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-24T21:08:13.592 INFO:teuthology.orchestra.run.smithi119.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-24T21:08:13.592 INFO:teuthology.orchestra.run.smithi119.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-08-24T21:08:13.592 INFO:teuthology.orchestra.run.smithi119.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-08-24T21:08:13.592 INFO:teuthology.orchestra.run.smithi119.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-08-24T21:08:13.592 INFO:teuthology.orchestra.run.smithi119.stdout: openblas x86_64 0.3.26-1.el9 appstream 38 k 2024-08-24T21:08:13.592 INFO:teuthology.orchestra.run.smithi119.stdout: openblas-openmp x86_64 0.3.26-1.el9 appstream 4.9 M 2024-08-24T21:08:13.592 INFO:teuthology.orchestra.run.smithi119.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-08-24T21:08:13.592 INFO:teuthology.orchestra.run.smithi119.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-08-24T21:08:13.593 INFO:teuthology.orchestra.run.smithi119.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-08-24T21:08:13.593 INFO:teuthology.orchestra.run.smithi119.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-24T21:08:13.593 INFO:teuthology.orchestra.run.smithi119.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-24T21:08:13.593 INFO:teuthology.orchestra.run.smithi119.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-24T21:08:13.593 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-24T21:08:13.593 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-argparse x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 45 k 2024-08-24T21:08:13.593 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-common x86_64 2:19.0.0-5842.g4887e20f.el9 ceph 138 k 2024-08-24T21:08:13.593 INFO:teuthology.orchestra.run.smithi119.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-24T21:08:13.593 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-24T21:08:13.593 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-24T21:08:13.593 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-24T21:08:13.593 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-24T21:08:13.593 INFO:teuthology.orchestra.run.smithi119.stdout: python3-devel x86_64 3.9.19-7.el9 appstream 245 k 2024-08-24T21:08:13.594 INFO:teuthology.orchestra.run.smithi119.stdout: python3-google-auth noarch 1:2.33.0-1.el9 epel 220 k 2024-08-24T21:08:13.594 INFO:teuthology.orchestra.run.smithi119.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-08-24T21:08:13.594 INFO:teuthology.orchestra.run.smithi119.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-08-24T21:08:13.594 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-24T21:08:13.594 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-24T21:08:13.594 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-24T21:08:13.594 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-24T21:08:13.594 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-24T21:08:13.594 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-24T21:08:13.594 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-24T21:08:13.594 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-24T21:08:13.594 INFO:teuthology.orchestra.run.smithi119.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-24T21:08:13.594 INFO:teuthology.orchestra.run.smithi119.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-24T21:08:13.595 INFO:teuthology.orchestra.run.smithi119.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-24T21:08:13.595 INFO:teuthology.orchestra.run.smithi119.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-24T21:08:13.595 INFO:teuthology.orchestra.run.smithi119.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-24T21:08:13.595 INFO:teuthology.orchestra.run.smithi119.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-24T21:08:13.595 INFO:teuthology.orchestra.run.smithi119.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-24T21:08:13.595 INFO:teuthology.orchestra.run.smithi119.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-24T21:08:13.595 INFO:teuthology.orchestra.run.smithi119.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-24T21:08:13.595 INFO:teuthology.orchestra.run.smithi119.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-24T21:08:13.595 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-24T21:08:13.595 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-24T21:08:13.595 INFO:teuthology.orchestra.run.smithi119.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-24T21:08:13.596 INFO:teuthology.orchestra.run.smithi119.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-24T21:08:13.596 INFO:teuthology.orchestra.run.smithi119.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-08-24T21:08:13.596 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-24T21:08:13.596 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-24T21:08:13.596 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-24T21:08:13.596 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-24T21:08:13.596 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-24T21:08:13.596 INFO:teuthology.orchestra.run.smithi119.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-24T21:08:13.596 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-24T21:08:13.596 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-24T21:08:13.596 INFO:teuthology.orchestra.run.smithi119.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-24T21:08:13.596 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-24T21:08:13.596 INFO:teuthology.orchestra.run.smithi119.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-24T21:08:13.597 INFO:teuthology.orchestra.run.smithi119.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-24T21:08:13.597 INFO:teuthology.orchestra.run.smithi119.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-24T21:08:13.597 INFO:teuthology.orchestra.run.smithi119.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-24T21:08:13.597 INFO:teuthology.orchestra.run.smithi119.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-24T21:08:13.597 INFO:teuthology.orchestra.run.smithi119.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-08-24T21:08:13.597 INFO:teuthology.orchestra.run.smithi119.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-24T21:08:13.597 INFO:teuthology.orchestra.run.smithi119.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-24T21:08:13.597 INFO:teuthology.orchestra.run.smithi119.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-24T21:08:13.597 INFO:teuthology.orchestra.run.smithi119.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-08-24T21:08:13.597 INFO:teuthology.orchestra.run.smithi119.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-08-24T21:08:13.597 INFO:teuthology.orchestra.run.smithi119.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-08-24T21:08:13.597 INFO:teuthology.orchestra.run.smithi119.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-24T21:08:13.598 INFO:teuthology.orchestra.run.smithi119.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-24T21:08:13.598 INFO:teuthology.orchestra.run.smithi119.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-24T21:08:13.598 INFO:teuthology.orchestra.run.smithi119.stdout:Installing weak dependencies: 2024-08-24T21:08:13.598 INFO:teuthology.orchestra.run.smithi119.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-08-24T21:08:13.598 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-24T21:08:13.598 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2024-08-24T21:08:13.598 INFO:teuthology.orchestra.run.smithi119.stdout:======================================================================================= 2024-08-24T21:08:13.598 INFO:teuthology.orchestra.run.smithi119.stdout:Install 125 Packages 2024-08-24T21:08:13.598 INFO:teuthology.orchestra.run.smithi119.stdout:Upgrade 2 Packages 2024-08-24T21:08:13.598 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-24T21:08:13.599 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 216 M 2024-08-24T21:08:13.599 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2024-08-24T21:08:13.640 INFO:teuthology.orchestra.run.smithi179.stdout:(2/127): ceph-fuse-19.0.0-5842.g4887e20f.el9.x8 1.4 MB/s | 901 kB 00:00 2024-08-24T21:08:13.748 INFO:teuthology.orchestra.run.smithi179.stdout:(3/127): ceph-immutable-object-cache-19.0.0-584 1.3 MB/s | 145 kB 00:00 2024-08-24T21:08:14.295 INFO:teuthology.orchestra.run.smithi060.stdout:(1/127): ceph-19.0.0-5842.g4887e20f.el9.x86_64. 21 kB/s | 6.6 kB 00:00 2024-08-24T21:08:14.393 INFO:teuthology.orchestra.run.smithi119.stdout:(1/127): ceph-19.0.0-5842.g4887e20f.el9.x86_64. 21 kB/s | 6.6 kB 00:00 2024-08-24T21:08:14.782 INFO:teuthology.orchestra.run.smithi179.stdout:(4/127): ceph-mds-19.0.0-5842.g4887e20f.el9.x86 2.3 MB/s | 2.4 MB 00:01 2024-08-24T21:08:14.891 INFO:teuthology.orchestra.run.smithi179.stdout:(5/127): ceph-base-19.0.0-5842.g4887e20f.el9.x8 2.4 MB/s | 5.5 MB 00:02 2024-08-24T21:08:15.170 INFO:teuthology.orchestra.run.smithi060.stdout:(2/127): ceph-fuse-19.0.0-5842.g4887e20f.el9.x8 1.0 MB/s | 901 kB 00:00 2024-08-24T21:08:15.320 INFO:teuthology.orchestra.run.smithi060.stdout:(3/127): ceph-immutable-object-cache-19.0.0-584 968 kB/s | 145 kB 00:00 2024-08-24T21:08:15.418 INFO:teuthology.orchestra.run.smithi179.stdout:(6/127): ceph-mgr-19.0.0-5842.g4887e20f.el9.x86 2.4 MB/s | 1.5 MB 00:00 2024-08-24T21:08:15.668 INFO:teuthology.orchestra.run.smithi119.stdout:(2/127): ceph-fuse-19.0.0-5842.g4887e20f.el9.x8 707 kB/s | 901 kB 00:01 2024-08-24T21:08:15.885 INFO:teuthology.orchestra.run.smithi119.stdout:(3/127): ceph-immutable-object-cache-19.0.0-584 668 kB/s | 145 kB 00:00 2024-08-24T21:08:16.125 INFO:teuthology.orchestra.run.smithi179.stdout:(7/127): ceph-common-19.0.0-5842.g4887e20f.el9. 6.2 MB/s | 22 MB 00:03 2024-08-24T21:08:16.325 INFO:teuthology.orchestra.run.smithi179.stdout:(8/127): ceph-mon-19.0.0-5842.g4887e20f.el9.x86 3.3 MB/s | 4.8 MB 00:01 2024-08-24T21:08:16.417 INFO:teuthology.orchestra.run.smithi179.stdout:(9/127): ceph-selinux-19.0.0-5842.g4887e20f.el9 276 kB/s | 25 kB 00:00 2024-08-24T21:08:16.770 INFO:teuthology.orchestra.run.smithi060.stdout:(4/127): ceph-mds-19.0.0-5842.g4887e20f.el9.x86 1.6 MB/s | 2.4 MB 00:01 2024-08-24T21:08:17.370 INFO:teuthology.orchestra.run.smithi060.stdout:(5/127): ceph-base-19.0.0-5842.g4887e20f.el9.x8 1.6 MB/s | 5.5 MB 00:03 2024-08-24T21:08:17.645 INFO:teuthology.orchestra.run.smithi060.stdout:(6/127): ceph-mgr-19.0.0-5842.g4887e20f.el9.x86 1.7 MB/s | 1.5 MB 00:00 2024-08-24T21:08:18.050 INFO:teuthology.orchestra.run.smithi179.stdout:(10/127): ceph-radosgw-19.0.0-5842.g4887e20f.el 5.7 MB/s | 11 MB 00:01 2024-08-24T21:08:18.119 INFO:teuthology.orchestra.run.smithi119.stdout:(4/127): ceph-mds-19.0.0-5842.g4887e20f.el9.x86 1.1 MB/s | 2.4 MB 00:02 2024-08-24T21:08:18.134 INFO:teuthology.orchestra.run.smithi179.stdout:(11/127): libcephfs-devel-19.0.0-5842.g4887e20f 382 kB/s | 32 kB 00:00 2024-08-24T21:08:18.292 INFO:teuthology.orchestra.run.smithi179.stdout:(12/127): libcephfs2-19.0.0-5842.g4887e20f.el9. 4.7 MB/s | 755 kB 00:00 2024-08-24T21:08:18.384 INFO:teuthology.orchestra.run.smithi179.stdout:(13/127): libcephsqlite-19.0.0-5842.g4887e20f.e 1.7 MB/s | 163 kB 00:00 2024-08-24T21:08:18.476 INFO:teuthology.orchestra.run.smithi179.stdout:(14/127): librados-devel-19.0.0-5842.g4887e20f. 1.3 MB/s | 127 kB 00:00 2024-08-24T21:08:18.651 INFO:teuthology.orchestra.run.smithi179.stdout:(15/127): libradosstriper1-19.0.0-5842.g4887e20 2.8 MB/s | 508 kB 00:00 2024-08-24T21:08:18.761 INFO:teuthology.orchestra.run.smithi119.stdout:(5/127): ceph-base-19.0.0-5842.g4887e20f.el9.x8 1.2 MB/s | 5.5 MB 00:04 2024-08-24T21:08:19.469 INFO:teuthology.orchestra.run.smithi119.stdout:(6/127): ceph-mgr-19.0.0-5842.g4887e20f.el9.x86 1.1 MB/s | 1.5 MB 00:01 2024-08-24T21:08:19.810 INFO:teuthology.orchestra.run.smithi179.stdout:(16/127): librgw2-19.0.0-5842.g4887e20f.el9.x86 4.8 MB/s | 5.5 MB 00:01 2024-08-24T21:08:19.812 INFO:teuthology.orchestra.run.smithi060.stdout:(7/127): ceph-mon-19.0.0-5842.g4887e20f.el9.x86 2.0 MB/s | 4.8 MB 00:02 2024-08-24T21:08:19.927 INFO:teuthology.orchestra.run.smithi179.stdout:(17/127): python3-ceph-argparse-19.0.0-5842.g48 387 kB/s | 45 kB 00:00 2024-08-24T21:08:20.019 INFO:teuthology.orchestra.run.smithi179.stdout:(18/127): python3-ceph-common-19.0.0-5842.g4887 1.5 MB/s | 138 kB 00:00 2024-08-24T21:08:20.111 INFO:teuthology.orchestra.run.smithi179.stdout:(19/127): python3-cephfs-19.0.0-5842.g4887e20f. 2.0 MB/s | 188 kB 00:00 2024-08-24T21:08:20.278 INFO:teuthology.orchestra.run.smithi179.stdout:(20/127): python3-rados-19.0.0-5842.g4887e20f.e 2.2 MB/s | 372 kB 00:00 2024-08-24T21:08:20.428 INFO:teuthology.orchestra.run.smithi179.stdout:(21/127): python3-rbd-19.0.0-5842.g4887e20f.el9 2.3 MB/s | 355 kB 00:00 2024-08-24T21:08:20.520 INFO:teuthology.orchestra.run.smithi179.stdout:(22/127): python3-rgw-19.0.0-5842.g4887e20f.el9 1.2 MB/s | 116 kB 00:00 2024-08-24T21:08:20.595 INFO:teuthology.orchestra.run.smithi179.stdout:(23/127): rbd-fuse-19.0.0-5842.g4887e20f.el9.x8 1.1 MB/s | 85 kB 00:00 2024-08-24T21:08:21.162 INFO:teuthology.orchestra.run.smithi179.stdout:(24/127): ceph-osd-19.0.0-5842.g4887e20f.el9.x8 3.0 MB/s | 17 MB 00:05 2024-08-24T21:08:21.262 INFO:teuthology.orchestra.run.smithi179.stdout:(25/127): rbd-nbd-19.0.0-5842.g4887e20f.el9.x86 1.7 MB/s | 170 kB 00:00 2024-08-24T21:08:21.388 INFO:teuthology.orchestra.run.smithi179.stdout:(26/127): ceph-grafana-dashboards-19.0.0-5842.g 274 kB/s | 34 kB 00:00 2024-08-24T21:08:21.455 INFO:teuthology.orchestra.run.smithi179.stdout:(27/127): rbd-mirror-19.0.0-5842.g4887e20f.el9. 3.7 MB/s | 3.2 MB 00:00 2024-08-24T21:08:21.480 INFO:teuthology.orchestra.run.smithi179.stdout:(28/127): ceph-mgr-cephadm-19.0.0-5842.g4887e20 1.6 MB/s | 150 kB 00:00 2024-08-24T21:08:21.686 INFO:teuthology.orchestra.run.smithi119.stdout:(7/127): ceph-mon-19.0.0-5842.g4887e20f.el9.x86 1.6 MB/s | 4.8 MB 00:02 2024-08-24T21:08:25.276 INFO:teuthology.orchestra.run.smithi179.stdout:(29/127): ceph-mgr-diskprediction-local-19.0.0- 2.0 MB/s | 7.4 MB 00:03 2024-08-24T21:08:25.738 INFO:teuthology.orchestra.run.smithi179.stdout:(30/127): ceph-mgr-modules-core-19.0.0-5842.g48 616 kB/s | 284 kB 00:00 2024-08-24T21:08:25.771 INFO:teuthology.orchestra.run.smithi060.stdout:(8/127): ceph-common-19.0.0-5842.g4887e20f.el9. 1.8 MB/s | 22 MB 00:11 2024-08-24T21:08:25.863 INFO:teuthology.orchestra.run.smithi060.stdout:(9/127): ceph-selinux-19.0.0-5842.g4887e20f.el9 276 kB/s | 25 kB 00:00 2024-08-24T21:08:25.872 INFO:teuthology.orchestra.run.smithi179.stdout:(31/127): ceph-mgr-rook-19.0.0-5842.g4887e20f.e 370 kB/s | 49 kB 00:00 2024-08-24T21:08:25.989 INFO:teuthology.orchestra.run.smithi179.stdout:(32/127): ceph-prometheus-alerts-19.0.0-5842.g4 141 kB/s | 16 kB 00:00 2024-08-24T21:08:26.239 INFO:teuthology.orchestra.run.smithi179.stdout:(33/127): ceph-volume-19.0.0-5842.g4887e20f.el9 1.1 MB/s | 285 kB 00:00 2024-08-24T21:08:26.580 INFO:teuthology.orchestra.run.smithi060.stdout:(10/127): ceph-radosgw-19.0.0-5842.g4887e20f.el 1.6 MB/s | 11 MB 00:06 2024-08-24T21:08:26.788 INFO:teuthology.orchestra.run.smithi060.stdout:(11/127): ceph-osd-19.0.0-5842.g4887e20f.el9.x8 1.9 MB/s | 17 MB 00:09 2024-08-24T21:08:26.805 INFO:teuthology.orchestra.run.smithi060.stdout:(12/127): libcephfs-devel-19.0.0-5842.g4887e20f 141 kB/s | 32 kB 00:00 2024-08-24T21:08:26.806 INFO:teuthology.orchestra.run.smithi179.stdout:(34/127): cephadm-19.0.0-5842.g4887e20f.el9.noa 1.3 MB/s | 772 kB 00:00 2024-08-24T21:08:26.956 INFO:teuthology.orchestra.run.smithi060.stdout:(13/127): libcephsqlite-19.0.0-5842.g4887e20f.e 1.1 MB/s | 163 kB 00:00 2024-08-24T21:08:27.039 INFO:teuthology.orchestra.run.smithi060.stdout:(14/127): librados-devel-19.0.0-5842.g4887e20f. 1.5 MB/s | 127 kB 00:00 2024-08-24T21:08:27.073 INFO:teuthology.orchestra.run.smithi179.stdout:(35/127): ceph-mgr-dashboard-19.0.0-5842.g4887e 2.5 MB/s | 14 MB 00:05 2024-08-24T21:08:27.099 INFO:teuthology.orchestra.run.smithi179.stdout:(36/127): fuse-2.9.9-16.el9.x86_64.rpm 274 kB/s | 80 kB 00:00 2024-08-24T21:08:27.164 INFO:teuthology.orchestra.run.smithi060.stdout:(15/127): libcephfs2-19.0.0-5842.g4887e20f.el9. 2.0 MB/s | 755 kB 00:00 2024-08-24T21:08:27.182 INFO:teuthology.orchestra.run.smithi179.stdout:(37/127): libquadmath-11.5.0-2.el9.x86_64.rpm 2.2 MB/s | 191 kB 00:00 2024-08-24T21:08:27.194 INFO:teuthology.orchestra.run.smithi119.stdout:(8/127): ceph-common-19.0.0-5842.g4887e20f.el9. 1.6 MB/s | 22 MB 00:13 2024-08-24T21:08:27.241 INFO:teuthology.orchestra.run.smithi179.stdout:(38/127): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.3 MB/s | 253 kB 00:00 2024-08-24T21:08:27.270 INFO:teuthology.orchestra.run.smithi119.stdout:(9/127): ceph-selinux-19.0.0-5842.g4887e20f.el9 337 kB/s | 25 kB 00:00 2024-08-24T21:08:27.281 INFO:teuthology.orchestra.run.smithi060.stdout:(16/127): libradosstriper1-19.0.0-5842.g4887e20 2.1 MB/s | 508 kB 00:00 2024-08-24T21:08:27.333 INFO:teuthology.orchestra.run.smithi179.stdout:(39/127): libgfortran-11.5.0-2.el9.x86_64.rpm 3.0 MB/s | 801 kB 00:00 2024-08-24T21:08:27.342 INFO:teuthology.orchestra.run.smithi060.stdout:(17/127): python3-ceph-argparse-19.0.0-5842.g48 747 kB/s | 45 kB 00:00 2024-08-24T21:08:27.375 INFO:teuthology.orchestra.run.smithi179.stdout:(40/127): python3-cryptography-36.0.1-4.el9.x86 9.2 MB/s | 1.2 MB 00:00 2024-08-24T21:08:27.400 INFO:teuthology.orchestra.run.smithi179.stdout:(41/127): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-08-24T21:08:27.417 INFO:teuthology.orchestra.run.smithi060.stdout:(18/127): python3-ceph-common-19.0.0-5842.g4887 1.8 MB/s | 138 kB 00:00 2024-08-24T21:08:27.425 INFO:teuthology.orchestra.run.smithi179.stdout:(42/127): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-08-24T21:08:27.459 INFO:teuthology.orchestra.run.smithi179.stdout:(43/127): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-08-24T21:08:27.484 INFO:teuthology.orchestra.run.smithi179.stdout:(44/127): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-08-24T21:08:27.510 INFO:teuthology.orchestra.run.smithi179.stdout:(45/127): boost-program-options-1.75.0-8.el9.x8 2.1 MB/s | 107 kB 00:00 2024-08-24T21:08:27.535 INFO:teuthology.orchestra.run.smithi179.stdout:(46/127): flexiblas-3.0.4-8.el9.x86_64.rpm 649 kB/s | 33 kB 00:00 2024-08-24T21:08:27.542 INFO:teuthology.orchestra.run.smithi060.stdout:(19/127): python3-cephfs-19.0.0-5842.g4887e20f. 1.5 MB/s | 188 kB 00:00 2024-08-24T21:08:27.585 INFO:teuthology.orchestra.run.smithi179.stdout:(47/127): flexiblas-openblas-openmp-3.0.4-8.el9 366 kB/s | 18 kB 00:00 2024-08-24T21:08:27.652 INFO:teuthology.orchestra.run.smithi179.stdout:(48/127): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.4 MB/s | 160 kB 00:00 2024-08-24T21:08:27.711 INFO:teuthology.orchestra.run.smithi179.stdout:(49/127): flexiblas-netlib-3.0.4-8.el9.x86_64.r 15 MB/s | 3.0 MB 00:00 2024-08-24T21:08:27.718 INFO:teuthology.orchestra.run.smithi060.stdout:(20/127): python3-rados-19.0.0-5842.g4887e20f.e 2.1 MB/s | 372 kB 00:00 2024-08-24T21:08:27.736 INFO:teuthology.orchestra.run.smithi179.stdout:(50/127): librabbitmq-0.11.0-7.el9.x86_64.rpm 539 kB/s | 45 kB 00:00 2024-08-24T21:08:27.770 INFO:teuthology.orchestra.run.smithi179.stdout:(51/127): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-08-24T21:08:27.795 INFO:teuthology.orchestra.run.smithi179.stdout:(52/127): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-08-24T21:08:27.837 INFO:teuthology.orchestra.run.smithi179.stdout:(53/127): lua-5.4.4-4.el9.x86_64.rpm 2.8 MB/s | 188 kB 00:00 2024-08-24T21:08:27.862 INFO:teuthology.orchestra.run.smithi179.stdout:(54/127): openblas-0.3.26-1.el9.x86_64.rpm 573 kB/s | 38 kB 00:00 2024-08-24T21:08:27.893 INFO:teuthology.orchestra.run.smithi060.stdout:(21/127): python3-rbd-19.0.0-5842.g4887e20f.el9 2.0 MB/s | 355 kB 00:00 2024-08-24T21:08:27.946 INFO:teuthology.orchestra.run.smithi179.stdout:(55/127): protobuf-3.14.0-13.el9.x86_64.rpm 12 MB/s | 1.0 MB 00:00 2024-08-24T21:08:27.985 INFO:teuthology.orchestra.run.smithi060.stdout:(22/127): python3-rgw-19.0.0-5842.g4887e20f.el9 1.2 MB/s | 116 kB 00:00 2024-08-24T21:08:28.030 INFO:teuthology.orchestra.run.smithi179.stdout:(56/127): openblas-openmp-0.3.26-1.el9.x86_64.r 26 MB/s | 4.9 MB 00:00 2024-08-24T21:08:28.052 INFO:teuthology.orchestra.run.smithi060.stdout:(23/127): rbd-fuse-19.0.0-5842.g4887e20f.el9.x8 1.2 MB/s | 85 kB 00:00 2024-08-24T21:08:28.071 INFO:teuthology.orchestra.run.smithi119.stdout:(10/127): ceph-radosgw-19.0.0-5842.g4887e20f.el 1.7 MB/s | 11 MB 00:06 2024-08-24T21:08:28.088 INFO:teuthology.orchestra.run.smithi179.stdout:(57/127): python3-devel-3.9.19-7.el9.x86_64.rpm 4.1 MB/s | 245 kB 00:00 2024-08-24T21:08:28.170 INFO:teuthology.orchestra.run.smithi119.stdout:(11/127): libcephfs-devel-19.0.0-5842.g4887e20f 323 kB/s | 32 kB 00:00 2024-08-24T21:08:28.180 INFO:teuthology.orchestra.run.smithi179.stdout:(58/127): python3-babel-2.9.1-2.el9.noarch.rpm 26 MB/s | 6.0 MB 00:00 2024-08-24T21:08:28.222 INFO:teuthology.orchestra.run.smithi179.stdout:(59/127): python3-jinja2-2.11.3-6.el9.noarch.rp 1.8 MB/s | 248 kB 00:00 2024-08-24T21:08:28.247 INFO:teuthology.orchestra.run.smithi179.stdout:(60/127): python3-jsonpatch-1.21-16.el9.noarch. 384 kB/s | 26 kB 00:00 2024-08-24T21:08:28.264 INFO:teuthology.orchestra.run.smithi179.stdout:(61/127): python3-jsonpointer-2.0-4.el9.noarch. 459 kB/s | 19 kB 00:00 2024-08-24T21:08:28.315 INFO:teuthology.orchestra.run.smithi179.stdout:(62/127): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-08-24T21:08:28.340 INFO:teuthology.orchestra.run.smithi179.stdout:(63/127): python3-markupsafe-1.1.1-12.el9.x86_6 460 kB/s | 35 kB 00:00 2024-08-24T21:08:28.415 INFO:teuthology.orchestra.run.smithi179.stdout:(64/127): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.3 MB/s | 250 kB 00:00 2024-08-24T21:08:28.491 INFO:teuthology.orchestra.run.smithi179.stdout:(65/127): python3-numpy-1.20.1-5.el9.x86_64.rpm 29 MB/s | 5.1 MB 00:00 2024-08-24T21:08:28.516 INFO:teuthology.orchestra.run.smithi179.stdout:(66/127): python3-oauthlib-3.1.1-5.el9.noarch.r 2.2 MB/s | 222 kB 00:00 2024-08-24T21:08:28.541 INFO:teuthology.orchestra.run.smithi179.stdout:(67/127): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-08-24T21:08:28.574 INFO:teuthology.orchestra.run.smithi179.stdout:(68/127): python3-prettytable-0.7.2-27.el9.noar 722 kB/s | 42 kB 00:00 2024-08-24T21:08:28.578 INFO:teuthology.orchestra.run.smithi119.stdout:(12/127): libcephfs2-19.0.0-5842.g4887e20f.el9. 1.8 MB/s | 755 kB 00:00 2024-08-24T21:08:28.600 INFO:teuthology.orchestra.run.smithi179.stdout:(69/127): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-08-24T21:08:28.633 INFO:teuthology.orchestra.run.smithi179.stdout:(70/127): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 159 kB 00:00 2024-08-24T21:08:28.659 INFO:teuthology.orchestra.run.smithi179.stdout:(71/127): python3-pyasn1-modules-0.4.8-6.el9.no 4.7 MB/s | 279 kB 00:00 2024-08-24T21:08:28.684 INFO:teuthology.orchestra.run.smithi179.stdout:(72/127): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-08-24T21:08:28.709 INFO:teuthology.orchestra.run.smithi179.stdout:(73/127): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-08-24T21:08:28.753 INFO:teuthology.orchestra.run.smithi119.stdout:(13/127): libcephsqlite-19.0.0-5842.g4887e20f.e 934 kB/s | 163 kB 00:00 2024-08-24T21:08:28.793 INFO:teuthology.orchestra.run.smithi179.stdout:(74/127): python3-toml-0.10.2-6.el9.noarch.rpm 499 kB/s | 42 kB 00:00 2024-08-24T21:08:28.852 INFO:teuthology.orchestra.run.smithi179.stdout:(75/127): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-08-24T21:08:28.862 INFO:teuthology.orchestra.run.smithi119.stdout:(14/127): librados-devel-19.0.0-5842.g4887e20f. 1.1 MB/s | 127 kB 00:00 2024-08-24T21:08:28.911 INFO:teuthology.orchestra.run.smithi179.stdout:(76/127): qatlib-service-24.02.0-1.el9.x86_64.r 617 kB/s | 36 kB 00:00 2024-08-24T21:08:28.969 INFO:teuthology.orchestra.run.smithi179.stdout:(77/127): qatzip-libs-1.2.0-1.el9.x86_64.rpm 817 kB/s | 47 kB 00:00 2024-08-24T21:08:29.136 INFO:teuthology.orchestra.run.smithi179.stdout:(78/127): python3-scipy-1.6.2-8.el9.x86_64.rpm 36 MB/s | 16 MB 00:00 2024-08-24T21:08:29.170 INFO:teuthology.orchestra.run.smithi179.stdout:(79/127): socat-1.7.4.1-6.el9.x86_64.rpm 1.5 MB/s | 304 kB 00:00 2024-08-24T21:08:29.195 INFO:teuthology.orchestra.run.smithi179.stdout:(80/127): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-08-24T21:08:29.229 INFO:teuthology.orchestra.run.smithi119.stdout:(15/127): libradosstriper1-19.0.0-5842.g4887e20 1.4 MB/s | 508 kB 00:00 2024-08-24T21:08:29.454 INFO:teuthology.orchestra.run.smithi179.stdout:(81/127): lua-devel-5.4.4-4.el9.x86_64.rpm 79 kB/s | 22 kB 00:00 2024-08-24T21:08:29.527 INFO:teuthology.orchestra.run.smithi060.stdout:(24/127): rbd-mirror-19.0.0-5842.g4887e20f.el9. 2.1 MB/s | 3.2 MB 00:01 2024-08-24T21:08:29.529 INFO:teuthology.orchestra.run.smithi179.stdout:(82/127): abseil-cpp-20211102.0-3.el9.x86_64.rp 7.1 MB/s | 548 kB 00:00 2024-08-24T21:08:29.571 INFO:teuthology.orchestra.run.smithi179.stdout:(83/127): gperftools-libs-2.9.1-2.el9.x86_64.rp 7.3 MB/s | 309 kB 00:00 2024-08-24T21:08:29.613 INFO:teuthology.orchestra.run.smithi179.stdout:(84/127): grpc-data-1.46.7-10.el9.noarch.rpm 469 kB/s | 19 kB 00:00 2024-08-24T21:08:29.647 INFO:teuthology.orchestra.run.smithi179.stdout:(85/127): protobuf-compiler-3.14.0-13.el9.x86_6 1.9 MB/s | 863 kB 00:00 2024-08-24T21:08:29.669 INFO:teuthology.orchestra.run.smithi060.stdout:(25/127): librgw2-19.0.0-5842.g4887e20f.el9.x86 2.2 MB/s | 5.5 MB 00:02 2024-08-24T21:08:29.714 INFO:teuthology.orchestra.run.smithi179.stdout:(86/127): libarrow-doc-9.0.0-11.el9.noarch.rpm 392 kB/s | 26 kB 00:00 2024-08-24T21:08:29.736 INFO:teuthology.orchestra.run.smithi060.stdout:(26/127): rbd-nbd-19.0.0-5842.g4887e20f.el9.x86 817 kB/s | 170 kB 00:00 2024-08-24T21:08:29.756 INFO:teuthology.orchestra.run.smithi179.stdout:(87/127): liboath-2.6.7-2.el9.x86_64.rpm 1.1 MB/s | 49 kB 00:00 2024-08-24T21:08:29.770 INFO:teuthology.orchestra.run.smithi060.stdout:(27/127): ceph-grafana-dashboards-19.0.0-5842.g 344 kB/s | 34 kB 00:00 2024-08-24T21:08:29.789 INFO:teuthology.orchestra.run.smithi179.stdout:(88/127): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-08-24T21:08:29.823 INFO:teuthology.orchestra.run.smithi179.stdout:(89/127): luarocks-3.9.2-5.el9.noarch.rpm 4.5 MB/s | 151 kB 00:00 2024-08-24T21:08:29.837 INFO:teuthology.orchestra.run.smithi060.stdout:(28/127): ceph-mgr-cephadm-19.0.0-5842.g4887e20 1.5 MB/s | 150 kB 00:00 2024-08-24T21:08:29.865 INFO:teuthology.orchestra.run.smithi179.stdout:(90/127): parquet-libs-9.0.0-11.el9.x86_64.rpm 20 MB/s | 839 kB 00:00 2024-08-24T21:08:29.891 INFO:teuthology.orchestra.run.smithi179.stdout:(91/127): pv-1.6.20-1.el9.x86_64.rpm 2.5 MB/s | 65 kB 00:00 2024-08-24T21:08:29.924 INFO:teuthology.orchestra.run.smithi179.stdout:(92/127): python3-asyncssh-2.13.2-5.el9.noarch. 16 MB/s | 548 kB 00:00 2024-08-24T21:08:30.011 INFO:teuthology.orchestra.run.smithi179.stdout:(93/127): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-08-24T21:08:30.058 INFO:teuthology.orchestra.run.smithi179.stdout:(94/127): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 325 kB/s | 43 kB 00:00 2024-08-24T21:08:30.100 INFO:teuthology.orchestra.run.smithi179.stdout:(95/127): python3-cachetools-4.2.4-1.el9.noarch 365 kB/s | 32 kB 00:00 2024-08-24T21:08:30.142 INFO:teuthology.orchestra.run.smithi179.stdout:(96/127): python3-certifi-2023.05.07-4.el9.noar 169 kB/s | 14 kB 00:00 2024-08-24T21:08:30.167 INFO:teuthology.orchestra.run.smithi179.stdout:(97/127): python3-cheroot-8.6.0-4.el9.noarch.rp 2.5 MB/s | 172 kB 00:00 2024-08-24T21:08:30.201 INFO:teuthology.orchestra.run.smithi179.stdout:(98/127): python3-cherrypy-18.6.1-2.el9.noarch. 6.0 MB/s | 358 kB 00:00 2024-08-24T21:08:30.235 INFO:teuthology.orchestra.run.smithi179.stdout:(99/127): python3-google-auth-2.33.0-1.el9.noar 3.2 MB/s | 220 kB 00:00 2024-08-24T21:08:30.260 INFO:teuthology.orchestra.run.smithi179.stdout:(100/127): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-08-24T21:08:30.310 INFO:teuthology.orchestra.run.smithi179.stdout:(101/127): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-08-24T21:08:30.361 INFO:teuthology.orchestra.run.smithi179.stdout:(102/127): python3-jaraco-classes-3.2.1-5.el9.n 355 kB/s | 18 kB 00:00 2024-08-24T21:08:30.411 INFO:teuthology.orchestra.run.smithi179.stdout:(103/127): python3-jaraco-collections-3.0.0-8.e 463 kB/s | 23 kB 00:00 2024-08-24T21:08:30.461 INFO:teuthology.orchestra.run.smithi179.stdout:(104/127): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-08-24T21:08:30.512 INFO:teuthology.orchestra.run.smithi179.stdout:(105/127): python3-jaraco-text-3.2.0-6.el9.noar 395 kB/s | 20 kB 00:00 2024-08-24T21:08:30.583 INFO:teuthology.orchestra.run.smithi179.stdout:(106/127): python3-kubernetes-26.1.0-2.el9.noar 15 MB/s | 1.0 MB 00:00 2024-08-24T21:08:30.637 INFO:teuthology.orchestra.run.smithi179.stdout:(107/127): python3-logutils-0.3.5-21.el9.noarch 851 kB/s | 46 kB 00:00 2024-08-24T21:08:30.663 INFO:teuthology.orchestra.run.smithi179.stdout:(108/127): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-08-24T21:08:30.713 INFO:teuthology.orchestra.run.smithi179.stdout:(109/127): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-08-24T21:08:30.763 INFO:teuthology.orchestra.run.smithi179.stdout:(110/127): python3-grpcio-1.46.7-10.el9.x86_64. 3.6 MB/s | 2.0 MB 00:00 2024-08-24T21:08:30.814 INFO:teuthology.orchestra.run.smithi179.stdout:(111/127): python3-portend-3.1.0-2.el9.noarch.r 330 kB/s | 16 kB 00:00 2024-08-24T21:08:30.839 INFO:teuthology.orchestra.run.smithi179.stdout:(112/127): python3-pecan-1.4.2-3.el9.noarch.rpm 2.1 MB/s | 272 kB 00:00 2024-08-24T21:08:30.864 INFO:teuthology.orchestra.run.smithi179.stdout:(113/127): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-08-24T21:08:30.906 INFO:teuthology.orchestra.run.smithi179.stdout:(114/127): python3-repoze-lru-0.7-16.el9.noarch 463 kB/s | 31 kB 00:00 2024-08-24T21:08:30.957 INFO:teuthology.orchestra.run.smithi179.stdout:(115/127): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-08-24T21:08:31.007 INFO:teuthology.orchestra.run.smithi179.stdout:(116/127): python3-tempora-5.0.0-2.el9.noarch.r 721 kB/s | 36 kB 00:00 2024-08-24T21:08:31.032 INFO:teuthology.orchestra.run.smithi179.stdout:(117/127): python3-routes-2.5.1-5.el9.noarch.rp 1.1 MB/s | 188 kB 00:00 2024-08-24T21:08:31.058 INFO:teuthology.orchestra.run.smithi179.stdout:(118/127): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-08-24T21:08:31.083 INFO:teuthology.orchestra.run.smithi179.stdout:(119/127): python3-webob-1.8.7-6.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-08-24T21:08:31.108 INFO:teuthology.orchestra.run.smithi179.stdout:(120/127): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-08-24T21:08:31.175 INFO:teuthology.orchestra.run.smithi179.stdout:(121/127): python3-zc-lockfile-2.0-10.el9.noarc 300 kB/s | 20 kB 00:00 2024-08-24T21:08:31.200 INFO:teuthology.orchestra.run.smithi179.stdout:(122/127): re2-20211101-3.el9.x86_64.rpm 7.6 MB/s | 192 kB 00:00 2024-08-24T21:08:31.226 INFO:teuthology.orchestra.run.smithi179.stdout:(123/127): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2024-08-24T21:08:31.229 INFO:teuthology.orchestra.run.smithi119.stdout:(16/127): ceph-osd-19.0.0-5842.g4887e20f.el9.x8 1.5 MB/s | 17 MB 00:11 2024-08-24T21:08:31.276 INFO:teuthology.orchestra.run.smithi179.stdout:(124/127): thrift-0.15.0-2.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-08-24T21:08:31.330 INFO:teuthology.orchestra.run.smithi119.stdout:(17/127): python3-ceph-argparse-19.0.0-5842.g48 454 kB/s | 45 kB 00:00 2024-08-24T21:08:31.530 INFO:teuthology.orchestra.run.smithi119.stdout:(18/127): python3-ceph-common-19.0.0-5842.g4887 692 kB/s | 138 kB 00:00 2024-08-24T21:08:31.939 INFO:teuthology.orchestra.run.smithi119.stdout:(19/127): python3-cephfs-19.0.0-5842.g4887e20f. 460 kB/s | 188 kB 00:00 2024-08-24T21:08:32.197 INFO:teuthology.orchestra.run.smithi119.stdout:(20/127): librgw2-19.0.0-5842.g4887e20f.el9.x86 1.9 MB/s | 5.5 MB 00:02 2024-08-24T21:08:32.364 INFO:teuthology.orchestra.run.smithi119.stdout:(21/127): python3-rados-19.0.0-5842.g4887e20f.e 876 kB/s | 372 kB 00:00 2024-08-24T21:08:32.464 INFO:teuthology.orchestra.run.smithi119.stdout:(22/127): python3-rbd-19.0.0-5842.g4887e20f.el9 1.3 MB/s | 355 kB 00:00 2024-08-24T21:08:32.548 INFO:teuthology.orchestra.run.smithi119.stdout:(23/127): python3-rgw-19.0.0-5842.g4887e20f.el9 633 kB/s | 116 kB 00:00 2024-08-24T21:08:32.573 INFO:teuthology.orchestra.run.smithi119.stdout:(24/127): rbd-fuse-19.0.0-5842.g4887e20f.el9.x8 785 kB/s | 85 kB 00:00 2024-08-24T21:08:32.732 INFO:teuthology.orchestra.run.smithi119.stdout:(25/127): rbd-nbd-19.0.0-5842.g4887e20f.el9.x86 1.1 MB/s | 170 kB 00:00 2024-08-24T21:08:32.824 INFO:teuthology.orchestra.run.smithi119.stdout:(26/127): ceph-grafana-dashboards-19.0.0-5842.g 375 kB/s | 34 kB 00:00 2024-08-24T21:08:32.862 INFO:teuthology.orchestra.run.smithi060.stdout:(29/127): ceph-mgr-diskprediction-local-19.0.0- 2.4 MB/s | 7.4 MB 00:03 2024-08-24T21:08:32.916 INFO:teuthology.orchestra.run.smithi119.stdout:(27/127): ceph-mgr-cephadm-19.0.0-5842.g4887e20 1.6 MB/s | 150 kB 00:00 2024-08-24T21:08:32.962 INFO:teuthology.orchestra.run.smithi179.stdout:(125/127): librbd1-19.0.0-5842.g4887e20f.el9.x8 1.9 MB/s | 3.2 MB 00:01 2024-08-24T21:08:33.012 INFO:teuthology.orchestra.run.smithi060.stdout:(30/127): ceph-mgr-modules-core-19.0.0-5842.g48 1.9 MB/s | 284 kB 00:00 2024-08-24T21:08:33.114 INFO:teuthology.orchestra.run.smithi060.stdout:(31/127): ceph-mgr-rook-19.0.0-5842.g4887e20f.e 488 kB/s | 49 kB 00:00 2024-08-24T21:08:33.204 INFO:teuthology.orchestra.run.smithi060.stdout:(32/127): ceph-prometheus-alerts-19.0.0-5842.g4 183 kB/s | 16 kB 00:00 2024-08-24T21:08:33.246 INFO:teuthology.orchestra.run.smithi179.stdout:(126/127): librados2-19.0.0-5842.g4887e20f.el9. 1.7 MB/s | 3.5 MB 00:02 2024-08-24T21:08:33.355 INFO:teuthology.orchestra.run.smithi060.stdout:(33/127): ceph-volume-19.0.0-5842.g4887e20f.el9 1.9 MB/s | 285 kB 00:00 2024-08-24T21:08:33.655 INFO:teuthology.orchestra.run.smithi060.stdout:(34/127): cephadm-19.0.0-5842.g4887e20f.el9.noa 2.5 MB/s | 772 kB 00:00 2024-08-24T21:08:34.014 INFO:teuthology.orchestra.run.smithi060.stdout:(35/127): fuse-2.9.9-16.el9.x86_64.rpm 223 kB/s | 80 kB 00:00 2024-08-24T21:08:34.380 INFO:teuthology.orchestra.run.smithi060.stdout:(36/127): libgfortran-11.5.0-2.el9.x86_64.rpm 2.1 MB/s | 801 kB 00:00 2024-08-24T21:08:34.433 INFO:teuthology.orchestra.run.smithi119.stdout:(28/127): ceph-test-19.0.0-5842.g4887e20f.el9.x 7.0 MB/s | 50 MB 00:07 2024-08-24T21:08:34.489 INFO:teuthology.orchestra.run.smithi060.stdout:(37/127): libquadmath-11.5.0-2.el9.x86_64.rpm 1.7 MB/s | 191 kB 00:00 2024-08-24T21:08:34.579 INFO:teuthology.orchestra.run.smithi179.stdout:(127/127): ceph-test-19.0.0-5842.g4887e20f.el9. 2.8 MB/s | 50 MB 00:18 2024-08-24T21:08:34.586 INFO:teuthology.orchestra.run.smithi179.stdout:-------------------------------------------------------------------------------- 2024-08-24T21:08:34.586 INFO:teuthology.orchestra.run.smithi179.stdout:Total 9.6 MB/s | 216 MB 00:22 2024-08-24T21:08:34.597 INFO:teuthology.orchestra.run.smithi060.stdout:(38/127): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2024-08-24T21:08:34.814 INFO:teuthology.orchestra.run.smithi060.stdout:(39/127): python3-cryptography-36.0.1-4.el9.x86 5.7 MB/s | 1.2 MB 00:00 2024-08-24T21:08:34.923 INFO:teuthology.orchestra.run.smithi060.stdout:(40/127): python3-ply-3.11-14.el9.noarch.rpm 984 kB/s | 106 kB 00:00 2024-08-24T21:08:35.032 INFO:teuthology.orchestra.run.smithi060.stdout:(41/127): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 135 kB 00:00 2024-08-24T21:08:35.141 INFO:teuthology.orchestra.run.smithi060.stdout:(42/127): python3-requests-2.25.1-8.el9.noarch. 1.1 MB/s | 125 kB 00:00 2024-08-24T21:08:35.250 INFO:teuthology.orchestra.run.smithi060.stdout:(43/127): python3-urllib3-1.26.5-6.el9.noarch.r 1.9 MB/s | 215 kB 00:00 2024-08-24T21:08:35.291 INFO:teuthology.orchestra.run.smithi119.stdout:(29/127): rbd-mirror-19.0.0-5842.g4887e20f.el9. 1.2 MB/s | 3.2 MB 00:02 2024-08-24T21:08:35.358 INFO:teuthology.orchestra.run.smithi060.stdout:(44/127): boost-program-options-1.75.0-8.el9.x8 991 kB/s | 107 kB 00:00 2024-08-24T21:08:35.425 INFO:teuthology.orchestra.run.smithi060.stdout:(45/127): flexiblas-3.0.4-8.el9.x86_64.rpm 492 kB/s | 33 kB 00:00 2024-08-24T21:08:35.483 INFO:teuthology.orchestra.run.smithi119.stdout:(30/127): ceph-mgr-modules-core-19.0.0-5842.g48 1.5 MB/s | 284 kB 00:00 2024-08-24T21:08:35.575 INFO:teuthology.orchestra.run.smithi060.stdout:(46/127): flexiblas-netlib-3.0.4-8.el9.x86_64.r 20 MB/s | 3.0 MB 00:00 2024-08-24T21:08:35.583 INFO:teuthology.orchestra.run.smithi119.stdout:(31/127): ceph-mgr-rook-19.0.0-5842.g4887e20f.e 494 kB/s | 49 kB 00:00 2024-08-24T21:08:35.642 INFO:teuthology.orchestra.run.smithi060.stdout:(47/127): flexiblas-openblas-openmp-3.0.4-8.el9 274 kB/s | 18 kB 00:00 2024-08-24T21:08:35.667 INFO:teuthology.orchestra.run.smithi119.stdout:(32/127): ceph-mgr-diskprediction-local-19.0.0- 6.0 MB/s | 7.4 MB 00:01 2024-08-24T21:08:35.676 INFO:teuthology.orchestra.run.smithi060.stdout:(48/127): libpmemobj-1.12.1-1.el9.x86_64.rpm 4.7 MB/s | 160 kB 00:00 2024-08-24T21:08:35.709 INFO:teuthology.orchestra.run.smithi119.stdout:(33/127): ceph-prometheus-alerts-19.0.0-5842.g4 131 kB/s | 16 kB 00:00 2024-08-24T21:08:35.719 INFO:teuthology.orchestra.run.smithi060.stdout:(49/127): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-08-24T21:08:35.777 INFO:teuthology.orchestra.run.smithi060.stdout:(50/127): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 662 kB 00:00 2024-08-24T21:08:35.782 INFO:teuthology.orchestra.run.smithi119.stdout:(34/127): ceph-volume-19.0.0-5842.g4887e20f.el9 2.5 MB/s | 285 kB 00:00 2024-08-24T21:08:35.810 INFO:teuthology.orchestra.run.smithi060.stdout:(51/127): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.9 MB/s | 292 kB 00:00 2024-08-24T21:08:35.844 INFO:teuthology.orchestra.run.smithi060.stdout:(52/127): lua-5.4.4-4.el9.x86_64.rpm 5.6 MB/s | 188 kB 00:00 2024-08-24T21:08:35.893 INFO:teuthology.orchestra.run.smithi119.stdout:(35/127): fuse-2.9.9-16.el9.x86_64.rpm 702 kB/s | 80 kB 00:00 2024-08-24T21:08:35.894 INFO:teuthology.orchestra.run.smithi060.stdout:(53/127): openblas-0.3.26-1.el9.x86_64.rpm 769 kB/s | 38 kB 00:00 2024-08-24T21:08:35.929 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction check 2024-08-24T21:08:36.018 INFO:teuthology.orchestra.run.smithi119.stdout:(36/127): libgfortran-11.5.0-2.el9.x86_64.rpm 6.3 MB/s | 801 kB 00:00 2024-08-24T21:08:36.020 INFO:teuthology.orchestra.run.smithi060.stdout:(54/127): openblas-openmp-0.3.26-1.el9.x86_64.r 40 MB/s | 4.9 MB 00:00 2024-08-24T21:08:36.054 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction check succeeded. 2024-08-24T21:08:36.054 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction test 2024-08-24T21:08:36.102 INFO:teuthology.orchestra.run.smithi119.stdout:(37/127): libquadmath-11.5.0-2.el9.x86_64.rpm 2.2 MB/s | 191 kB 00:00 2024-08-24T21:08:36.185 INFO:teuthology.orchestra.run.smithi119.stdout:(38/127): cephadm-19.0.0-5842.g4887e20f.el9.noa 1.6 MB/s | 772 kB 00:00 2024-08-24T21:08:36.211 INFO:teuthology.orchestra.run.smithi119.stdout:(39/127): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2024-08-24T21:08:36.286 INFO:teuthology.orchestra.run.smithi119.stdout:(40/127): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-08-24T21:08:36.428 INFO:teuthology.orchestra.run.smithi119.stdout:(41/127): python3-pycparser-2.20-6.el9.noarch.r 955 kB/s | 135 kB 00:00 2024-08-24T21:08:36.470 INFO:teuthology.orchestra.run.smithi119.stdout:(42/127): python3-cryptography-36.0.1-4.el9.x86 4.3 MB/s | 1.2 MB 00:00 2024-08-24T21:08:36.495 INFO:teuthology.orchestra.run.smithi060.stdout:(55/127): ceph-test-19.0.0-5842.g4887e20f.el9.x 4.7 MB/s | 50 MB 00:10 2024-08-24T21:08:36.537 INFO:teuthology.orchestra.run.smithi060.stdout:(56/127): protobuf-3.14.0-13.el9.x86_64.rpm 2.0 MB/s | 1.0 MB 00:00 2024-08-24T21:08:36.554 INFO:teuthology.orchestra.run.smithi119.stdout:(43/127): python3-requests-2.25.1-8.el9.noarch. 999 kB/s | 125 kB 00:00 2024-08-24T21:08:36.579 INFO:teuthology.orchestra.run.smithi060.stdout:(57/127): python3-devel-3.9.19-7.el9.x86_64.rpm 5.8 MB/s | 245 kB 00:00 2024-08-24T21:08:36.579 INFO:teuthology.orchestra.run.smithi119.stdout:(44/127): python3-urllib3-1.26.5-6.el9.noarch.r 1.9 MB/s | 215 kB 00:00 2024-08-24T21:08:36.621 INFO:teuthology.orchestra.run.smithi060.stdout:(58/127): python3-jinja2-2.11.3-6.el9.noarch.rp 5.8 MB/s | 248 kB 00:00 2024-08-24T21:08:36.663 INFO:teuthology.orchestra.run.smithi060.stdout:(59/127): python3-jsonpatch-1.21-16.el9.noarch. 618 kB/s | 26 kB 00:00 2024-08-24T21:08:36.679 INFO:teuthology.orchestra.run.smithi119.stdout:(45/127): flexiblas-3.0.4-8.el9.x86_64.rpm 367 kB/s | 33 kB 00:00 2024-08-24T21:08:36.704 INFO:teuthology.orchestra.run.smithi119.stdout:(46/127): boost-program-options-1.75.0-8.el9.x8 711 kB/s | 107 kB 00:00 2024-08-24T21:08:36.805 INFO:teuthology.orchestra.run.smithi119.stdout:(47/127): flexiblas-openblas-openmp-3.0.4-8.el9 205 kB/s | 18 kB 00:00 2024-08-24T21:08:36.805 INFO:teuthology.orchestra.run.smithi060.stdout:(60/127): python3-jsonpointer-2.0-4.el9.noarch. 135 kB/s | 19 kB 00:00 2024-08-24T21:08:36.838 INFO:teuthology.orchestra.run.smithi060.stdout:(61/127): python3-mako-1.1.4-6.el9.noarch.rpm 5.1 MB/s | 172 kB 00:00 2024-08-24T21:08:36.930 INFO:teuthology.orchestra.run.smithi060.stdout:(62/127): python3-babel-2.9.1-2.el9.noarch.rpm 14 MB/s | 6.0 MB 00:00 2024-08-24T21:08:36.947 INFO:teuthology.orchestra.run.smithi060.stdout:(63/127): python3-markupsafe-1.1.1-12.el9.x86_6 321 kB/s | 35 kB 00:00 2024-08-24T21:08:36.987 INFO:teuthology.orchestra.run.smithi119.stdout:(48/127): libpmemobj-1.12.1-1.el9.x86_64.rpm 883 kB/s | 160 kB 00:00 2024-08-24T21:08:36.998 INFO:teuthology.orchestra.run.smithi060.stdout:(64/127): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.9 MB/s | 250 kB 00:00 2024-08-24T21:08:37.072 INFO:teuthology.orchestra.run.smithi119.stdout:(49/127): flexiblas-netlib-3.0.4-8.el9.x86_64.r 7.6 MB/s | 3.0 MB 00:00 2024-08-24T21:08:37.090 INFO:teuthology.orchestra.run.smithi060.stdout:(65/127): python3-numpy-1.20.1-5.el9.x86_64.rpm 32 MB/s | 5.1 MB 00:00 2024-08-24T21:08:37.139 INFO:teuthology.orchestra.run.smithi119.stdout:(50/127): librabbitmq-0.11.0-7.el9.x86_64.rpm 299 kB/s | 45 kB 00:00 2024-08-24T21:08:37.239 INFO:teuthology.orchestra.run.smithi119.stdout:(51/127): librdkafka-1.6.1-102.el9.x86_64.rpm 3.9 MB/s | 662 kB 00:00 2024-08-24T21:08:37.240 INFO:teuthology.orchestra.run.smithi060.stdout:(66/127): ceph-mgr-dashboard-19.0.0-5842.g4887e 1.9 MB/s | 14 MB 00:07 2024-08-24T21:08:37.264 INFO:teuthology.orchestra.run.smithi119.stdout:(52/127): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.3 MB/s | 292 kB 00:00 2024-08-24T21:08:37.265 INFO:teuthology.orchestra.run.smithi060.stdout:(67/127): python3-packaging-20.9-5.el9.noarch.r 441 kB/s | 77 kB 00:00 2024-08-24T21:08:37.290 INFO:teuthology.orchestra.run.smithi060.stdout:(68/127): python3-oauthlib-3.1.1-5.el9.noarch.r 760 kB/s | 222 kB 00:00 2024-08-24T21:08:37.316 INFO:teuthology.orchestra.run.smithi060.stdout:(69/127): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-08-24T21:08:37.341 INFO:teuthology.orchestra.run.smithi060.stdout:(70/127): python3-prettytable-0.7.2-27.el9.noar 420 kB/s | 42 kB 00:00 2024-08-24T21:08:37.366 INFO:teuthology.orchestra.run.smithi060.stdout:(71/127): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-08-24T21:08:37.392 INFO:teuthology.orchestra.run.smithi060.stdout:(72/127): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-08-24T21:08:37.417 INFO:teuthology.orchestra.run.smithi060.stdout:(73/127): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-08-24T21:08:37.443 INFO:teuthology.orchestra.run.smithi060.stdout:(74/127): python3-pyasn1-modules-0.4.8-6.el9.no 2.2 MB/s | 279 kB 00:00 2024-08-24T21:08:37.465 INFO:teuthology.orchestra.run.smithi119.stdout:(53/127): ceph-mgr-dashboard-19.0.0-5842.g4887e 3.1 MB/s | 14 MB 00:04 2024-08-24T21:08:37.468 INFO:teuthology.orchestra.run.smithi060.stdout:(75/127): python3-toml-0.10.2-6.el9.noarch.rpm 832 kB/s | 42 kB 00:00 2024-08-24T21:08:37.493 INFO:teuthology.orchestra.run.smithi060.stdout:(76/127): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-08-24T21:08:37.515 INFO:teuthology.orchestra.run.smithi119.stdout:(54/127): lua-5.4.4-4.el9.x86_64.rpm 684 kB/s | 188 kB 00:00 2024-08-24T21:08:37.518 INFO:teuthology.orchestra.run.smithi060.stdout:(77/127): qatlib-service-24.02.0-1.el9.x86_64.r 720 kB/s | 36 kB 00:00 2024-08-24T21:08:37.544 INFO:teuthology.orchestra.run.smithi060.stdout:(78/127): qatzip-libs-1.2.0-1.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-08-24T21:08:37.566 INFO:teuthology.orchestra.run.smithi119.stdout:(55/127): openblas-0.3.26-1.el9.x86_64.rpm 132 kB/s | 38 kB 00:00 2024-08-24T21:08:37.569 INFO:teuthology.orchestra.run.smithi060.stdout:(79/127): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-08-24T21:08:37.611 INFO:teuthology.orchestra.run.smithi060.stdout:(80/127): xmlstarlet-1.6.1-20.el9.x86_64.rpm 957 kB/s | 64 kB 00:00 2024-08-24T21:08:37.703 INFO:teuthology.orchestra.run.smithi060.stdout:(81/127): lua-devel-5.4.4-4.el9.x86_64.rpm 167 kB/s | 22 kB 00:00 2024-08-24T21:08:37.716 INFO:teuthology.orchestra.run.smithi119.stdout:(56/127): protobuf-3.14.0-13.el9.x86_64.rpm 5.1 MB/s | 1.0 MB 00:00 2024-08-24T21:08:37.761 INFO:teuthology.orchestra.run.smithi060.stdout:(82/127): abseil-cpp-20211102.0-3.el9.x86_64.rp 9.2 MB/s | 548 kB 00:00 2024-08-24T21:08:37.795 INFO:teuthology.orchestra.run.smithi060.stdout:(83/127): gperftools-libs-2.9.1-2.el9.x86_64.rp 9.1 MB/s | 309 kB 00:00 2024-08-24T21:08:37.820 INFO:teuthology.orchestra.run.smithi060.stdout:(84/127): grpc-data-1.46.7-10.el9.noarch.rpm 789 kB/s | 19 kB 00:00 2024-08-24T21:08:37.833 INFO:teuthology.orchestra.run.smithi119.stdout:(57/127): python3-devel-3.9.19-7.el9.x86_64.rpm 2.1 MB/s | 245 kB 00:00 2024-08-24T21:08:37.854 INFO:teuthology.orchestra.run.smithi060.stdout:(85/127): protobuf-compiler-3.14.0-13.el9.x86_6 3.5 MB/s | 863 kB 00:00 2024-08-24T21:08:37.908 INFO:teuthology.orchestra.run.smithi119.stdout:(58/127): openblas-openmp-0.3.26-1.el9.x86_64.r 11 MB/s | 4.9 MB 00:00 2024-08-24T21:08:38.025 INFO:teuthology.orchestra.run.smithi119.stdout:(59/127): python3-babel-2.9.1-2.el9.noarch.rpm 13 MB/s | 6.0 MB 00:00 2024-08-24T21:08:38.041 INFO:teuthology.orchestra.run.smithi119.stdout:(60/127): python3-jsonpatch-1.21-16.el9.noarch. 207 kB/s | 26 kB 00:00 2024-08-24T21:08:38.062 INFO:teuthology.orchestra.run.smithi060.stdout:(86/127): python3-scipy-1.6.2-8.el9.x86_64.rpm 24 MB/s | 16 MB 00:00 2024-08-24T21:08:38.101 INFO:teuthology.orchestra.run.smithi119.stdout:(61/127): python3-jinja2-2.11.3-6.el9.noarch.rp 928 kB/s | 248 kB 00:00 2024-08-24T21:08:38.104 INFO:teuthology.orchestra.run.smithi060.stdout:(87/127): libarrow-doc-9.0.0-11.el9.noarch.rpm 104 kB/s | 26 kB 00:00 2024-08-24T21:08:38.138 INFO:teuthology.orchestra.run.smithi060.stdout:(88/127): libunwind-1.6.2-1.el9.x86_64.rpm 2.1 MB/s | 67 kB 00:00 2024-08-24T21:08:38.151 INFO:teuthology.orchestra.run.smithi119.stdout:(62/127): python3-jsonpointer-2.0-4.el9.noarch. 153 kB/s | 19 kB 00:00 2024-08-24T21:08:38.164 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction test succeeded. 2024-08-24T21:08:38.164 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction 2024-08-24T21:08:38.192 INFO:teuthology.orchestra.run.smithi060.stdout:(89/127): liboath-2.6.7-2.el9.x86_64.rpm 382 kB/s | 49 kB 00:00 2024-08-24T21:08:38.209 INFO:teuthology.orchestra.run.smithi119.stdout:(63/127): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-08-24T21:08:38.235 INFO:teuthology.orchestra.run.smithi119.stdout:(64/127): python3-markupsafe-1.1.1-12.el9.x86_6 262 kB/s | 35 kB 00:00 2024-08-24T21:08:38.279 INFO:teuthology.orchestra.run.smithi060.stdout:(90/127): luarocks-3.9.2-5.el9.noarch.rpm 1.1 MB/s | 151 kB 00:00 2024-08-24T21:08:38.314 INFO:teuthology.orchestra.run.smithi060.stdout:(91/127): pv-1.6.20-1.el9.x86_64.rpm 1.9 MB/s | 65 kB 00:00 2024-08-24T21:08:38.335 INFO:teuthology.orchestra.run.smithi119.stdout:(65/127): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.0 MB/s | 250 kB 00:00 2024-08-24T21:08:38.360 INFO:teuthology.orchestra.run.smithi119.stdout:(66/127): python3-oauthlib-3.1.1-5.el9.noarch.r 1.9 MB/s | 222 kB 00:00 2024-08-24T21:08:38.364 INFO:teuthology.orchestra.run.smithi060.stdout:(92/127): python3-asyncssh-2.13.2-5.el9.noarch. 11 MB/s | 548 kB 00:00 2024-08-24T21:08:38.389 INFO:teuthology.orchestra.run.smithi060.stdout:(93/127): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.7 MB/s | 43 kB 00:00 2024-08-24T21:08:38.431 INFO:teuthology.orchestra.run.smithi060.stdout:(94/127): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.4 MB/s | 839 kB 00:00 2024-08-24T21:08:38.452 INFO:teuthology.orchestra.run.smithi119.stdout:(67/127): python3-packaging-20.9-5.el9.noarch.r 660 kB/s | 77 kB 00:00 2024-08-24T21:08:38.456 INFO:teuthology.orchestra.run.smithi060.stdout:(95/127): python3-cachetools-4.2.4-1.el9.noarch 483 kB/s | 32 kB 00:00 2024-08-24T21:08:38.477 INFO:teuthology.orchestra.run.smithi119.stdout:(68/127): python3-prettytable-0.7.2-27.el9.noar 394 kB/s | 42 kB 00:00 2024-08-24T21:08:38.482 INFO:teuthology.orchestra.run.smithi060.stdout:(96/127): python3-certifi-2023.05.07-4.el9.noar 568 kB/s | 14 kB 00:00 2024-08-24T21:08:38.515 INFO:teuthology.orchestra.run.smithi060.stdout:(97/127): python3-cheroot-8.6.0-4.el9.noarch.rp 2.9 MB/s | 172 kB 00:00 2024-08-24T21:08:38.549 INFO:teuthology.orchestra.run.smithi060.stdout:(98/127): python3-cherrypy-18.6.1-2.el9.noarch. 5.2 MB/s | 358 kB 00:00 2024-08-24T21:08:38.575 INFO:teuthology.orchestra.run.smithi060.stdout:(99/127): python3-google-auth-2.33.0-1.el9.noar 3.7 MB/s | 220 kB 00:00 2024-08-24T21:08:38.586 INFO:teuthology.orchestra.run.smithi119.stdout:(69/127): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-08-24T21:08:38.608 INFO:teuthology.orchestra.run.smithi060.stdout:(100/127): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-08-24T21:08:38.633 INFO:teuthology.orchestra.run.smithi060.stdout:(101/127): python3-jaraco-8.2.1-3.el9.noarch.rp 432 kB/s | 11 kB 00:00 2024-08-24T21:08:38.636 INFO:teuthology.orchestra.run.smithi119.stdout:(70/127): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.0 MB/s | 159 kB 00:00 2024-08-24T21:08:38.659 INFO:teuthology.orchestra.run.smithi060.stdout:(102/127): python3-jaraco-classes-3.2.1-5.el9.n 713 kB/s | 18 kB 00:00 2024-08-24T21:08:38.661 INFO:teuthology.orchestra.run.smithi119.stdout:(71/127): python3-protobuf-3.14.0-13.el9.noarch 1.3 MB/s | 269 kB 00:00 2024-08-24T21:08:38.684 INFO:teuthology.orchestra.run.smithi060.stdout:(103/127): python3-jaraco-collections-3.0.0-8.e 941 kB/s | 23 kB 00:00 2024-08-24T21:08:38.709 INFO:teuthology.orchestra.run.smithi060.stdout:(104/127): python3-jaraco-functools-3.5.0-2.el9 787 kB/s | 19 kB 00:00 2024-08-24T21:08:38.720 INFO:teuthology.orchestra.run.smithi119.stdout:(72/127): python3-pyasn1-modules-0.4.8-6.el9.no 2.0 MB/s | 279 kB 00:00 2024-08-24T21:08:38.735 INFO:teuthology.orchestra.run.smithi060.stdout:(105/127): python3-jaraco-text-3.2.0-6.el9.noar 789 kB/s | 20 kB 00:00 2024-08-24T21:08:38.754 INFO:teuthology.orchestra.run.smithi119.stdout:(73/127): python3-pytz-2021.1-5.el9.noarch.rpm 439 kB/s | 51 kB 00:00 2024-08-24T21:08:38.787 INFO:teuthology.orchestra.run.smithi119.stdout:(74/127): python3-requests-oauthlib-1.3.0-12.el 462 kB/s | 54 kB 00:00 2024-08-24T21:08:38.793 INFO:teuthology.orchestra.run.smithi060.stdout:(106/127): python3-kubernetes-26.1.0-2.el9.noar 18 MB/s | 1.0 MB 00:00 2024-08-24T21:08:38.819 INFO:teuthology.orchestra.run.smithi060.stdout:(107/127): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-08-24T21:08:38.844 INFO:teuthology.orchestra.run.smithi060.stdout:(108/127): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-08-24T21:08:38.861 INFO:teuthology.orchestra.run.smithi060.stdout:(109/127): python3-natsort-7.1.1-5.el9.noarch.r 3.4 MB/s | 58 kB 00:00 2024-08-24T21:08:38.904 INFO:teuthology.orchestra.run.smithi119.stdout:(75/127): python3-toml-0.10.2-6.el9.noarch.rpm 295 kB/s | 42 kB 00:00 2024-08-24T21:08:38.919 INFO:teuthology.orchestra.run.smithi060.stdout:(110/127): python3-grpcio-1.46.7-10.el9.x86_64. 5.5 MB/s | 2.0 MB 00:00 2024-08-24T21:08:38.938 INFO:teuthology.orchestra.run.smithi119.stdout:(76/127): qatlib-24.02.0-1.el9.x86_64.rpm 1.5 MB/s | 221 kB 00:00 2024-08-24T21:08:38.944 INFO:teuthology.orchestra.run.smithi060.stdout:(111/127): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-08-24T21:08:39.020 INFO:teuthology.orchestra.run.smithi060.stdout:(112/127): libarrow-9.0.0-11.el9.x86_64.rpm 3.7 MB/s | 4.4 MB 00:01 2024-08-24T21:08:39.022 INFO:teuthology.orchestra.run.smithi119.stdout:(77/127): qatlib-service-24.02.0-1.el9.x86_64.r 308 kB/s | 36 kB 00:00 2024-08-24T21:08:39.037 INFO:teuthology.orchestra.run.smithi060.stdout:(113/127): python3-portend-3.1.0-2.el9.noarch.r 179 kB/s | 16 kB 00:00 2024-08-24T21:08:39.047 INFO:teuthology.orchestra.run.smithi119.stdout:(78/127): qatzip-libs-1.2.0-1.el9.x86_64.rpm 480 kB/s | 47 kB 00:00 2024-08-24T21:08:39.053 INFO:teuthology.orchestra.run.smithi060.stdout:(114/127): python3-repoze-lru-0.7-16.el9.noarch 926 kB/s | 31 kB 00:00 2024-08-24T21:08:39.070 INFO:teuthology.orchestra.run.smithi060.stdout:(115/127): python3-pyOpenSSL-21.0.0-1.el9.noarc 717 kB/s | 90 kB 00:00 2024-08-24T21:08:39.096 INFO:teuthology.orchestra.run.smithi060.stdout:(116/127): python3-rsa-4.9-2.el9.noarch.rpm 1.4 MB/s | 59 kB 00:00 2024-08-24T21:08:39.121 INFO:teuthology.orchestra.run.smithi060.stdout:(117/127): python3-tempora-5.0.0-2.el9.noarch.r 715 kB/s | 36 kB 00:00 2024-08-24T21:08:39.139 INFO:teuthology.orchestra.run.smithi119.stdout:(79/127): xmlstarlet-1.6.1-20.el9.x86_64.rpm 776 kB/s | 64 kB 00:00 2024-08-24T21:08:39.146 INFO:teuthology.orchestra.run.smithi060.stdout:(118/127): python3-routes-2.5.1-5.el9.noarch.rp 1.7 MB/s | 188 kB 00:00 2024-08-24T21:08:39.164 INFO:teuthology.orchestra.run.smithi119.stdout:(80/127): socat-1.7.4.1-6.el9.x86_64.rpm 2.1 MB/s | 304 kB 00:00 2024-08-24T21:08:39.172 INFO:teuthology.orchestra.run.smithi060.stdout:(119/127): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-08-24T21:08:39.197 INFO:teuthology.orchestra.run.smithi060.stdout:(120/127): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-08-24T21:08:39.222 INFO:teuthology.orchestra.run.smithi060.stdout:(121/127): python3-zc-lockfile-2.0-10.el9.noarc 811 kB/s | 20 kB 00:00 2024-08-24T21:08:39.247 INFO:teuthology.orchestra.run.smithi060.stdout:(122/127): python3-webob-1.8.7-6.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-08-24T21:08:39.271 INFO:teuthology.orchestra.run.smithi119.stdout:(81/127): lua-devel-5.4.4-4.el9.x86_64.rpm 170 kB/s | 22 kB 00:00 2024-08-24T21:08:39.273 INFO:teuthology.orchestra.run.smithi060.stdout:(123/127): re2-20211101-3.el9.x86_64.rpm 3.7 MB/s | 192 kB 00:00 2024-08-24T21:08:39.306 INFO:teuthology.orchestra.run.smithi060.stdout:(124/127): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-08-24T21:08:39.340 INFO:teuthology.orchestra.run.smithi119.stdout:(82/127): abseil-cpp-20211102.0-3.el9.x86_64.rp 7.8 MB/s | 548 kB 00:00 2024-08-24T21:08:39.373 INFO:teuthology.orchestra.run.smithi119.stdout:(83/127): gperftools-libs-2.9.1-2.el9.x86_64.rp 9.1 MB/s | 309 kB 00:00 2024-08-24T21:08:39.374 INFO:teuthology.orchestra.run.smithi060.stdout:(125/127): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-08-24T21:08:39.398 INFO:teuthology.orchestra.run.smithi119.stdout:(84/127): grpc-data-1.46.7-10.el9.noarch.rpm 786 kB/s | 19 kB 00:00 2024-08-24T21:08:39.440 INFO:teuthology.orchestra.run.smithi119.stdout:(85/127): protobuf-compiler-3.14.0-13.el9.x86_6 3.1 MB/s | 863 kB 00:00 2024-08-24T21:08:39.482 INFO:teuthology.orchestra.run.smithi119.stdout:(86/127): libarrow-doc-9.0.0-11.el9.noarch.rpm 628 kB/s | 26 kB 00:00 2024-08-24T21:08:39.507 INFO:teuthology.orchestra.run.smithi119.stdout:(87/127): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-08-24T21:08:39.533 INFO:teuthology.orchestra.run.smithi119.stdout:(88/127): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-08-24T21:08:39.567 INFO:teuthology.orchestra.run.smithi119.stdout:(89/127): luarocks-3.9.2-5.el9.noarch.rpm 4.4 MB/s | 151 kB 00:00 2024-08-24T21:08:39.617 INFO:teuthology.orchestra.run.smithi119.stdout:(90/127): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-08-24T21:08:39.659 INFO:teuthology.orchestra.run.smithi119.stdout:(91/127): pv-1.6.20-1.el9.x86_64.rpm 1.5 MB/s | 65 kB 00:00 2024-08-24T21:08:39.701 INFO:teuthology.orchestra.run.smithi119.stdout:(92/127): python3-asyncssh-2.13.2-5.el9.noarch. 13 MB/s | 548 kB 00:00 2024-08-24T21:08:39.726 INFO:teuthology.orchestra.run.smithi119.stdout:(93/127): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.7 MB/s | 43 kB 00:00 2024-08-24T21:08:39.751 INFO:teuthology.orchestra.run.smithi119.stdout:(94/127): python3-cachetools-4.2.4-1.el9.noarch 1.3 MB/s | 32 kB 00:00 2024-08-24T21:08:39.774 INFO:teuthology.orchestra.run.smithi060.stdout:(126/127): librbd1-19.0.0-5842.g4887e20f.el9.x8 6.9 MB/s | 3.2 MB 00:00 2024-08-24T21:08:39.777 INFO:teuthology.orchestra.run.smithi119.stdout:(95/127): python3-certifi-2023.05.07-4.el9.noar 568 kB/s | 14 kB 00:00 2024-08-24T21:08:39.810 INFO:teuthology.orchestra.run.smithi119.stdout:(96/127): python3-cheroot-8.6.0-4.el9.noarch.rp 5.1 MB/s | 172 kB 00:00 2024-08-24T21:08:39.844 INFO:teuthology.orchestra.run.smithi119.stdout:(97/127): python3-cherrypy-18.6.1-2.el9.noarch. 11 MB/s | 358 kB 00:00 2024-08-24T21:08:39.878 INFO:teuthology.orchestra.run.smithi119.stdout:(98/127): python3-google-auth-2.33.0-1.el9.noar 6.4 MB/s | 220 kB 00:00 2024-08-24T21:08:39.898 INFO:teuthology.orchestra.run.smithi060.stdout:(127/127): librados2-19.0.0-5842.g4887e20f.el9. 5.5 MB/s | 3.5 MB 00:00 2024-08-24T21:08:39.906 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-08-24T21:08:39.906 INFO:teuthology.orchestra.run.smithi060.stdout:Total 8.1 MB/s | 216 MB 00:26 2024-08-24T21:08:39.970 INFO:teuthology.orchestra.run.smithi119.stdout:(99/127): libarrow-9.0.0-11.el9.x86_64.rpm 7.7 MB/s | 4.4 MB 00:00 2024-08-24T21:08:39.995 INFO:teuthology.orchestra.run.smithi119.stdout:(100/127): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-08-24T21:08:40.045 INFO:teuthology.orchestra.run.smithi119.stdout:(101/127): python3-jaraco-8.2.1-3.el9.noarch.rp 214 kB/s | 11 kB 00:00 2024-08-24T21:08:40.071 INFO:teuthology.orchestra.run.smithi119.stdout:(102/127): python3-jaraco-classes-3.2.1-5.el9.n 711 kB/s | 18 kB 00:00 2024-08-24T21:08:40.096 INFO:teuthology.orchestra.run.smithi119.stdout:(103/127): python3-jaraco-collections-3.0.0-8.e 927 kB/s | 23 kB 00:00 2024-08-24T21:08:40.121 INFO:teuthology.orchestra.run.smithi119.stdout:(104/127): python3-jaraco-functools-3.5.0-2.el9 785 kB/s | 19 kB 00:00 2024-08-24T21:08:40.146 INFO:teuthology.orchestra.run.smithi119.stdout:(105/127): python3-jaraco-text-3.2.0-6.el9.noar 791 kB/s | 20 kB 00:00 2024-08-24T21:08:40.213 INFO:teuthology.orchestra.run.smithi119.stdout:(106/127): python3-grpcio-1.46.7-10.el9.x86_64. 6.1 MB/s | 2.0 MB 00:00 2024-08-24T21:08:40.239 INFO:teuthology.orchestra.run.smithi119.stdout:(107/127): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-08-24T21:08:40.264 INFO:teuthology.orchestra.run.smithi119.stdout:(108/127): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-08-24T21:08:40.289 INFO:teuthology.orchestra.run.smithi119.stdout:(109/127): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-08-24T21:08:40.323 INFO:teuthology.orchestra.run.smithi119.stdout:(110/127): python3-kubernetes-26.1.0-2.el9.noar 5.8 MB/s | 1.0 MB 00:00 2024-08-24T21:08:40.348 INFO:teuthology.orchestra.run.smithi119.stdout:(111/127): python3-portend-3.1.0-2.el9.noarch.r 662 kB/s | 16 kB 00:00 2024-08-24T21:08:40.374 INFO:teuthology.orchestra.run.smithi119.stdout:(112/127): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-08-24T21:08:40.424 INFO:teuthology.orchestra.run.smithi119.stdout:(113/127): python3-repoze-lru-0.7-16.el9.noarch 615 kB/s | 31 kB 00:00 2024-08-24T21:08:40.449 INFO:teuthology.orchestra.run.smithi119.stdout:(114/127): python3-pecan-1.4.2-3.el9.noarch.rpm 1.7 MB/s | 272 kB 00:00 2024-08-24T21:08:40.475 INFO:teuthology.orchestra.run.smithi119.stdout:(115/127): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-08-24T21:08:40.500 INFO:teuthology.orchestra.run.smithi119.stdout:(116/127): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-08-24T21:08:40.525 INFO:teuthology.orchestra.run.smithi119.stdout:(117/127): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-08-24T21:08:40.551 INFO:teuthology.orchestra.run.smithi119.stdout:(118/127): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-08-24T21:08:40.576 INFO:teuthology.orchestra.run.smithi119.stdout:(119/127): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-08-24T21:08:40.743 INFO:teuthology.orchestra.run.smithi119.stdout:(120/127): python3-scipy-1.6.2-8.el9.x86_64.rpm 8.0 MB/s | 16 MB 00:02 2024-08-24T21:08:40.790 INFO:teuthology.orchestra.run.smithi119.stdout:(121/127): python3-webob-1.8.7-6.el9.noarch.rpm 867 kB/s | 230 kB 00:00 2024-08-24T21:08:40.835 INFO:teuthology.orchestra.run.smithi119.stdout:(122/127): re2-20211101-3.el9.x86_64.rpm 5.4 MB/s | 192 kB 00:00 2024-08-24T21:08:40.869 INFO:teuthology.orchestra.run.smithi119.stdout:(123/127): python3-zc-lockfile-2.0-10.el9.noarc 159 kB/s | 20 kB 00:00 2024-08-24T21:08:40.894 INFO:teuthology.orchestra.run.smithi119.stdout:(124/127): python3-werkzeug-2.0.3-3.el9.1.noarc 1.3 MB/s | 427 kB 00:00 2024-08-24T21:08:40.944 INFO:teuthology.orchestra.run.smithi119.stdout:(125/127): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-08-24T21:08:41.266 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2024-08-24T21:08:41.328 INFO:teuthology.orchestra.run.smithi119.stdout:(126/127): librbd1-19.0.0-5842.g4887e20f.el9.x8 7.5 MB/s | 3.2 MB 00:00 2024-08-24T21:08:41.407 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2024-08-24T21:08:41.407 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2024-08-24T21:08:41.620 INFO:teuthology.orchestra.run.smithi119.stdout:(127/127): librados2-19.0.0-5842.g4887e20f.el9. 4.6 MB/s | 3.5 MB 00:00 2024-08-24T21:08:41.625 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2024-08-24T21:08:41.625 INFO:teuthology.orchestra.run.smithi119.stdout:Total 7.7 MB/s | 216 MB 00:28 2024-08-24T21:08:42.972 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2024-08-24T21:08:43.097 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2024-08-24T21:08:43.098 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2024-08-24T21:08:43.568 INFO:teuthology.orchestra.run.smithi179.stdout: Preparing : 1/1 2024-08-24T21:08:43.643 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/129 2024-08-24T21:08:43.805 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2024-08-24T21:08:43.805 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2024-08-24T21:08:43.817 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/129 2024-08-24T21:08:43.927 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/129 2024-08-24T21:08:44.308 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/129 2024-08-24T21:08:44.448 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : librados2-2:19.0.0-5842.g4887e20f.el9.x86_64 5/129 2024-08-24T21:08:44.593 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librados2-2:19.0.0-5842.g4887e20f.el9.x86_64 5/129 2024-08-24T21:08:44.626 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libcephfs2-2:19.0.0-5842.g4887e20f.el9.x86_64 6/129 2024-08-24T21:08:44.768 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libcephfs2-2:19.0.0-5842.g4887e20f.el9.x86_64 6/129 2024-08-24T21:08:44.817 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-rados-2:19.0.0-5842.g4887e20f.el9.x86_64 7/129 2024-08-24T21:08:44.848 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/129 2024-08-24T21:08:44.893 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/129 2024-08-24T21:08:44.920 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libcephsqlite-2:19.0.0-5842.g4887e20f.el9.x86_64 10/129 2024-08-24T21:08:45.097 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libcephsqlite-2:19.0.0-5842.g4887e20f.el9.x86_64 10/129 2024-08-24T21:08:45.129 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libradosstriper1-2:19.0.0-5842.g4887e20f.el9.x86 11/129 2024-08-24T21:08:45.248 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2024-08-24T21:08:45.249 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2024-08-24T21:08:45.273 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libradosstriper1-2:19.0.0-5842.g4887e20f.el9.x86 11/129 2024-08-24T21:08:45.306 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 12/129 2024-08-24T21:08:45.343 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 12/129 2024-08-24T21:08:45.757 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 13/129 2024-08-24T21:08:45.799 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 13/129 2024-08-24T21:08:45.932 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : re2-1:20211101-3.el9.x86_64 14/129 2024-08-24T21:08:45.972 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 15/129 2024-08-24T21:08:46.016 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : liboath-2.6.7-2.el9.x86_64 16/129 2024-08-24T21:08:46.100 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 17/129 2024-08-24T21:08:46.186 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 18/129 2024-08-24T21:08:46.224 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-packaging-20.9-5.el9.noarch 19/129 2024-08-24T21:08:46.270 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 20/129 2024-08-24T21:08:46.316 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 21/129 2024-08-24T21:08:46.351 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : lua-5.4.4-4.el9.x86_64 22/129 2024-08-24T21:08:46.442 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 23/129 2024-08-24T21:08:46.504 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 24/129 2024-08-24T21:08:46.538 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 25/129 2024-08-24T21:08:46.584 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 26/129 2024-08-24T21:08:46.666 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 27/129 2024-08-24T21:08:46.730 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-ceph-common-2:19.0.0-5842.g4887e20f.el9. 28/129 2024-08-24T21:08:46.780 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-ceph-argparse-2:19.0.0-5842.g4887e20f.el 29/129 2024-08-24T21:08:46.814 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cephfs-2:19.0.0-5842.g4887e20f.el9.x86_6 30/129 2024-08-24T21:08:46.907 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 31/129 2024-08-24T21:08:46.966 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : luarocks-3.9.2-5.el9.noarch 32/129 2024-08-24T21:08:47.058 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 33/129 2024-08-24T21:08:47.219 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 34/129 2024-08-24T21:08:47.278 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 35/129 2024-08-24T21:08:47.928 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-rsa-4.9-2.el9.noarch 36/129 2024-08-24T21:08:48.069 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 37/129 2024-08-24T21:08:48.106 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 38/129 2024-08-24T21:08:48.151 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 39/129 2024-08-24T21:08:48.188 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : librados-devel-2:19.0.0-5842.g4887e20f.el9.x86_6 40/129 2024-08-24T21:08:48.229 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 41/129 2024-08-24T21:08:48.337 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 42/129 2024-08-24T21:08:48.408 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 43/129 2024-08-24T21:08:48.517 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 44/129 2024-08-24T21:08:48.581 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 45/129 2024-08-24T21:08:48.617 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 46/129 2024-08-24T21:08:48.676 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 47/129 2024-08-24T21:08:48.729 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 48/129 2024-08-24T21:08:48.779 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 49/129 2024-08-24T21:08:48.951 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 50/129 2024-08-24T21:08:49.032 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 51/129 2024-08-24T21:08:49.080 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 52/129 2024-08-24T21:08:49.199 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 53/129 2024-08-24T21:08:49.254 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-google-auth-1:2.33.0-1.el9.noarch 54/129 2024-08-24T21:08:49.288 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2024-08-24T21:08:49.299 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 55/129 2024-08-24T21:08:49.334 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 56/129 2024-08-24T21:08:49.358 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 57/129 2024-08-24T21:08:49.380 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/129 2024-08-24T21:08:49.411 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/129 2024-08-24T21:08:49.485 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 58/129 2024-08-24T21:08:49.495 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/129 2024-08-24T21:08:49.643 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 59/129 2024-08-24T21:08:49.696 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 60/129 2024-08-24T21:08:49.744 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 61/129 2024-08-24T21:08:49.783 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 62/129 2024-08-24T21:08:49.821 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 63/129 2024-08-24T21:08:49.855 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 64/129 2024-08-24T21:08:49.888 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 65/129 2024-08-24T21:08:49.903 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/129 2024-08-24T21:08:49.932 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 66/129 2024-08-24T21:08:49.964 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 67/129 2024-08-24T21:08:50.003 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : librados2-2:19.0.0-5842.g4887e20f.el9.x86_64 5/129 2024-08-24T21:08:50.065 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 68/129 2024-08-24T21:08:50.114 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 69/129 2024-08-24T21:08:50.152 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librados2-2:19.0.0-5842.g4887e20f.el9.x86_64 5/129 2024-08-24T21:08:50.172 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 70/129 2024-08-24T21:08:50.187 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libcephfs2-2:19.0.0-5842.g4887e20f.el9.x86_64 6/129 2024-08-24T21:08:50.299 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 71/129 2024-08-24T21:08:50.307 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libcephfs2-2:19.0.0-5842.g4887e20f.el9.x86_64 6/129 2024-08-24T21:08:50.360 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rados-2:19.0.0-5842.g4887e20f.el9.x86_64 7/129 2024-08-24T21:08:50.365 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 72/129 2024-08-24T21:08:50.393 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/129 2024-08-24T21:08:50.439 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/129 2024-08-24T21:08:50.465 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libcephsqlite-2:19.0.0-5842.g4887e20f.el9.x86_64 10/129 2024-08-24T21:08:50.586 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libcephsqlite-2:19.0.0-5842.g4887e20f.el9.x86_64 10/129 2024-08-24T21:08:50.616 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libradosstriper1-2:19.0.0-5842.g4887e20f.el9.x86 11/129 2024-08-24T21:08:50.709 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libradosstriper1-2:19.0.0-5842.g4887e20f.el9.x86 11/129 2024-08-24T21:08:50.710 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2024-08-24T21:08:50.733 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 12/129 2024-08-24T21:08:50.778 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 12/129 2024-08-24T21:08:50.833 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/129 2024-08-24T21:08:50.864 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/129 2024-08-24T21:08:50.957 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/129 2024-08-24T21:08:51.179 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 13/129 2024-08-24T21:08:51.220 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 13/129 2024-08-24T21:08:51.258 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 73/129 2024-08-24T21:08:51.350 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 74/129 2024-08-24T21:08:51.358 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : re2-1:20211101-3.el9.x86_64 14/129 2024-08-24T21:08:51.363 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/129 2024-08-24T21:08:51.383 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 75/129 2024-08-24T21:08:51.400 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 15/129 2024-08-24T21:08:51.446 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : liboath-2.6.7-2.el9.x86_64 16/129 2024-08-24T21:08:51.498 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : librados2-2:19.0.0-5842.g4887e20f.el9.x86_64 5/129 2024-08-24T21:08:51.500 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 76/129 2024-08-24T21:08:51.533 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 17/129 2024-08-24T21:08:51.541 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-devel-3.9.19-7.el9.x86_64 77/129 2024-08-24T21:08:51.591 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 18/129 2024-08-24T21:08:51.629 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-packaging-20.9-5.el9.noarch 19/129 2024-08-24T21:08:51.643 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librados2-2:19.0.0-5842.g4887e20f.el9.x86_64 5/129 2024-08-24T21:08:51.691 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libcephfs2-2:19.0.0-5842.g4887e20f.el9.x86_64 6/129 2024-08-24T21:08:51.691 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 20/129 2024-08-24T21:08:51.732 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 21/129 2024-08-24T21:08:51.763 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : lua-5.4.4-4.el9.x86_64 22/129 2024-08-24T21:08:51.776 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : openblas-0.3.26-1.el9.x86_64 78/129 2024-08-24T21:08:51.804 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : openblas-openmp-0.3.26-1.el9.x86_64 79/129 2024-08-24T21:08:51.856 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 23/129 2024-08-24T21:08:51.872 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libcephfs2-2:19.0.0-5842.g4887e20f.el9.x86_64 6/129 2024-08-24T21:08:51.908 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 80/129 2024-08-24T21:08:51.925 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-rados-2:19.0.0-5842.g4887e20f.el9.x86_64 7/129 2024-08-24T21:08:51.927 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 24/129 2024-08-24T21:08:51.959 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 25/129 2024-08-24T21:08:51.963 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/129 2024-08-24T21:08:52.008 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/129 2024-08-24T21:08:52.034 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 26/129 2024-08-24T21:08:52.035 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libcephsqlite-2:19.0.0-5842.g4887e20f.el9.x86_64 10/129 2024-08-24T21:08:52.116 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 27/129 2024-08-24T21:08:52.162 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-ceph-common-2:19.0.0-5842.g4887e20f.el9. 28/129 2024-08-24T21:08:52.195 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libcephsqlite-2:19.0.0-5842.g4887e20f.el9.x86_64 10/129 2024-08-24T21:08:52.209 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-ceph-argparse-2:19.0.0-5842.g4887e20f.el 29/129 2024-08-24T21:08:52.228 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libradosstriper1-2:19.0.0-5842.g4887e20f.el9.x86 11/129 2024-08-24T21:08:52.242 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cephfs-2:19.0.0-5842.g4887e20f.el9.x86_6 30/129 2024-08-24T21:08:52.341 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 31/129 2024-08-24T21:08:52.354 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libradosstriper1-2:19.0.0-5842.g4887e20f.el9.x86 11/129 2024-08-24T21:08:52.379 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 12/129 2024-08-24T21:08:52.396 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : luarocks-3.9.2-5.el9.noarch 32/129 2024-08-24T21:08:52.420 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 12/129 2024-08-24T21:08:52.493 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 33/129 2024-08-24T21:08:52.671 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 34/129 2024-08-24T21:08:52.723 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 81/129 2024-08-24T21:08:52.727 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 35/129 2024-08-24T21:08:52.853 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 82/129 2024-08-24T21:08:52.912 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 13/129 2024-08-24T21:08:52.977 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 13/129 2024-08-24T21:08:53.113 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : re2-1:20211101-3.el9.x86_64 14/129 2024-08-24T21:08:53.154 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 15/129 2024-08-24T21:08:53.199 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : liboath-2.6.7-2.el9.x86_64 16/129 2024-08-24T21:08:53.290 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 17/129 2024-08-24T21:08:53.388 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 18/129 2024-08-24T21:08:53.431 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-packaging-20.9-5.el9.noarch 19/129 2024-08-24T21:08:53.441 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rsa-4.9-2.el9.noarch 36/129 2024-08-24T21:08:53.486 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 20/129 2024-08-24T21:08:53.526 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 21/129 2024-08-24T21:08:53.545 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 37/129 2024-08-24T21:08:53.558 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : lua-5.4.4-4.el9.x86_64 22/129 2024-08-24T21:08:53.577 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 38/129 2024-08-24T21:08:53.629 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 39/129 2024-08-24T21:08:53.646 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 23/129 2024-08-24T21:08:53.668 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librados-devel-2:19.0.0-5842.g4887e20f.el9.x86_6 40/129 2024-08-24T21:08:53.708 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 41/129 2024-08-24T21:08:53.710 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 24/129 2024-08-24T21:08:53.779 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 25/129 2024-08-24T21:08:53.823 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 42/129 2024-08-24T21:08:53.825 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 26/129 2024-08-24T21:08:53.899 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 43/129 2024-08-24T21:08:53.908 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 27/129 2024-08-24T21:08:53.941 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-ceph-common-2:19.0.0-5842.g4887e20f.el9. 28/129 2024-08-24T21:08:53.985 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 44/129 2024-08-24T21:08:53.988 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-ceph-argparse-2:19.0.0-5842.g4887e20f.el 29/129 2024-08-24T21:08:54.021 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cephfs-2:19.0.0-5842.g4887e20f.el9.x86_6 30/129 2024-08-24T21:08:54.113 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 31/129 2024-08-24T21:08:54.149 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 45/129 2024-08-24T21:08:54.174 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : luarocks-3.9.2-5.el9.noarch 32/129 2024-08-24T21:08:54.181 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 46/129 2024-08-24T21:08:54.233 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 47/129 2024-08-24T21:08:54.265 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 33/129 2024-08-24T21:08:54.284 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 48/129 2024-08-24T21:08:54.351 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 49/129 2024-08-24T21:08:54.424 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 34/129 2024-08-24T21:08:54.441 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/129 2024-08-24T21:08:54.486 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 35/129 2024-08-24T21:08:54.535 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 50/129 2024-08-24T21:08:54.538 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 84/129 2024-08-24T21:08:54.583 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 51/129 2024-08-24T21:08:54.627 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 52/129 2024-08-24T21:08:54.762 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 53/129 2024-08-24T21:08:54.800 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-google-auth-1:2.33.0-1.el9.noarch 54/129 2024-08-24T21:08:54.843 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 55/129 2024-08-24T21:08:54.872 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 56/129 2024-08-24T21:08:54.882 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 85/129 2024-08-24T21:08:54.896 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 57/129 2024-08-24T21:08:54.923 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : librbd1-2:19.0.0-5842.g4887e20f.el9.x86_64 86/129 2024-08-24T21:08:55.009 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 58/129 2024-08-24T21:08:55.040 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librbd1-2:19.0.0-5842.g4887e20f.el9.x86_64 86/129 2024-08-24T21:08:55.070 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-rbd-2:19.0.0-5842.g4887e20f.el9.x86_64 87/129 2024-08-24T21:08:55.119 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 88/129 2024-08-24T21:08:55.126 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-rsa-4.9-2.el9.noarch 36/129 2024-08-24T21:08:55.175 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 59/129 2024-08-24T21:08:55.217 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 60/129 2024-08-24T21:08:55.236 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 37/129 2024-08-24T21:08:55.266 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 61/129 2024-08-24T21:08:55.280 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 38/129 2024-08-24T21:08:55.305 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 62/129 2024-08-24T21:08:55.325 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 39/129 2024-08-24T21:08:55.333 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 63/129 2024-08-24T21:08:55.360 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 64/129 2024-08-24T21:08:55.362 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : librados-devel-2:19.0.0-5842.g4887e20f.el9.x86_6 40/129 2024-08-24T21:08:55.393 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 65/129 2024-08-24T21:08:55.395 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 41/129 2024-08-24T21:08:55.437 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 66/129 2024-08-24T21:08:55.494 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 67/129 2024-08-24T21:08:55.501 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 42/129 2024-08-24T21:08:55.565 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 43/129 2024-08-24T21:08:55.601 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 68/129 2024-08-24T21:08:55.649 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 44/129 2024-08-24T21:08:55.654 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 69/129 2024-08-24T21:08:55.658 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 89/129 2024-08-24T21:08:55.688 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 45/129 2024-08-24T21:08:55.689 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 70/129 2024-08-24T21:08:55.709 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : librgw2-2:19.0.0-5842.g4887e20f.el9.x86_64 90/129 2024-08-24T21:08:55.725 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 46/129 2024-08-24T21:08:55.785 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 47/129 2024-08-24T21:08:55.821 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 71/129 2024-08-24T21:08:55.835 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librgw2-2:19.0.0-5842.g4887e20f.el9.x86_64 90/129 2024-08-24T21:08:55.844 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 48/129 2024-08-24T21:08:55.861 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-rgw-2:19.0.0-5842.g4887e20f.el9.x86_64 91/129 2024-08-24T21:08:55.888 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 72/129 2024-08-24T21:08:55.894 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 49/129 2024-08-24T21:08:56.065 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 50/129 2024-08-24T21:08:56.110 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 51/129 2024-08-24T21:08:56.146 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 52/129 2024-08-24T21:08:56.273 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 53/129 2024-08-24T21:08:56.336 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-google-auth-1:2.33.0-1.el9.noarch 54/129 2024-08-24T21:08:56.397 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 55/129 2024-08-24T21:08:56.433 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 56/129 2024-08-24T21:08:56.457 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 57/129 2024-08-24T21:08:56.569 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 58/129 2024-08-24T21:08:56.729 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 59/129 2024-08-24T21:08:56.795 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 60/129 2024-08-24T21:08:56.842 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 61/129 2024-08-24T21:08:56.871 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 73/129 2024-08-24T21:08:56.883 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 62/129 2024-08-24T21:08:56.920 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 63/129 2024-08-24T21:08:56.921 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 74/129 2024-08-24T21:08:56.954 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 64/129 2024-08-24T21:08:56.955 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 75/129 2024-08-24T21:08:56.987 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 65/129 2024-08-24T21:08:57.031 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 66/129 2024-08-24T21:08:57.063 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 67/129 2024-08-24T21:08:57.082 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 76/129 2024-08-24T21:08:57.122 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-devel-3.9.19-7.el9.x86_64 77/129 2024-08-24T21:08:57.164 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 68/129 2024-08-24T21:08:57.223 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 69/129 2024-08-24T21:08:57.250 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 70/129 2024-08-24T21:08:57.362 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : openblas-0.3.26-1.el9.x86_64 78/129 2024-08-24T21:08:57.365 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 71/129 2024-08-24T21:08:57.384 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : openblas-openmp-0.3.26-1.el9.x86_64 79/129 2024-08-24T21:08:57.438 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 72/129 2024-08-24T21:08:57.483 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 80/129 2024-08-24T21:08:58.333 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 73/129 2024-08-24T21:08:58.388 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 81/129 2024-08-24T21:08:58.399 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 74/129 2024-08-24T21:08:58.432 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 75/129 2024-08-24T21:08:58.531 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-common-2:19.0.0-5842.g4887e20f.el9.x86_64 92/129 2024-08-24T21:08:58.548 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 82/129 2024-08-24T21:08:58.549 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 76/129 2024-08-24T21:08:58.566 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-common-2:19.0.0-5842.g4887e20f.el9.x86_64 92/129 2024-08-24T21:08:58.599 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-devel-3.9.19-7.el9.x86_64 77/129 2024-08-24T21:08:58.836 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : openblas-0.3.26-1.el9.x86_64 78/129 2024-08-24T21:08:58.871 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : openblas-openmp-0.3.26-1.el9.x86_64 79/129 2024-08-24T21:08:58.976 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 80/129 2024-08-24T21:08:59.216 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-common-2:19.0.0-5842.g4887e20f.el9.x86_64 92/129 2024-08-24T21:08:59.253 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-base-2:19.0.0-5842.g4887e20f.el9.x86_64 93/129 2024-08-24T21:08:59.387 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-base-2:19.0.0-5842.g4887e20f.el9.x86_64 93/129 2024-08-24T21:08:59.387 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-24T21:08:59.387 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-24T21:08:59.387 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-08-24T21:08:59.429 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-selinux-2:19.0.0-5842.g4887e20f.el9.x86_64 94/129 2024-08-24T21:08:59.840 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 81/129 2024-08-24T21:08:59.979 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 82/129 2024-08-24T21:09:00.253 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/129 2024-08-24T21:09:00.352 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 84/129 2024-08-24T21:09:00.718 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 85/129 2024-08-24T21:09:00.766 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : librbd1-2:19.0.0-5842.g4887e20f.el9.x86_64 86/129 2024-08-24T21:09:00.888 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librbd1-2:19.0.0-5842.g4887e20f.el9.x86_64 86/129 2024-08-24T21:09:00.917 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rbd-2:19.0.0-5842.g4887e20f.el9.x86_64 87/129 2024-08-24T21:09:00.966 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 88/129 2024-08-24T21:09:01.540 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 89/129 2024-08-24T21:09:01.555 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/129 2024-08-24T21:09:01.572 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librgw2-2:19.0.0-5842.g4887e20f.el9.x86_64 90/129 2024-08-24T21:09:01.663 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 84/129 2024-08-24T21:09:01.666 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librgw2-2:19.0.0-5842.g4887e20f.el9.x86_64 90/129 2024-08-24T21:09:01.691 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rgw-2:19.0.0-5842.g4887e20f.el9.x86_64 91/129 2024-08-24T21:09:02.031 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 85/129 2024-08-24T21:09:02.097 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : librbd1-2:19.0.0-5842.g4887e20f.el9.x86_64 86/129 2024-08-24T21:09:02.214 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librbd1-2:19.0.0-5842.g4887e20f.el9.x86_64 86/129 2024-08-24T21:09:02.245 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-rbd-2:19.0.0-5842.g4887e20f.el9.x86_64 87/129 2024-08-24T21:09:02.297 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 88/129 2024-08-24T21:09:02.837 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 89/129 2024-08-24T21:09:02.867 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : librgw2-2:19.0.0-5842.g4887e20f.el9.x86_64 90/129 2024-08-24T21:09:02.944 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librgw2-2:19.0.0-5842.g4887e20f.el9.x86_64 90/129 2024-08-24T21:09:02.969 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-rgw-2:19.0.0-5842.g4887e20f.el9.x86_64 91/129 2024-08-24T21:09:04.393 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-common-2:19.0.0-5842.g4887e20f.el9.x86_64 92/129 2024-08-24T21:09:04.429 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-common-2:19.0.0-5842.g4887e20f.el9.x86_64 92/129 2024-08-24T21:09:05.108 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-common-2:19.0.0-5842.g4887e20f.el9.x86_64 92/129 2024-08-24T21:09:05.157 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-base-2:19.0.0-5842.g4887e20f.el9.x86_64 93/129 2024-08-24T21:09:05.285 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-base-2:19.0.0-5842.g4887e20f.el9.x86_64 93/129 2024-08-24T21:09:05.285 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-24T21:09:05.285 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-24T21:09:05.286 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-08-24T21:09:05.325 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-selinux-2:19.0.0-5842.g4887e20f.el9.x86_64 94/129 2024-08-24T21:09:05.555 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-common-2:19.0.0-5842.g4887e20f.el9.x86_64 92/129 2024-08-24T21:09:05.590 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-common-2:19.0.0-5842.g4887e20f.el9.x86_64 92/129 2024-08-24T21:09:06.237 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-common-2:19.0.0-5842.g4887e20f.el9.x86_64 92/129 2024-08-24T21:09:06.286 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-base-2:19.0.0-5842.g4887e20f.el9.x86_64 93/129 2024-08-24T21:09:06.431 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-base-2:19.0.0-5842.g4887e20f.el9.x86_64 93/129 2024-08-24T21:09:06.431 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-24T21:09:06.432 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-24T21:09:06.432 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-24T21:09:06.478 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-selinux-2:19.0.0-5842.g4887e20f.el9.x86_64 94/129 2024-08-24T21:09:12.200 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-selinux-2:19.0.0-5842.g4887e20f.el9.x86_64 94/129 2024-08-24T21:09:12.200 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /sys 2024-08-24T21:09:12.200 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /proc 2024-08-24T21:09:12.200 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /mnt 2024-08-24T21:09:12.200 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /var/tmp 2024-08-24T21:09:12.201 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /home 2024-08-24T21:09:12.201 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /root 2024-08-24T21:09:12.201 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /tmp 2024-08-24T21:09:12.201 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-08-24T21:09:12.407 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-volume-2:19.0.0-5842.g4887e20f.el9.noarch 95/129 2024-08-24T21:09:12.442 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-volume-2:19.0.0-5842.g4887e20f.el9.noarch 95/129 2024-08-24T21:09:12.442 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-24T21:09:12.442 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-24T21:09:12.443 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-08-24T21:09:14.086 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-osd-2:19.0.0-5842.g4887e20f.el9.x86_64 96/129 2024-08-24T21:09:14.144 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-osd-2:19.0.0-5842.g4887e20f.el9.x86_64 96/129 2024-08-24T21:09:14.144 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-24T21:09:14.144 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-24T21:09:14.144 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-24T21:09:14.144 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-24T21:09:14.144 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-08-24T21:09:14.386 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mds-2:19.0.0-5842.g4887e20f.el9.x86_64 97/129 2024-08-24T21:09:14.436 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mds-2:19.0.0-5842.g4887e20f.el9.x86_64 97/129 2024-08-24T21:09:14.437 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-24T21:09:14.437 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-24T21:09:14.437 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-24T21:09:14.437 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-24T21:09:14.437 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-08-24T21:09:14.929 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mon-2:19.0.0-5842.g4887e20f.el9.x86_64 98/129 2024-08-24T21:09:14.979 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mon-2:19.0.0-5842.g4887e20f.el9.x86_64 98/129 2024-08-24T21:09:14.979 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-24T21:09:14.979 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-24T21:09:14.979 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-24T21:09:14.979 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-24T21:09:14.979 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-08-24T21:09:15.062 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-ply-3.11-14.el9.noarch 99/129 2024-08-24T21:09:15.127 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 100/129 2024-08-24T21:09:15.349 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 101/129 2024-08-24T21:09:15.423 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 102/129 2024-08-24T21:09:15.508 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 103/129 2024-08-24T21:09:15.610 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 104/129 2024-08-24T21:09:15.764 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 105/129 2024-08-24T21:09:15.807 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 106/129 2024-08-24T21:09:15.847 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 107/129 2024-08-24T21:09:15.882 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : fuse-2.9.9-16.el9.x86_64 108/129 2024-08-24T21:09:16.573 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: cephadm-2:19.0.0-5842.g4887e20f.el9.noarch 109/129 2024-08-24T21:09:16.607 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : cephadm-2:19.0.0-5842.g4887e20f.el9.noarch 109/129 2024-08-24T21:09:16.649 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-5842.g4887e20f.e 110/129 2024-08-24T21:09:16.727 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-5842.g4887e20f. 111/129 2024-08-24T21:09:16.754 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-5842.g4887e20f.el9.noa 112/129 2024-08-24T21:09:18.321 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-selinux-2:19.0.0-5842.g4887e20f.el9.x86_64 94/129 2024-08-24T21:09:18.321 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /sys 2024-08-24T21:09:18.321 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /proc 2024-08-24T21:09:18.321 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /mnt 2024-08-24T21:09:18.322 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /var/tmp 2024-08-24T21:09:18.322 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /home 2024-08-24T21:09:18.322 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /root 2024-08-24T21:09:18.322 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /tmp 2024-08-24T21:09:18.322 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-08-24T21:09:18.537 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-volume-2:19.0.0-5842.g4887e20f.el9.noarch 95/129 2024-08-24T21:09:18.573 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-volume-2:19.0.0-5842.g4887e20f.el9.noarch 95/129 2024-08-24T21:09:18.573 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-24T21:09:18.573 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-24T21:09:18.574 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-08-24T21:09:18.915 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-selinux-2:19.0.0-5842.g4887e20f.el9.x86_64 94/129 2024-08-24T21:09:18.915 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /sys 2024-08-24T21:09:18.915 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /proc 2024-08-24T21:09:18.915 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /mnt 2024-08-24T21:09:18.916 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /var/tmp 2024-08-24T21:09:18.916 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /home 2024-08-24T21:09:18.916 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /root 2024-08-24T21:09:18.916 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /tmp 2024-08-24T21:09:18.916 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-24T21:09:19.137 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-volume-2:19.0.0-5842.g4887e20f.el9.noarch 95/129 2024-08-24T21:09:19.173 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-volume-2:19.0.0-5842.g4887e20f.el9.noarch 95/129 2024-08-24T21:09:19.174 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-24T21:09:19.174 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-24T21:09:19.174 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-24T21:09:20.302 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-osd-2:19.0.0-5842.g4887e20f.el9.x86_64 96/129 2024-08-24T21:09:20.333 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-5842.g4887e20f.el9.noa 112/129 2024-08-24T21:09:20.360 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-osd-2:19.0.0-5842.g4887e20f.el9.x86_64 96/129 2024-08-24T21:09:20.360 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-24T21:09:20.360 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-24T21:09:20.360 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-24T21:09:20.361 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-24T21:09:20.361 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-08-24T21:09:20.403 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-5842.g4887e20f.el9.n 113/129 2024-08-24T21:09:20.624 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mds-2:19.0.0-5842.g4887e20f.el9.x86_64 97/129 2024-08-24T21:09:20.676 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mds-2:19.0.0-5842.g4887e20f.el9.x86_64 97/129 2024-08-24T21:09:20.676 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-24T21:09:20.676 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-24T21:09:20.676 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-24T21:09:20.676 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-24T21:09:20.676 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-08-24T21:09:20.765 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-osd-2:19.0.0-5842.g4887e20f.el9.x86_64 96/129 2024-08-24T21:09:20.822 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-osd-2:19.0.0-5842.g4887e20f.el9.x86_64 96/129 2024-08-24T21:09:20.823 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-24T21:09:20.823 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-24T21:09:20.823 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-24T21:09:20.823 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-24T21:09:20.823 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-24T21:09:21.065 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mds-2:19.0.0-5842.g4887e20f.el9.x86_64 97/129 2024-08-24T21:09:21.116 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mds-2:19.0.0-5842.g4887e20f.el9.x86_64 97/129 2024-08-24T21:09:21.116 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-24T21:09:21.116 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-24T21:09:21.116 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-24T21:09:21.116 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-24T21:09:21.117 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-24T21:09:21.192 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mon-2:19.0.0-5842.g4887e20f.el9.x86_64 98/129 2024-08-24T21:09:21.243 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mon-2:19.0.0-5842.g4887e20f.el9.x86_64 98/129 2024-08-24T21:09:21.243 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-24T21:09:21.243 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-24T21:09:21.243 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-24T21:09:21.243 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-24T21:09:21.243 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-08-24T21:09:21.328 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-ply-3.11-14.el9.noarch 99/129 2024-08-24T21:09:21.401 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 100/129 2024-08-24T21:09:21.479 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-5842.g4887e20f.el9.n 113/129 2024-08-24T21:09:21.522 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-5842.g488 114/129 2024-08-24T21:09:21.599 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mon-2:19.0.0-5842.g4887e20f.el9.x86_64 98/129 2024-08-24T21:09:21.651 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mon-2:19.0.0-5842.g4887e20f.el9.x86_64 98/129 2024-08-24T21:09:21.651 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-24T21:09:21.651 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-24T21:09:21.651 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-24T21:09:21.651 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-24T21:09:21.651 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-24T21:09:21.671 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-5842.g488 114/129 2024-08-24T21:09:21.676 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 101/129 2024-08-24T21:09:21.733 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-ply-3.11-14.el9.noarch 99/129 2024-08-24T21:09:21.745 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 102/129 2024-08-24T21:09:21.797 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 100/129 2024-08-24T21:09:21.835 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 103/129 2024-08-24T21:09:21.875 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-5842.g4887e20f.el 115/129 2024-08-24T21:09:21.906 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-2:19.0.0-5842.g4887e20f.el9.x86_64 116/129 2024-08-24T21:09:21.945 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 104/129 2024-08-24T21:09:21.957 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-2:19.0.0-5842.g4887e20f.el9.x86_64 116/129 2024-08-24T21:09:21.957 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-24T21:09:21.958 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-24T21:09:21.958 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-24T21:09:21.958 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-24T21:09:21.958 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-08-24T21:09:22.022 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 101/129 2024-08-24T21:09:22.041 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-rook-2:19.0.0-5842.g4887e20f.el9.noarch 117/129 2024-08-24T21:09:22.067 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-5842.g4887e20f.el9.noarch 117/129 2024-08-24T21:09:22.102 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 102/129 2024-08-24T21:09:22.122 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 105/129 2024-08-24T21:09:22.175 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-2:19.0.0-5842.g4887e20f.el9.x86_64 118/129 2024-08-24T21:09:22.179 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 106/129 2024-08-24T21:09:22.187 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 103/129 2024-08-24T21:09:22.228 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 107/129 2024-08-24T21:09:22.260 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : fuse-2.9.9-16.el9.x86_64 108/129 2024-08-24T21:09:22.296 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 104/129 2024-08-24T21:09:22.475 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 105/129 2024-08-24T21:09:22.535 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 106/129 2024-08-24T21:09:22.580 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 107/129 2024-08-24T21:09:22.609 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : fuse-2.9.9-16.el9.x86_64 108/129 2024-08-24T21:09:22.819 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: cephadm-2:19.0.0-5842.g4887e20f.el9.noarch 109/129 2024-08-24T21:09:22.851 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : cephadm-2:19.0.0-5842.g4887e20f.el9.noarch 109/129 2024-08-24T21:09:22.894 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-5842.g4887e20f.e 110/129 2024-08-24T21:09:22.976 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-5842.g4887e20f. 111/129 2024-08-24T21:09:23.007 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-5842.g4887e20f.el9.noa 112/129 2024-08-24T21:09:23.193 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-fuse-2:19.0.0-5842.g4887e20f.el9.x86_64 119/129 2024-08-24T21:09:23.225 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-radosgw-2:19.0.0-5842.g4887e20f.el9.x86_64 120/129 2024-08-24T21:09:23.276 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-5842.g4887e20f.el9.x86_64 120/129 2024-08-24T21:09:23.276 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-24T21:09:23.276 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-24T21:09:23.276 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-24T21:09:23.276 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-24T21:09:23.276 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-08-24T21:09:23.282 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: cephadm-2:19.0.0-5842.g4887e20f.el9.noarch 109/129 2024-08-24T21:09:23.316 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : cephadm-2:19.0.0-5842.g4887e20f.el9.noarch 109/129 2024-08-24T21:09:23.326 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-5842.g4887e 121/129 2024-08-24T21:09:23.359 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-5842.g4887e20f.e 110/129 2024-08-24T21:09:23.378 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-5842.g4887e 121/129 2024-08-24T21:09:23.378 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-24T21:09:23.378 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-24T21:09:23.378 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-08-24T21:09:23.438 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-5842.g4887e20f. 111/129 2024-08-24T21:09:23.489 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-5842.g4887e20f.el9.noa 112/129 2024-08-24T21:09:23.718 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : rbd-mirror-2:19.0.0-5842.g4887e20f.el9.x86_64 122/129 2024-08-24T21:09:23.769 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: rbd-mirror-2:19.0.0-5842.g4887e20f.el9.x86_64 122/129 2024-08-24T21:09:23.769 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-24T21:09:23.769 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-24T21:09:23.769 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-24T21:09:23.769 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-24T21:09:23.769 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-08-24T21:09:26.917 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-5842.g4887e20f.el9.noa 112/129 2024-08-24T21:09:26.988 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-5842.g4887e20f.el9.n 113/129 2024-08-24T21:09:27.076 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-5842.g4887e20f.el9.noa 112/129 2024-08-24T21:09:27.154 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-5842.g4887e20f.el9.n 113/129 2024-08-24T21:09:28.150 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-5842.g4887e20f.el9.n 113/129 2024-08-24T21:09:28.180 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-5842.g488 114/129 2024-08-24T21:09:28.228 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-5842.g4887e20f.el9.n 113/129 2024-08-24T21:09:28.254 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-5842.g488 114/129 2024-08-24T21:09:28.339 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-5842.g488 114/129 2024-08-24T21:09:28.405 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-5842.g488 114/129 2024-08-24T21:09:28.522 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-5842.g4887e20f.el 115/129 2024-08-24T21:09:28.557 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-2:19.0.0-5842.g4887e20f.el9.x86_64 116/129 2024-08-24T21:09:28.586 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-5842.g4887e20f.el 115/129 2024-08-24T21:09:28.608 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-2:19.0.0-5842.g4887e20f.el9.x86_64 116/129 2024-08-24T21:09:28.608 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-24T21:09:28.609 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-24T21:09:28.609 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-24T21:09:28.609 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-24T21:09:28.609 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-08-24T21:09:28.623 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-2:19.0.0-5842.g4887e20f.el9.x86_64 116/129 2024-08-24T21:09:28.666 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-rook-2:19.0.0-5842.g4887e20f.el9.noarch 117/129 2024-08-24T21:09:28.674 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-2:19.0.0-5842.g4887e20f.el9.x86_64 116/129 2024-08-24T21:09:28.674 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-24T21:09:28.675 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-24T21:09:28.675 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-24T21:09:28.675 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-24T21:09:28.675 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-24T21:09:28.692 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-5842.g4887e20f.el9.noarch 117/129 2024-08-24T21:09:28.765 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-rook-2:19.0.0-5842.g4887e20f.el9.noarch 117/129 2024-08-24T21:09:28.791 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-5842.g4887e20f.el9.noarch 117/129 2024-08-24T21:09:28.805 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-2:19.0.0-5842.g4887e20f.el9.x86_64 118/129 2024-08-24T21:09:28.825 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-test-2:19.0.0-5842.g4887e20f.el9.x86_64 123/129 2024-08-24T21:09:28.868 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : rbd-fuse-2:19.0.0-5842.g4887e20f.el9.x86_64 124/129 2024-08-24T21:09:28.890 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : rbd-nbd-2:19.0.0-5842.g4887e20f.el9.x86_64 125/129 2024-08-24T21:09:28.899 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-2:19.0.0-5842.g4887e20f.el9.x86_64 118/129 2024-08-24T21:09:28.931 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libcephfs-devel-2:19.0.0-5842.g4887e20f.el9.x86_ 126/129 2024-08-24T21:09:28.957 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : pv-1.6.20-1.el9.x86_64 127/129 2024-08-24T21:09:28.957 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 128/129 2024-08-24T21:09:29.056 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 128/129 2024-08-24T21:09:29.056 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 129/129 2024-08-24T21:09:29.403 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 129/129 2024-08-24T21:09:29.403 INFO:teuthology.orchestra.run.smithi179.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-08-24T21:09:29.403 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-08-24T21:09:29.919 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-fuse-2:19.0.0-5842.g4887e20f.el9.x86_64 119/129 2024-08-24T21:09:29.951 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-fuse-2:19.0.0-5842.g4887e20f.el9.x86_64 119/129 2024-08-24T21:09:29.951 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-radosgw-2:19.0.0-5842.g4887e20f.el9.x86_64 120/129 2024-08-24T21:09:29.992 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-radosgw-2:19.0.0-5842.g4887e20f.el9.x86_64 120/129 2024-08-24T21:09:30.004 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-5842.g4887e20f.el9.x86_64 120/129 2024-08-24T21:09:30.004 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-24T21:09:30.004 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-24T21:09:30.005 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-24T21:09:30.005 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-24T21:09:30.005 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-08-24T21:09:30.043 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-5842.g4887e20f.el9.x86_64 120/129 2024-08-24T21:09:30.043 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-24T21:09:30.043 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-24T21:09:30.043 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-24T21:09:30.044 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-24T21:09:30.044 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-24T21:09:30.052 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-5842.g4887e 121/129 2024-08-24T21:09:30.093 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-5842.g4887e 121/129 2024-08-24T21:09:30.102 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-5842.g4887e 121/129 2024-08-24T21:09:30.103 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-24T21:09:30.103 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-24T21:09:30.103 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-08-24T21:09:30.142 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-5842.g4887e 121/129 2024-08-24T21:09:30.142 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-24T21:09:30.143 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-24T21:09:30.143 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-24T21:09:30.469 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : rbd-mirror-2:19.0.0-5842.g4887e20f.el9.x86_64 122/129 2024-08-24T21:09:30.485 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : rbd-mirror-2:19.0.0-5842.g4887e20f.el9.x86_64 122/129 2024-08-24T21:09:30.521 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: rbd-mirror-2:19.0.0-5842.g4887e20f.el9.x86_64 122/129 2024-08-24T21:09:30.521 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-24T21:09:30.521 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-24T21:09:30.521 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-24T21:09:30.521 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-24T21:09:30.521 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-08-24T21:09:30.536 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: rbd-mirror-2:19.0.0-5842.g4887e20f.el9.x86_64 122/129 2024-08-24T21:09:30.536 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-24T21:09:30.536 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-24T21:09:30.536 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-24T21:09:30.536 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-24T21:09:30.536 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-24T21:09:34.965 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-2:19.0.0-5842.g4887e20f.el9.x86_64 1/129 2024-08-24T21:09:34.965 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-base-2:19.0.0-5842.g4887e20f.el9.x86_64 2/129 2024-08-24T21:09:34.965 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-common-2:19.0.0-5842.g4887e20f.el9.x86_64 3/129 2024-08-24T21:09:34.966 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-fuse-2:19.0.0-5842.g4887e20f.el9.x86_64 4/129 2024-08-24T21:09:34.966 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-5842.g4887e 5/129 2024-08-24T21:09:34.966 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mds-2:19.0.0-5842.g4887e20f.el9.x86_64 6/129 2024-08-24T21:09:34.966 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-2:19.0.0-5842.g4887e20f.el9.x86_64 7/129 2024-08-24T21:09:34.966 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mon-2:19.0.0-5842.g4887e20f.el9.x86_64 8/129 2024-08-24T21:09:34.966 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-osd-2:19.0.0-5842.g4887e20f.el9.x86_64 9/129 2024-08-24T21:09:34.966 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-radosgw-2:19.0.0-5842.g4887e20f.el9.x86_64 10/129 2024-08-24T21:09:34.966 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-selinux-2:19.0.0-5842.g4887e20f.el9.x86_64 11/129 2024-08-24T21:09:34.966 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-test-2:19.0.0-5842.g4887e20f.el9.x86_64 12/129 2024-08-24T21:09:34.966 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libcephfs-devel-2:19.0.0-5842.g4887e20f.el9.x86_ 13/129 2024-08-24T21:09:34.966 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libcephfs2-2:19.0.0-5842.g4887e20f.el9.x86_64 14/129 2024-08-24T21:09:34.967 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libcephsqlite-2:19.0.0-5842.g4887e20f.el9.x86_64 15/129 2024-08-24T21:09:34.967 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librados-devel-2:19.0.0-5842.g4887e20f.el9.x86_6 16/129 2024-08-24T21:09:34.967 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libradosstriper1-2:19.0.0-5842.g4887e20f.el9.x86 17/129 2024-08-24T21:09:34.967 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librgw2-2:19.0.0-5842.g4887e20f.el9.x86_64 18/129 2024-08-24T21:09:34.967 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-ceph-argparse-2:19.0.0-5842.g4887e20f.el 19/129 2024-08-24T21:09:34.967 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-ceph-common-2:19.0.0-5842.g4887e20f.el9. 20/129 2024-08-24T21:09:34.967 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cephfs-2:19.0.0-5842.g4887e20f.el9.x86_6 21/129 2024-08-24T21:09:34.967 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-rados-2:19.0.0-5842.g4887e20f.el9.x86_64 22/129 2024-08-24T21:09:34.967 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-rbd-2:19.0.0-5842.g4887e20f.el9.x86_64 23/129 2024-08-24T21:09:34.967 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-rgw-2:19.0.0-5842.g4887e20f.el9.x86_64 24/129 2024-08-24T21:09:34.967 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : rbd-fuse-2:19.0.0-5842.g4887e20f.el9.x86_64 25/129 2024-08-24T21:09:34.967 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : rbd-mirror-2:19.0.0-5842.g4887e20f.el9.x86_64 26/129 2024-08-24T21:09:34.968 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : rbd-nbd-2:19.0.0-5842.g4887e20f.el9.x86_64 27/129 2024-08-24T21:09:34.968 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-5842.g4887e20f. 28/129 2024-08-24T21:09:34.968 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-5842.g4887e20f.el9.noa 29/129 2024-08-24T21:09:34.976 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-5842.g4887e20f.el9.n 30/129 2024-08-24T21:09:34.976 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-5842.g488 31/129 2024-08-24T21:09:34.977 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-5842.g4887e20f.el 32/129 2024-08-24T21:09:34.977 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-rook-2:19.0.0-5842.g4887e20f.el9.noarch 33/129 2024-08-24T21:09:34.977 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-5842.g4887e20f.e 34/129 2024-08-24T21:09:34.977 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-volume-2:19.0.0-5842.g4887e20f.el9.noarch 35/129 2024-08-24T21:09:34.977 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : cephadm-2:19.0.0-5842.g4887e20f.el9.noarch 36/129 2024-08-24T21:09:34.977 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 37/129 2024-08-24T21:09:34.977 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 38/129 2024-08-24T21:09:34.977 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 39/129 2024-08-24T21:09:34.977 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 40/129 2024-08-24T21:09:34.977 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 41/129 2024-08-24T21:09:34.977 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-ply-3.11-14.el9.noarch 42/129 2024-08-24T21:09:34.977 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 43/129 2024-08-24T21:09:34.977 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 44/129 2024-08-24T21:09:34.978 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 45/129 2024-08-24T21:09:34.978 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 46/129 2024-08-24T21:09:34.978 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 47/129 2024-08-24T21:09:34.978 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 48/129 2024-08-24T21:09:34.978 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 49/129 2024-08-24T21:09:34.978 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 50/129 2024-08-24T21:09:34.978 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 51/129 2024-08-24T21:09:34.978 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 52/129 2024-08-24T21:09:34.978 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/129 2024-08-24T21:09:34.978 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/129 2024-08-24T21:09:34.978 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openblas-0.3.26-1.el9.x86_64 55/129 2024-08-24T21:09:34.979 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openblas-openmp-0.3.26-1.el9.x86_64 56/129 2024-08-24T21:09:34.979 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 57/129 2024-08-24T21:09:34.979 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 58/129 2024-08-24T21:09:34.979 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-devel-3.9.19-7.el9.x86_64 59/129 2024-08-24T21:09:34.979 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 60/129 2024-08-24T21:09:34.979 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 61/129 2024-08-24T21:09:34.979 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 62/129 2024-08-24T21:09:34.979 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 63/129 2024-08-24T21:09:34.979 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 64/129 2024-08-24T21:09:34.979 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 65/129 2024-08-24T21:09:34.979 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 66/129 2024-08-24T21:09:34.979 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 67/129 2024-08-24T21:09:34.979 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 68/129 2024-08-24T21:09:34.980 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 69/129 2024-08-24T21:09:34.980 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 70/129 2024-08-24T21:09:34.980 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 71/129 2024-08-24T21:09:34.980 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 72/129 2024-08-24T21:09:34.980 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 73/129 2024-08-24T21:09:34.980 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 74/129 2024-08-24T21:09:34.980 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 75/129 2024-08-24T21:09:34.980 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 76/129 2024-08-24T21:09:34.980 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 77/129 2024-08-24T21:09:34.980 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 78/129 2024-08-24T21:09:34.980 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 79/129 2024-08-24T21:09:34.980 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 80/129 2024-08-24T21:09:34.980 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 81/129 2024-08-24T21:09:34.980 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 82/129 2024-08-24T21:09:34.981 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 83/129 2024-08-24T21:09:34.981 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 84/129 2024-08-24T21:09:34.981 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 85/129 2024-08-24T21:09:34.981 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 86/129 2024-08-24T21:09:34.981 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 87/129 2024-08-24T21:09:34.981 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 88/129 2024-08-24T21:09:34.981 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 89/129 2024-08-24T21:09:34.981 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 90/129 2024-08-24T21:09:34.981 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 91/129 2024-08-24T21:09:34.981 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 92/129 2024-08-24T21:09:34.981 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : pv-1.6.20-1.el9.x86_64 93/129 2024-08-24T21:09:34.981 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 94/129 2024-08-24T21:09:34.981 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 95/129 2024-08-24T21:09:34.981 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 96/129 2024-08-24T21:09:34.982 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 97/129 2024-08-24T21:09:34.982 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 98/129 2024-08-24T21:09:34.982 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 99/129 2024-08-24T21:09:34.982 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-google-auth-1:2.33.0-1.el9.noarch 100/129 2024-08-24T21:09:34.982 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 101/129 2024-08-24T21:09:34.982 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 102/129 2024-08-24T21:09:34.982 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 103/129 2024-08-24T21:09:34.982 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 104/129 2024-08-24T21:09:34.982 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 105/129 2024-08-24T21:09:34.982 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 106/129 2024-08-24T21:09:34.982 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 107/129 2024-08-24T21:09:34.982 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 108/129 2024-08-24T21:09:34.982 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 109/129 2024-08-24T21:09:34.982 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 110/129 2024-08-24T21:09:34.983 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 111/129 2024-08-24T21:09:34.983 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 112/129 2024-08-24T21:09:34.983 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 113/129 2024-08-24T21:09:34.983 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 114/129 2024-08-24T21:09:34.983 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 115/129 2024-08-24T21:09:34.983 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 116/129 2024-08-24T21:09:34.983 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 117/129 2024-08-24T21:09:34.983 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 118/129 2024-08-24T21:09:34.983 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 119/129 2024-08-24T21:09:34.983 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 120/129 2024-08-24T21:09:34.983 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 121/129 2024-08-24T21:09:34.983 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 122/129 2024-08-24T21:09:34.984 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 123/129 2024-08-24T21:09:34.984 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : re2-1:20211101-3.el9.x86_64 124/129 2024-08-24T21:09:34.984 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 125/129 2024-08-24T21:09:34.984 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librados2-2:19.0.0-5842.g4887e20f.el9.x86_64 126/129 2024-08-24T21:09:34.984 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 127/129 2024-08-24T21:09:34.984 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librbd1-2:19.0.0-5842.g4887e20f.el9.x86_64 128/129 2024-08-24T21:09:35.593 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-test-2:19.0.0-5842.g4887e20f.el9.x86_64 123/129 2024-08-24T21:09:35.643 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : rbd-fuse-2:19.0.0-5842.g4887e20f.el9.x86_64 124/129 2024-08-24T21:09:35.674 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : rbd-nbd-2:19.0.0-5842.g4887e20f.el9.x86_64 125/129 2024-08-24T21:09:35.720 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libcephfs-devel-2:19.0.0-5842.g4887e20f.el9.x86_ 126/129 2024-08-24T21:09:35.749 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : pv-1.6.20-1.el9.x86_64 127/129 2024-08-24T21:09:35.750 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 128/129 2024-08-24T21:09:35.890 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 128/129 2024-08-24T21:09:35.890 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 129/129 2024-08-24T21:09:35.942 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-test-2:19.0.0-5842.g4887e20f.el9.x86_64 123/129 2024-08-24T21:09:35.992 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : rbd-fuse-2:19.0.0-5842.g4887e20f.el9.x86_64 124/129 2024-08-24T21:09:36.023 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : rbd-nbd-2:19.0.0-5842.g4887e20f.el9.x86_64 125/129 2024-08-24T21:09:36.077 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libcephfs-devel-2:19.0.0-5842.g4887e20f.el9.x86_ 126/129 2024-08-24T21:09:36.115 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : pv-1.6.20-1.el9.x86_64 127/129 2024-08-24T21:09:36.115 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 128/129 2024-08-24T21:09:36.230 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 128/129 2024-08-24T21:09:36.230 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 129/129 2024-08-24T21:09:36.306 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 129/129 2024-08-24T21:09:36.306 INFO:teuthology.orchestra.run.smithi119.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-08-24T21:09:36.306 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-24T21:09:36.603 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 129/129 2024-08-24T21:09:36.603 INFO:teuthology.orchestra.run.smithi060.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-08-24T21:09:36.603 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-08-24T21:09:37.116 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 129/129 2024-08-24T21:09:37.116 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-08-24T21:09:37.116 INFO:teuthology.orchestra.run.smithi179.stdout:Upgraded: 2024-08-24T21:09:37.116 INFO:teuthology.orchestra.run.smithi179.stdout: librados2-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:37.116 INFO:teuthology.orchestra.run.smithi179.stdout: librbd1-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:37.116 INFO:teuthology.orchestra.run.smithi179.stdout:Installed: 2024-08-24T21:09:37.116 INFO:teuthology.orchestra.run.smithi179.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-08-24T21:09:37.116 INFO:teuthology.orchestra.run.smithi179.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-08-24T21:09:37.116 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:37.116 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-base-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:37.117 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-common-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:37.117 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-fuse-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:37.117 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-grafana-dashboards-2:19.0.0-5842.g4887e20f.el9.noarch 2024-08-24T21:09:37.117 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-immutable-object-cache-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:37.117 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mds-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:37.117 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:37.117 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-cephadm-2:19.0.0-5842.g4887e20f.el9.noarch 2024-08-24T21:09:37.117 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-dashboard-2:19.0.0-5842.g4887e20f.el9.noarch 2024-08-24T21:09:37.117 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-diskprediction-local-2:19.0.0-5842.g4887e20f.el9.noarch 2024-08-24T21:09:37.117 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-modules-core-2:19.0.0-5842.g4887e20f.el9.noarch 2024-08-24T21:09:37.117 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-rook-2:19.0.0-5842.g4887e20f.el9.noarch 2024-08-24T21:09:37.117 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mon-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:37.118 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-osd-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:37.118 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-prometheus-alerts-2:19.0.0-5842.g4887e20f.el9.noarch 2024-08-24T21:09:37.118 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-radosgw-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:37.118 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-selinux-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:37.118 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-test-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:37.118 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-volume-2:19.0.0-5842.g4887e20f.el9.noarch 2024-08-24T21:09:37.118 INFO:teuthology.orchestra.run.smithi179.stdout: cephadm-2:19.0.0-5842.g4887e20f.el9.noarch 2024-08-24T21:09:37.118 INFO:teuthology.orchestra.run.smithi179.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-24T21:09:37.118 INFO:teuthology.orchestra.run.smithi179.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-24T21:09:37.118 INFO:teuthology.orchestra.run.smithi179.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-24T21:09:37.118 INFO:teuthology.orchestra.run.smithi179.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-24T21:09:37.118 INFO:teuthology.orchestra.run.smithi179.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-24T21:09:37.118 INFO:teuthology.orchestra.run.smithi179.stdout: grpc-data-1.46.7-10.el9.noarch 2024-08-24T21:09:37.119 INFO:teuthology.orchestra.run.smithi179.stdout: libarrow-9.0.0-11.el9.x86_64 2024-08-24T21:09:37.119 INFO:teuthology.orchestra.run.smithi179.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-08-24T21:09:37.119 INFO:teuthology.orchestra.run.smithi179.stdout: libcephfs-devel-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:37.119 INFO:teuthology.orchestra.run.smithi179.stdout: libcephfs2-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:37.119 INFO:teuthology.orchestra.run.smithi179.stdout: libcephsqlite-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:37.119 INFO:teuthology.orchestra.run.smithi179.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-08-24T21:09:37.119 INFO:teuthology.orchestra.run.smithi179.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-24T21:09:37.119 INFO:teuthology.orchestra.run.smithi179.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-24T21:09:37.119 INFO:teuthology.orchestra.run.smithi179.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-08-24T21:09:37.119 INFO:teuthology.orchestra.run.smithi179.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-24T21:09:37.119 INFO:teuthology.orchestra.run.smithi179.stdout: librados-devel-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:37.120 INFO:teuthology.orchestra.run.smithi179.stdout: libradosstriper1-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:37.120 INFO:teuthology.orchestra.run.smithi179.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-24T21:09:37.120 INFO:teuthology.orchestra.run.smithi179.stdout: librgw2-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:37.120 INFO:teuthology.orchestra.run.smithi179.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-24T21:09:37.120 INFO:teuthology.orchestra.run.smithi179.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-24T21:09:37.120 INFO:teuthology.orchestra.run.smithi179.stdout: lua-5.4.4-4.el9.x86_64 2024-08-24T21:09:37.120 INFO:teuthology.orchestra.run.smithi179.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-08-24T21:09:37.120 INFO:teuthology.orchestra.run.smithi179.stdout: luarocks-3.9.2-5.el9.noarch 2024-08-24T21:09:37.120 INFO:teuthology.orchestra.run.smithi179.stdout: openblas-0.3.26-1.el9.x86_64 2024-08-24T21:09:37.120 INFO:teuthology.orchestra.run.smithi179.stdout: openblas-openmp-0.3.26-1.el9.x86_64 2024-08-24T21:09:37.120 INFO:teuthology.orchestra.run.smithi179.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-08-24T21:09:37.120 INFO:teuthology.orchestra.run.smithi179.stdout: protobuf-3.14.0-13.el9.x86_64 2024-08-24T21:09:37.121 INFO:teuthology.orchestra.run.smithi179.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-08-24T21:09:37.121 INFO:teuthology.orchestra.run.smithi179.stdout: pv-1.6.20-1.el9.x86_64 2024-08-24T21:09:37.121 INFO:teuthology.orchestra.run.smithi179.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-24T21:09:37.121 INFO:teuthology.orchestra.run.smithi179.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-24T21:09:37.121 INFO:teuthology.orchestra.run.smithi179.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-24T21:09:37.121 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-24T21:09:37.121 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-argparse-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:37.121 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-common-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:37.121 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cephfs-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:37.121 INFO:teuthology.orchestra.run.smithi179.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-24T21:09:37.121 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-24T21:09:37.122 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-24T21:09:37.122 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-24T21:09:37.122 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-24T21:09:37.122 INFO:teuthology.orchestra.run.smithi179.stdout: python3-devel-3.9.19-7.el9.x86_64 2024-08-24T21:09:37.122 INFO:teuthology.orchestra.run.smithi179.stdout: python3-google-auth-1:2.33.0-1.el9.noarch 2024-08-24T21:09:37.122 INFO:teuthology.orchestra.run.smithi179.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-08-24T21:09:37.122 INFO:teuthology.orchestra.run.smithi179.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-08-24T21:09:37.122 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-24T21:09:37.122 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-24T21:09:37.122 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-24T21:09:37.122 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-24T21:09:37.122 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-24T21:09:37.122 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-24T21:09:37.123 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-24T21:09:37.123 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-24T21:09:37.123 INFO:teuthology.orchestra.run.smithi179.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-24T21:09:37.123 INFO:teuthology.orchestra.run.smithi179.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-24T21:09:37.123 INFO:teuthology.orchestra.run.smithi179.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-24T21:09:37.123 INFO:teuthology.orchestra.run.smithi179.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-24T21:09:37.123 INFO:teuthology.orchestra.run.smithi179.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-24T21:09:37.123 INFO:teuthology.orchestra.run.smithi179.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-24T21:09:37.123 INFO:teuthology.orchestra.run.smithi179.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-24T21:09:37.123 INFO:teuthology.orchestra.run.smithi179.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-24T21:09:37.123 INFO:teuthology.orchestra.run.smithi179.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-24T21:09:37.124 INFO:teuthology.orchestra.run.smithi179.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-24T21:09:37.124 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-24T21:09:37.124 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ply-3.11-14.el9.noarch 2024-08-24T21:09:37.124 INFO:teuthology.orchestra.run.smithi179.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-24T21:09:37.124 INFO:teuthology.orchestra.run.smithi179.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-24T21:09:37.124 INFO:teuthology.orchestra.run.smithi179.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-08-24T21:09:37.124 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-24T21:09:37.124 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-24T21:09:37.124 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-24T21:09:37.124 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-24T21:09:37.124 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-24T21:09:37.124 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rados-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:37.124 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rbd-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:37.124 INFO:teuthology.orchestra.run.smithi179.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-24T21:09:37.124 INFO:teuthology.orchestra.run.smithi179.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-24T21:09:37.125 INFO:teuthology.orchestra.run.smithi179.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-24T21:09:37.125 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rgw-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:37.125 INFO:teuthology.orchestra.run.smithi179.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-24T21:09:37.125 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-24T21:09:37.125 INFO:teuthology.orchestra.run.smithi179.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-24T21:09:37.125 INFO:teuthology.orchestra.run.smithi179.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-24T21:09:37.125 INFO:teuthology.orchestra.run.smithi179.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-24T21:09:37.125 INFO:teuthology.orchestra.run.smithi179.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-24T21:09:37.125 INFO:teuthology.orchestra.run.smithi179.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-24T21:09:37.125 INFO:teuthology.orchestra.run.smithi179.stdout: python3-webob-1.8.7-6.el9.noarch 2024-08-24T21:09:37.125 INFO:teuthology.orchestra.run.smithi179.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-24T21:09:37.125 INFO:teuthology.orchestra.run.smithi179.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-24T21:09:37.126 INFO:teuthology.orchestra.run.smithi179.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-24T21:09:37.126 INFO:teuthology.orchestra.run.smithi179.stdout: qatlib-24.02.0-1.el9.x86_64 2024-08-24T21:09:37.126 INFO:teuthology.orchestra.run.smithi179.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-08-24T21:09:37.126 INFO:teuthology.orchestra.run.smithi179.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-08-24T21:09:37.126 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-fuse-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:37.126 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-mirror-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:37.126 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-nbd-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:37.126 INFO:teuthology.orchestra.run.smithi179.stdout: re2-1:20211101-3.el9.x86_64 2024-08-24T21:09:37.126 INFO:teuthology.orchestra.run.smithi179.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-24T21:09:37.126 INFO:teuthology.orchestra.run.smithi179.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-24T21:09:37.126 INFO:teuthology.orchestra.run.smithi179.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-24T21:09:37.127 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-08-24T21:09:37.127 INFO:teuthology.orchestra.run.smithi179.stdout:Complete! 2024-08-24T21:09:37.615 DEBUG:teuthology.parallel:result is None 2024-08-24T21:09:42.068 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-2:19.0.0-5842.g4887e20f.el9.x86_64 1/129 2024-08-24T21:09:42.068 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-base-2:19.0.0-5842.g4887e20f.el9.x86_64 2/129 2024-08-24T21:09:42.068 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-common-2:19.0.0-5842.g4887e20f.el9.x86_64 3/129 2024-08-24T21:09:42.068 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-fuse-2:19.0.0-5842.g4887e20f.el9.x86_64 4/129 2024-08-24T21:09:42.068 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-5842.g4887e 5/129 2024-08-24T21:09:42.068 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mds-2:19.0.0-5842.g4887e20f.el9.x86_64 6/129 2024-08-24T21:09:42.068 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-2:19.0.0-5842.g4887e20f.el9.x86_64 7/129 2024-08-24T21:09:42.068 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mon-2:19.0.0-5842.g4887e20f.el9.x86_64 8/129 2024-08-24T21:09:42.068 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-osd-2:19.0.0-5842.g4887e20f.el9.x86_64 9/129 2024-08-24T21:09:42.068 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-radosgw-2:19.0.0-5842.g4887e20f.el9.x86_64 10/129 2024-08-24T21:09:42.069 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-selinux-2:19.0.0-5842.g4887e20f.el9.x86_64 11/129 2024-08-24T21:09:42.069 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-test-2:19.0.0-5842.g4887e20f.el9.x86_64 12/129 2024-08-24T21:09:42.069 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libcephfs-devel-2:19.0.0-5842.g4887e20f.el9.x86_ 13/129 2024-08-24T21:09:42.069 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libcephfs2-2:19.0.0-5842.g4887e20f.el9.x86_64 14/129 2024-08-24T21:09:42.069 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libcephsqlite-2:19.0.0-5842.g4887e20f.el9.x86_64 15/129 2024-08-24T21:09:42.069 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librados-devel-2:19.0.0-5842.g4887e20f.el9.x86_6 16/129 2024-08-24T21:09:42.069 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libradosstriper1-2:19.0.0-5842.g4887e20f.el9.x86 17/129 2024-08-24T21:09:42.069 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librgw2-2:19.0.0-5842.g4887e20f.el9.x86_64 18/129 2024-08-24T21:09:42.069 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-ceph-argparse-2:19.0.0-5842.g4887e20f.el 19/129 2024-08-24T21:09:42.069 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-ceph-common-2:19.0.0-5842.g4887e20f.el9. 20/129 2024-08-24T21:09:42.069 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cephfs-2:19.0.0-5842.g4887e20f.el9.x86_6 21/129 2024-08-24T21:09:42.069 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-rados-2:19.0.0-5842.g4887e20f.el9.x86_64 22/129 2024-08-24T21:09:42.070 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-rbd-2:19.0.0-5842.g4887e20f.el9.x86_64 23/129 2024-08-24T21:09:42.070 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-rgw-2:19.0.0-5842.g4887e20f.el9.x86_64 24/129 2024-08-24T21:09:42.070 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : rbd-fuse-2:19.0.0-5842.g4887e20f.el9.x86_64 25/129 2024-08-24T21:09:42.070 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : rbd-mirror-2:19.0.0-5842.g4887e20f.el9.x86_64 26/129 2024-08-24T21:09:42.070 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : rbd-nbd-2:19.0.0-5842.g4887e20f.el9.x86_64 27/129 2024-08-24T21:09:42.070 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-5842.g4887e20f. 28/129 2024-08-24T21:09:42.070 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-5842.g4887e20f.el9.noa 29/129 2024-08-24T21:09:42.070 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-5842.g4887e20f.el9.n 30/129 2024-08-24T21:09:42.070 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-5842.g488 31/129 2024-08-24T21:09:42.070 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-5842.g4887e20f.el 32/129 2024-08-24T21:09:42.070 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-rook-2:19.0.0-5842.g4887e20f.el9.noarch 33/129 2024-08-24T21:09:42.070 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-5842.g4887e20f.e 34/129 2024-08-24T21:09:42.070 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-volume-2:19.0.0-5842.g4887e20f.el9.noarch 35/129 2024-08-24T21:09:42.070 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : cephadm-2:19.0.0-5842.g4887e20f.el9.noarch 36/129 2024-08-24T21:09:42.071 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 37/129 2024-08-24T21:09:42.071 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 38/129 2024-08-24T21:09:42.071 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 39/129 2024-08-24T21:09:42.071 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 40/129 2024-08-24T21:09:42.071 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 41/129 2024-08-24T21:09:42.071 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-ply-3.11-14.el9.noarch 42/129 2024-08-24T21:09:42.071 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 43/129 2024-08-24T21:09:42.071 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 44/129 2024-08-24T21:09:42.071 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 45/129 2024-08-24T21:09:42.071 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 46/129 2024-08-24T21:09:42.071 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 47/129 2024-08-24T21:09:42.071 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 48/129 2024-08-24T21:09:42.071 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 49/129 2024-08-24T21:09:42.071 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 50/129 2024-08-24T21:09:42.072 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 51/129 2024-08-24T21:09:42.072 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 52/129 2024-08-24T21:09:42.072 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/129 2024-08-24T21:09:42.072 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/129 2024-08-24T21:09:42.072 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openblas-0.3.26-1.el9.x86_64 55/129 2024-08-24T21:09:42.072 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openblas-openmp-0.3.26-1.el9.x86_64 56/129 2024-08-24T21:09:42.072 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 57/129 2024-08-24T21:09:42.072 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 58/129 2024-08-24T21:09:42.072 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-devel-3.9.19-7.el9.x86_64 59/129 2024-08-24T21:09:42.072 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 60/129 2024-08-24T21:09:42.072 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 61/129 2024-08-24T21:09:42.072 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 62/129 2024-08-24T21:09:42.072 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 63/129 2024-08-24T21:09:42.072 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 64/129 2024-08-24T21:09:42.073 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 65/129 2024-08-24T21:09:42.073 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 66/129 2024-08-24T21:09:42.073 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 67/129 2024-08-24T21:09:42.073 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 68/129 2024-08-24T21:09:42.073 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 69/129 2024-08-24T21:09:42.073 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 70/129 2024-08-24T21:09:42.073 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 71/129 2024-08-24T21:09:42.073 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 72/129 2024-08-24T21:09:42.073 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 73/129 2024-08-24T21:09:42.073 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 74/129 2024-08-24T21:09:42.073 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 75/129 2024-08-24T21:09:42.073 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 76/129 2024-08-24T21:09:42.073 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 77/129 2024-08-24T21:09:42.073 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 78/129 2024-08-24T21:09:42.074 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 79/129 2024-08-24T21:09:42.074 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 80/129 2024-08-24T21:09:42.074 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 81/129 2024-08-24T21:09:42.074 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 82/129 2024-08-24T21:09:42.074 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 83/129 2024-08-24T21:09:42.074 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 84/129 2024-08-24T21:09:42.074 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 85/129 2024-08-24T21:09:42.074 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 86/129 2024-08-24T21:09:42.074 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 87/129 2024-08-24T21:09:42.074 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 88/129 2024-08-24T21:09:42.074 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 89/129 2024-08-24T21:09:42.074 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 90/129 2024-08-24T21:09:42.074 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 91/129 2024-08-24T21:09:42.074 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 92/129 2024-08-24T21:09:42.075 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : pv-1.6.20-1.el9.x86_64 93/129 2024-08-24T21:09:42.075 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 94/129 2024-08-24T21:09:42.075 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 95/129 2024-08-24T21:09:42.075 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 96/129 2024-08-24T21:09:42.075 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 97/129 2024-08-24T21:09:42.075 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 98/129 2024-08-24T21:09:42.075 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 99/129 2024-08-24T21:09:42.075 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-google-auth-1:2.33.0-1.el9.noarch 100/129 2024-08-24T21:09:42.075 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 101/129 2024-08-24T21:09:42.075 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 102/129 2024-08-24T21:09:42.075 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 103/129 2024-08-24T21:09:42.075 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 104/129 2024-08-24T21:09:42.075 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 105/129 2024-08-24T21:09:42.076 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 106/129 2024-08-24T21:09:42.076 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 107/129 2024-08-24T21:09:42.076 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 108/129 2024-08-24T21:09:42.076 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 109/129 2024-08-24T21:09:42.076 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 110/129 2024-08-24T21:09:42.076 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 111/129 2024-08-24T21:09:42.076 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 112/129 2024-08-24T21:09:42.076 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 113/129 2024-08-24T21:09:42.076 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 114/129 2024-08-24T21:09:42.077 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 115/129 2024-08-24T21:09:42.078 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 116/129 2024-08-24T21:09:42.078 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 117/129 2024-08-24T21:09:42.078 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 118/129 2024-08-24T21:09:42.078 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 119/129 2024-08-24T21:09:42.078 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 120/129 2024-08-24T21:09:42.078 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 121/129 2024-08-24T21:09:42.078 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 122/129 2024-08-24T21:09:42.078 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 123/129 2024-08-24T21:09:42.079 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : re2-1:20211101-3.el9.x86_64 124/129 2024-08-24T21:09:42.079 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 125/129 2024-08-24T21:09:42.079 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librados2-2:19.0.0-5842.g4887e20f.el9.x86_64 126/129 2024-08-24T21:09:42.079 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 127/129 2024-08-24T21:09:42.079 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librbd1-2:19.0.0-5842.g4887e20f.el9.x86_64 128/129 2024-08-24T21:09:42.092 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-2:19.0.0-5842.g4887e20f.el9.x86_64 1/129 2024-08-24T21:09:42.092 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-base-2:19.0.0-5842.g4887e20f.el9.x86_64 2/129 2024-08-24T21:09:42.092 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-common-2:19.0.0-5842.g4887e20f.el9.x86_64 3/129 2024-08-24T21:09:42.092 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-fuse-2:19.0.0-5842.g4887e20f.el9.x86_64 4/129 2024-08-24T21:09:42.092 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-5842.g4887e 5/129 2024-08-24T21:09:42.092 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mds-2:19.0.0-5842.g4887e20f.el9.x86_64 6/129 2024-08-24T21:09:42.093 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-2:19.0.0-5842.g4887e20f.el9.x86_64 7/129 2024-08-24T21:09:42.093 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mon-2:19.0.0-5842.g4887e20f.el9.x86_64 8/129 2024-08-24T21:09:42.093 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-osd-2:19.0.0-5842.g4887e20f.el9.x86_64 9/129 2024-08-24T21:09:42.093 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-radosgw-2:19.0.0-5842.g4887e20f.el9.x86_64 10/129 2024-08-24T21:09:42.093 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-selinux-2:19.0.0-5842.g4887e20f.el9.x86_64 11/129 2024-08-24T21:09:42.093 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-test-2:19.0.0-5842.g4887e20f.el9.x86_64 12/129 2024-08-24T21:09:42.093 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libcephfs-devel-2:19.0.0-5842.g4887e20f.el9.x86_ 13/129 2024-08-24T21:09:42.093 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libcephfs2-2:19.0.0-5842.g4887e20f.el9.x86_64 14/129 2024-08-24T21:09:42.093 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libcephsqlite-2:19.0.0-5842.g4887e20f.el9.x86_64 15/129 2024-08-24T21:09:42.093 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librados-devel-2:19.0.0-5842.g4887e20f.el9.x86_6 16/129 2024-08-24T21:09:42.093 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libradosstriper1-2:19.0.0-5842.g4887e20f.el9.x86 17/129 2024-08-24T21:09:42.093 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librgw2-2:19.0.0-5842.g4887e20f.el9.x86_64 18/129 2024-08-24T21:09:42.093 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-ceph-argparse-2:19.0.0-5842.g4887e20f.el 19/129 2024-08-24T21:09:42.094 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-ceph-common-2:19.0.0-5842.g4887e20f.el9. 20/129 2024-08-24T21:09:42.094 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cephfs-2:19.0.0-5842.g4887e20f.el9.x86_6 21/129 2024-08-24T21:09:42.094 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rados-2:19.0.0-5842.g4887e20f.el9.x86_64 22/129 2024-08-24T21:09:42.094 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rbd-2:19.0.0-5842.g4887e20f.el9.x86_64 23/129 2024-08-24T21:09:42.094 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rgw-2:19.0.0-5842.g4887e20f.el9.x86_64 24/129 2024-08-24T21:09:42.094 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : rbd-fuse-2:19.0.0-5842.g4887e20f.el9.x86_64 25/129 2024-08-24T21:09:42.094 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : rbd-mirror-2:19.0.0-5842.g4887e20f.el9.x86_64 26/129 2024-08-24T21:09:42.094 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : rbd-nbd-2:19.0.0-5842.g4887e20f.el9.x86_64 27/129 2024-08-24T21:09:42.094 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-5842.g4887e20f. 28/129 2024-08-24T21:09:42.094 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-5842.g4887e20f.el9.noa 29/129 2024-08-24T21:09:42.094 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-5842.g4887e20f.el9.n 30/129 2024-08-24T21:09:42.094 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-5842.g488 31/129 2024-08-24T21:09:42.094 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-5842.g4887e20f.el 32/129 2024-08-24T21:09:42.094 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-rook-2:19.0.0-5842.g4887e20f.el9.noarch 33/129 2024-08-24T21:09:42.095 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-5842.g4887e20f.e 34/129 2024-08-24T21:09:42.095 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-volume-2:19.0.0-5842.g4887e20f.el9.noarch 35/129 2024-08-24T21:09:42.095 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : cephadm-2:19.0.0-5842.g4887e20f.el9.noarch 36/129 2024-08-24T21:09:42.095 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 37/129 2024-08-24T21:09:42.095 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 38/129 2024-08-24T21:09:42.095 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 39/129 2024-08-24T21:09:42.095 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 40/129 2024-08-24T21:09:42.095 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 41/129 2024-08-24T21:09:42.095 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-ply-3.11-14.el9.noarch 42/129 2024-08-24T21:09:42.095 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 43/129 2024-08-24T21:09:42.095 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 44/129 2024-08-24T21:09:42.095 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 45/129 2024-08-24T21:09:42.096 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 46/129 2024-08-24T21:09:42.096 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 47/129 2024-08-24T21:09:42.096 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 48/129 2024-08-24T21:09:42.096 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 49/129 2024-08-24T21:09:42.096 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 50/129 2024-08-24T21:09:42.096 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 51/129 2024-08-24T21:09:42.096 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 52/129 2024-08-24T21:09:42.096 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/129 2024-08-24T21:09:42.096 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/129 2024-08-24T21:09:42.096 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openblas-0.3.26-1.el9.x86_64 55/129 2024-08-24T21:09:42.096 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openblas-openmp-0.3.26-1.el9.x86_64 56/129 2024-08-24T21:09:42.096 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 57/129 2024-08-24T21:09:42.096 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 58/129 2024-08-24T21:09:42.096 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-devel-3.9.19-7.el9.x86_64 59/129 2024-08-24T21:09:42.097 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 60/129 2024-08-24T21:09:42.097 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 61/129 2024-08-24T21:09:42.097 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 62/129 2024-08-24T21:09:42.097 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 63/129 2024-08-24T21:09:42.097 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 64/129 2024-08-24T21:09:42.097 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 65/129 2024-08-24T21:09:42.097 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 66/129 2024-08-24T21:09:42.097 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 67/129 2024-08-24T21:09:42.097 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 68/129 2024-08-24T21:09:42.097 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 69/129 2024-08-24T21:09:42.097 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 70/129 2024-08-24T21:09:42.097 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 71/129 2024-08-24T21:09:42.097 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 72/129 2024-08-24T21:09:42.097 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 73/129 2024-08-24T21:09:42.098 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 74/129 2024-08-24T21:09:42.098 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 75/129 2024-08-24T21:09:42.098 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 76/129 2024-08-24T21:09:42.098 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 77/129 2024-08-24T21:09:42.098 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 78/129 2024-08-24T21:09:42.098 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 79/129 2024-08-24T21:09:42.098 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 80/129 2024-08-24T21:09:42.098 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 81/129 2024-08-24T21:09:42.098 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 82/129 2024-08-24T21:09:42.098 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 83/129 2024-08-24T21:09:42.098 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 84/129 2024-08-24T21:09:42.098 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 85/129 2024-08-24T21:09:42.098 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 86/129 2024-08-24T21:09:42.098 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 87/129 2024-08-24T21:09:42.098 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 88/129 2024-08-24T21:09:42.099 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 89/129 2024-08-24T21:09:42.099 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 90/129 2024-08-24T21:09:42.099 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 91/129 2024-08-24T21:09:42.099 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 92/129 2024-08-24T21:09:42.099 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : pv-1.6.20-1.el9.x86_64 93/129 2024-08-24T21:09:42.099 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 94/129 2024-08-24T21:09:42.099 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 95/129 2024-08-24T21:09:42.099 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 96/129 2024-08-24T21:09:42.099 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 97/129 2024-08-24T21:09:42.099 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 98/129 2024-08-24T21:09:42.099 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 99/129 2024-08-24T21:09:42.099 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-google-auth-1:2.33.0-1.el9.noarch 100/129 2024-08-24T21:09:42.100 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 101/129 2024-08-24T21:09:42.100 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 102/129 2024-08-24T21:09:42.100 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 103/129 2024-08-24T21:09:42.100 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 104/129 2024-08-24T21:09:42.100 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 105/129 2024-08-24T21:09:42.100 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 106/129 2024-08-24T21:09:42.100 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 107/129 2024-08-24T21:09:42.100 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 108/129 2024-08-24T21:09:42.100 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 109/129 2024-08-24T21:09:42.100 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 110/129 2024-08-24T21:09:42.100 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 111/129 2024-08-24T21:09:42.100 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 112/129 2024-08-24T21:09:42.101 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 113/129 2024-08-24T21:09:42.101 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 114/129 2024-08-24T21:09:42.101 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 115/129 2024-08-24T21:09:42.101 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 116/129 2024-08-24T21:09:42.101 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 117/129 2024-08-24T21:09:42.101 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 118/129 2024-08-24T21:09:42.101 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 119/129 2024-08-24T21:09:42.101 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 120/129 2024-08-24T21:09:42.101 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 121/129 2024-08-24T21:09:42.101 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 122/129 2024-08-24T21:09:42.101 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 123/129 2024-08-24T21:09:42.101 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : re2-1:20211101-3.el9.x86_64 124/129 2024-08-24T21:09:42.101 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 125/129 2024-08-24T21:09:42.101 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librados2-2:19.0.0-5842.g4887e20f.el9.x86_64 126/129 2024-08-24T21:09:42.101 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 127/129 2024-08-24T21:09:42.102 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librbd1-2:19.0.0-5842.g4887e20f.el9.x86_64 128/129 2024-08-24T21:09:44.381 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 129/129 2024-08-24T21:09:44.381 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-08-24T21:09:44.381 INFO:teuthology.orchestra.run.smithi060.stdout:Upgraded: 2024-08-24T21:09:44.381 INFO:teuthology.orchestra.run.smithi060.stdout: librados2-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:44.381 INFO:teuthology.orchestra.run.smithi060.stdout: librbd1-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:44.381 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2024-08-24T21:09:44.381 INFO:teuthology.orchestra.run.smithi060.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-08-24T21:09:44.381 INFO:teuthology.orchestra.run.smithi060.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-08-24T21:09:44.382 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:44.382 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-base-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:44.382 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-common-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:44.382 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-fuse-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:44.382 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-grafana-dashboards-2:19.0.0-5842.g4887e20f.el9.noarch 2024-08-24T21:09:44.382 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-immutable-object-cache-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:44.382 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mds-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:44.382 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:44.382 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-cephadm-2:19.0.0-5842.g4887e20f.el9.noarch 2024-08-24T21:09:44.382 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-dashboard-2:19.0.0-5842.g4887e20f.el9.noarch 2024-08-24T21:09:44.382 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-diskprediction-local-2:19.0.0-5842.g4887e20f.el9.noarch 2024-08-24T21:09:44.382 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-modules-core-2:19.0.0-5842.g4887e20f.el9.noarch 2024-08-24T21:09:44.383 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-rook-2:19.0.0-5842.g4887e20f.el9.noarch 2024-08-24T21:09:44.383 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mon-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:44.383 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-osd-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:44.383 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-prometheus-alerts-2:19.0.0-5842.g4887e20f.el9.noarch 2024-08-24T21:09:44.383 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-radosgw-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:44.383 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-selinux-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:44.383 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-test-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:44.383 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-volume-2:19.0.0-5842.g4887e20f.el9.noarch 2024-08-24T21:09:44.383 INFO:teuthology.orchestra.run.smithi060.stdout: cephadm-2:19.0.0-5842.g4887e20f.el9.noarch 2024-08-24T21:09:44.383 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-24T21:09:44.383 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-24T21:09:44.384 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-24T21:09:44.384 INFO:teuthology.orchestra.run.smithi060.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-24T21:09:44.384 INFO:teuthology.orchestra.run.smithi060.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-24T21:09:44.384 INFO:teuthology.orchestra.run.smithi060.stdout: grpc-data-1.46.7-10.el9.noarch 2024-08-24T21:09:44.384 INFO:teuthology.orchestra.run.smithi060.stdout: libarrow-9.0.0-11.el9.x86_64 2024-08-24T21:09:44.384 INFO:teuthology.orchestra.run.smithi060.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-08-24T21:09:44.384 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs-devel-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:44.384 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs2-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:44.384 INFO:teuthology.orchestra.run.smithi060.stdout: libcephsqlite-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:44.384 INFO:teuthology.orchestra.run.smithi060.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-08-24T21:09:44.384 INFO:teuthology.orchestra.run.smithi060.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-24T21:09:44.385 INFO:teuthology.orchestra.run.smithi060.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-24T21:09:44.385 INFO:teuthology.orchestra.run.smithi060.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-08-24T21:09:44.385 INFO:teuthology.orchestra.run.smithi060.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-24T21:09:44.385 INFO:teuthology.orchestra.run.smithi060.stdout: librados-devel-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:44.385 INFO:teuthology.orchestra.run.smithi060.stdout: libradosstriper1-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:44.385 INFO:teuthology.orchestra.run.smithi060.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-24T21:09:44.385 INFO:teuthology.orchestra.run.smithi060.stdout: librgw2-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:44.385 INFO:teuthology.orchestra.run.smithi060.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-24T21:09:44.385 INFO:teuthology.orchestra.run.smithi060.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-24T21:09:44.385 INFO:teuthology.orchestra.run.smithi060.stdout: lua-5.4.4-4.el9.x86_64 2024-08-24T21:09:44.385 INFO:teuthology.orchestra.run.smithi060.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-08-24T21:09:44.385 INFO:teuthology.orchestra.run.smithi060.stdout: luarocks-3.9.2-5.el9.noarch 2024-08-24T21:09:44.385 INFO:teuthology.orchestra.run.smithi060.stdout: openblas-0.3.26-1.el9.x86_64 2024-08-24T21:09:44.386 INFO:teuthology.orchestra.run.smithi060.stdout: openblas-openmp-0.3.26-1.el9.x86_64 2024-08-24T21:09:44.386 INFO:teuthology.orchestra.run.smithi060.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-08-24T21:09:44.386 INFO:teuthology.orchestra.run.smithi060.stdout: protobuf-3.14.0-13.el9.x86_64 2024-08-24T21:09:44.386 INFO:teuthology.orchestra.run.smithi060.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-08-24T21:09:44.386 INFO:teuthology.orchestra.run.smithi060.stdout: pv-1.6.20-1.el9.x86_64 2024-08-24T21:09:44.386 INFO:teuthology.orchestra.run.smithi060.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-24T21:09:44.386 INFO:teuthology.orchestra.run.smithi060.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-24T21:09:44.386 INFO:teuthology.orchestra.run.smithi060.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-24T21:09:44.386 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-24T21:09:44.386 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-argparse-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:44.386 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-common-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:44.386 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cephfs-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:44.386 INFO:teuthology.orchestra.run.smithi060.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-24T21:09:44.387 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-24T21:09:44.387 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-24T21:09:44.387 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-24T21:09:44.387 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-24T21:09:44.387 INFO:teuthology.orchestra.run.smithi060.stdout: python3-devel-3.9.19-7.el9.x86_64 2024-08-24T21:09:44.387 INFO:teuthology.orchestra.run.smithi060.stdout: python3-google-auth-1:2.33.0-1.el9.noarch 2024-08-24T21:09:44.387 INFO:teuthology.orchestra.run.smithi060.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-08-24T21:09:44.387 INFO:teuthology.orchestra.run.smithi060.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-08-24T21:09:44.387 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-24T21:09:44.387 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-24T21:09:44.387 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-24T21:09:44.387 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-24T21:09:44.387 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-24T21:09:44.388 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-24T21:09:44.388 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-24T21:09:44.388 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-24T21:09:44.388 INFO:teuthology.orchestra.run.smithi060.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-24T21:09:44.388 INFO:teuthology.orchestra.run.smithi060.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-24T21:09:44.388 INFO:teuthology.orchestra.run.smithi060.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-24T21:09:44.388 INFO:teuthology.orchestra.run.smithi060.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-24T21:09:44.388 INFO:teuthology.orchestra.run.smithi060.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-24T21:09:44.388 INFO:teuthology.orchestra.run.smithi060.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-24T21:09:44.388 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-24T21:09:44.388 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-24T21:09:44.388 INFO:teuthology.orchestra.run.smithi060.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-24T21:09:44.388 INFO:teuthology.orchestra.run.smithi060.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-24T21:09:44.389 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-24T21:09:44.389 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ply-3.11-14.el9.noarch 2024-08-24T21:09:44.389 INFO:teuthology.orchestra.run.smithi060.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-24T21:09:44.389 INFO:teuthology.orchestra.run.smithi060.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-24T21:09:44.389 INFO:teuthology.orchestra.run.smithi060.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-08-24T21:09:44.389 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-24T21:09:44.389 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-24T21:09:44.389 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-24T21:09:44.389 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-24T21:09:44.389 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-24T21:09:44.389 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rados-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:44.389 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rbd-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:44.389 INFO:teuthology.orchestra.run.smithi060.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-24T21:09:44.389 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-24T21:09:44.390 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-24T21:09:44.390 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rgw-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:44.390 INFO:teuthology.orchestra.run.smithi060.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-24T21:09:44.390 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-24T21:09:44.390 INFO:teuthology.orchestra.run.smithi060.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-24T21:09:44.390 INFO:teuthology.orchestra.run.smithi060.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-24T21:09:44.390 INFO:teuthology.orchestra.run.smithi060.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-24T21:09:44.390 INFO:teuthology.orchestra.run.smithi060.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-24T21:09:44.390 INFO:teuthology.orchestra.run.smithi060.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-24T21:09:44.391 INFO:teuthology.orchestra.run.smithi060.stdout: python3-webob-1.8.7-6.el9.noarch 2024-08-24T21:09:44.391 INFO:teuthology.orchestra.run.smithi060.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-24T21:09:44.391 INFO:teuthology.orchestra.run.smithi060.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-24T21:09:44.391 INFO:teuthology.orchestra.run.smithi060.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-24T21:09:44.391 INFO:teuthology.orchestra.run.smithi060.stdout: qatlib-24.02.0-1.el9.x86_64 2024-08-24T21:09:44.391 INFO:teuthology.orchestra.run.smithi060.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-08-24T21:09:44.391 INFO:teuthology.orchestra.run.smithi060.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-08-24T21:09:44.391 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-fuse-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:44.391 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-mirror-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:44.391 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-nbd-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:44.391 INFO:teuthology.orchestra.run.smithi060.stdout: re2-1:20211101-3.el9.x86_64 2024-08-24T21:09:44.391 INFO:teuthology.orchestra.run.smithi060.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-24T21:09:44.392 INFO:teuthology.orchestra.run.smithi060.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-24T21:09:44.392 INFO:teuthology.orchestra.run.smithi060.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-24T21:09:44.392 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-08-24T21:09:44.392 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-08-24T21:09:44.503 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 129/129 2024-08-24T21:09:44.503 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-24T21:09:44.503 INFO:teuthology.orchestra.run.smithi119.stdout:Upgraded: 2024-08-24T21:09:44.503 INFO:teuthology.orchestra.run.smithi119.stdout: librados2-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:44.503 INFO:teuthology.orchestra.run.smithi119.stdout: librbd1-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:44.503 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2024-08-24T21:09:44.503 INFO:teuthology.orchestra.run.smithi119.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-08-24T21:09:44.503 INFO:teuthology.orchestra.run.smithi119.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-08-24T21:09:44.504 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:44.504 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-base-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:44.504 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-common-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:44.504 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-fuse-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:44.504 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-grafana-dashboards-2:19.0.0-5842.g4887e20f.el9.noarch 2024-08-24T21:09:44.504 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-immutable-object-cache-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:44.504 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mds-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:44.504 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:44.504 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-cephadm-2:19.0.0-5842.g4887e20f.el9.noarch 2024-08-24T21:09:44.504 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-dashboard-2:19.0.0-5842.g4887e20f.el9.noarch 2024-08-24T21:09:44.504 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-diskprediction-local-2:19.0.0-5842.g4887e20f.el9.noarch 2024-08-24T21:09:44.504 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-modules-core-2:19.0.0-5842.g4887e20f.el9.noarch 2024-08-24T21:09:44.504 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-rook-2:19.0.0-5842.g4887e20f.el9.noarch 2024-08-24T21:09:44.505 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mon-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:44.505 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-osd-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:44.505 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-prometheus-alerts-2:19.0.0-5842.g4887e20f.el9.noarch 2024-08-24T21:09:44.505 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-radosgw-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:44.505 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-selinux-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:44.505 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-test-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:44.505 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-volume-2:19.0.0-5842.g4887e20f.el9.noarch 2024-08-24T21:09:44.505 INFO:teuthology.orchestra.run.smithi119.stdout: cephadm-2:19.0.0-5842.g4887e20f.el9.noarch 2024-08-24T21:09:44.505 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-24T21:09:44.505 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-24T21:09:44.505 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-24T21:09:44.506 INFO:teuthology.orchestra.run.smithi119.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-24T21:09:44.506 INFO:teuthology.orchestra.run.smithi119.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-24T21:09:44.506 INFO:teuthology.orchestra.run.smithi119.stdout: grpc-data-1.46.7-10.el9.noarch 2024-08-24T21:09:44.506 INFO:teuthology.orchestra.run.smithi119.stdout: libarrow-9.0.0-11.el9.x86_64 2024-08-24T21:09:44.506 INFO:teuthology.orchestra.run.smithi119.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-08-24T21:09:44.506 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs-devel-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:44.506 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs2-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:44.506 INFO:teuthology.orchestra.run.smithi119.stdout: libcephsqlite-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:44.506 INFO:teuthology.orchestra.run.smithi119.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-08-24T21:09:44.507 INFO:teuthology.orchestra.run.smithi119.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-24T21:09:44.507 INFO:teuthology.orchestra.run.smithi119.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-24T21:09:44.507 INFO:teuthology.orchestra.run.smithi119.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-08-24T21:09:44.507 INFO:teuthology.orchestra.run.smithi119.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-24T21:09:44.507 INFO:teuthology.orchestra.run.smithi119.stdout: librados-devel-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:44.507 INFO:teuthology.orchestra.run.smithi119.stdout: libradosstriper1-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:44.507 INFO:teuthology.orchestra.run.smithi119.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-24T21:09:44.507 INFO:teuthology.orchestra.run.smithi119.stdout: librgw2-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:44.507 INFO:teuthology.orchestra.run.smithi119.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-24T21:09:44.507 INFO:teuthology.orchestra.run.smithi119.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-24T21:09:44.507 INFO:teuthology.orchestra.run.smithi119.stdout: lua-5.4.4-4.el9.x86_64 2024-08-24T21:09:44.507 INFO:teuthology.orchestra.run.smithi119.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-08-24T21:09:44.507 INFO:teuthology.orchestra.run.smithi119.stdout: luarocks-3.9.2-5.el9.noarch 2024-08-24T21:09:44.508 INFO:teuthology.orchestra.run.smithi119.stdout: openblas-0.3.26-1.el9.x86_64 2024-08-24T21:09:44.508 INFO:teuthology.orchestra.run.smithi119.stdout: openblas-openmp-0.3.26-1.el9.x86_64 2024-08-24T21:09:44.508 INFO:teuthology.orchestra.run.smithi119.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-08-24T21:09:44.508 INFO:teuthology.orchestra.run.smithi119.stdout: protobuf-3.14.0-13.el9.x86_64 2024-08-24T21:09:44.508 INFO:teuthology.orchestra.run.smithi119.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-08-24T21:09:44.508 INFO:teuthology.orchestra.run.smithi119.stdout: pv-1.6.20-1.el9.x86_64 2024-08-24T21:09:44.508 INFO:teuthology.orchestra.run.smithi119.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-24T21:09:44.508 INFO:teuthology.orchestra.run.smithi119.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-24T21:09:44.508 INFO:teuthology.orchestra.run.smithi119.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-24T21:09:44.508 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-24T21:09:44.508 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-argparse-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:44.508 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-common-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:44.509 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cephfs-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:44.509 INFO:teuthology.orchestra.run.smithi119.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-24T21:09:44.509 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-24T21:09:44.509 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-24T21:09:44.509 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-24T21:09:44.509 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-24T21:09:44.509 INFO:teuthology.orchestra.run.smithi119.stdout: python3-devel-3.9.19-7.el9.x86_64 2024-08-24T21:09:44.509 INFO:teuthology.orchestra.run.smithi119.stdout: python3-google-auth-1:2.33.0-1.el9.noarch 2024-08-24T21:09:44.509 INFO:teuthology.orchestra.run.smithi119.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-08-24T21:09:44.509 INFO:teuthology.orchestra.run.smithi119.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-08-24T21:09:44.509 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-24T21:09:44.509 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-24T21:09:44.509 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-24T21:09:44.509 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-24T21:09:44.510 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-24T21:09:44.510 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-24T21:09:44.510 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-24T21:09:44.510 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-24T21:09:44.510 INFO:teuthology.orchestra.run.smithi119.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-24T21:09:44.510 INFO:teuthology.orchestra.run.smithi119.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-24T21:09:44.510 INFO:teuthology.orchestra.run.smithi119.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-24T21:09:44.510 INFO:teuthology.orchestra.run.smithi119.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-24T21:09:44.510 INFO:teuthology.orchestra.run.smithi119.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-24T21:09:44.510 INFO:teuthology.orchestra.run.smithi119.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-24T21:09:44.510 INFO:teuthology.orchestra.run.smithi119.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-24T21:09:44.510 INFO:teuthology.orchestra.run.smithi119.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-24T21:09:44.511 INFO:teuthology.orchestra.run.smithi119.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-24T21:09:44.511 INFO:teuthology.orchestra.run.smithi119.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-24T21:09:44.511 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-24T21:09:44.511 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ply-3.11-14.el9.noarch 2024-08-24T21:09:44.511 INFO:teuthology.orchestra.run.smithi119.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-24T21:09:44.511 INFO:teuthology.orchestra.run.smithi119.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-24T21:09:44.511 INFO:teuthology.orchestra.run.smithi119.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-08-24T21:09:44.511 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-24T21:09:44.511 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-24T21:09:44.511 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-24T21:09:44.511 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-24T21:09:44.511 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-24T21:09:44.511 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rados-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:44.511 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rbd-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:44.512 INFO:teuthology.orchestra.run.smithi119.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-24T21:09:44.512 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-24T21:09:44.512 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-24T21:09:44.512 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rgw-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:44.512 INFO:teuthology.orchestra.run.smithi119.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-24T21:09:44.512 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-24T21:09:44.512 INFO:teuthology.orchestra.run.smithi119.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-24T21:09:44.512 INFO:teuthology.orchestra.run.smithi119.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-24T21:09:44.512 INFO:teuthology.orchestra.run.smithi119.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-24T21:09:44.512 INFO:teuthology.orchestra.run.smithi119.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-24T21:09:44.512 INFO:teuthology.orchestra.run.smithi119.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-24T21:09:44.512 INFO:teuthology.orchestra.run.smithi119.stdout: python3-webob-1.8.7-6.el9.noarch 2024-08-24T21:09:44.512 INFO:teuthology.orchestra.run.smithi119.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-24T21:09:44.512 INFO:teuthology.orchestra.run.smithi119.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-24T21:09:44.513 INFO:teuthology.orchestra.run.smithi119.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-24T21:09:44.513 INFO:teuthology.orchestra.run.smithi119.stdout: qatlib-24.02.0-1.el9.x86_64 2024-08-24T21:09:44.513 INFO:teuthology.orchestra.run.smithi119.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-08-24T21:09:44.513 INFO:teuthology.orchestra.run.smithi119.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-08-24T21:09:44.513 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-fuse-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:44.513 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-mirror-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:44.513 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-nbd-2:19.0.0-5842.g4887e20f.el9.x86_64 2024-08-24T21:09:44.513 INFO:teuthology.orchestra.run.smithi119.stdout: re2-1:20211101-3.el9.x86_64 2024-08-24T21:09:44.513 INFO:teuthology.orchestra.run.smithi119.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-24T21:09:44.513 INFO:teuthology.orchestra.run.smithi119.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-24T21:09:44.513 INFO:teuthology.orchestra.run.smithi119.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-24T21:09:44.514 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-24T21:09:44.514 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-08-24T21:09:44.854 DEBUG:teuthology.parallel:result is None 2024-08-24T21:09:45.039 DEBUG:teuthology.parallel:result is None 2024-08-24T21:09:45.040 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=4887e20f48210b9f64d81c80656e954e16f399f3 2024-08-24T21:09:45.175 DEBUG:teuthology.orchestra.run.smithi060:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-24T21:09:45.220 INFO:teuthology.orchestra.run.smithi060.stdout:19.0.0-5842.g4887e20f.el9 2024-08-24T21:09:45.221 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-5842.g4887e20f.el9 2024-08-24T21:09:45.221 INFO:teuthology.task.install:The correct ceph version 19.0.0-5842.g4887e20f is installed. 2024-08-24T21:09:45.223 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=4887e20f48210b9f64d81c80656e954e16f399f3 2024-08-24T21:09:45.356 DEBUG:teuthology.orchestra.run.smithi119:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-24T21:09:45.401 INFO:teuthology.orchestra.run.smithi119.stdout:19.0.0-5842.g4887e20f.el9 2024-08-24T21:09:45.401 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-5842.g4887e20f.el9 2024-08-24T21:09:45.401 INFO:teuthology.task.install:The correct ceph version 19.0.0-5842.g4887e20f is installed. 2024-08-24T21:09:45.403 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=4887e20f48210b9f64d81c80656e954e16f399f3 2024-08-24T21:09:45.536 DEBUG:teuthology.orchestra.run.smithi179:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-24T21:09:45.585 INFO:teuthology.orchestra.run.smithi179.stdout:19.0.0-5842.g4887e20f.el9 2024-08-24T21:09:45.585 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-5842.g4887e20f.el9 2024-08-24T21:09:45.585 INFO:teuthology.task.install:The correct ceph version 19.0.0-5842.g4887e20f is installed. 2024-08-24T21:09:45.587 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-08-24T21:09:45.587 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-08-24T21:09:45.587 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-24T21:09:45.646 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-08-24T21:09:45.646 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-24T21:09:45.705 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-08-24T21:09:45.705 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-24T21:09:45.766 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-08-24T21:09:45.766 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-08-24T21:09:45.766 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/usr/bin/daemon-helper 2024-08-24T21:09:45.822 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-24T21:09:45.917 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-08-24T21:09:45.918 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/daemon-helper 2024-08-24T21:09:45.972 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-24T21:09:46.068 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-08-24T21:09:46.068 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/usr/bin/daemon-helper 2024-08-24T21:09:46.125 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-24T21:09:46.221 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-08-24T21:09:46.221 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-08-24T21:09:46.222 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-24T21:09:46.277 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-24T21:09:46.373 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-08-24T21:09:46.373 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-24T21:09:46.427 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-24T21:09:46.522 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-08-24T21:09:46.523 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-24T21:09:46.577 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-24T21:09:46.671 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-08-24T21:09:46.671 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-08-24T21:09:46.671 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/usr/bin/stdin-killer 2024-08-24T21:09:46.726 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-24T21:09:46.823 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-08-24T21:09:46.823 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/stdin-killer 2024-08-24T21:09:46.877 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-24T21:09:46.973 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-08-24T21:09:46.973 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/usr/bin/stdin-killer 2024-08-24T21:09:47.028 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-24T21:09:47.122 INFO:teuthology.run_tasks:Running task ceph... 2024-08-24T21:09:47.197 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-08-24T21:09:47.198 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 777 /var/log/ceph 2024-08-24T21:09:47.203 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 777 /var/log/ceph 2024-08-24T21:09:47.206 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 777 /var/log/ceph 2024-08-24T21:09:47.261 INFO:tasks.ceph:Disabling ceph logrotate... 2024-08-24T21:09:47.261 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -f -- /etc/logrotate.d/ceph 2024-08-24T21:09:47.265 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /etc/logrotate.d/ceph 2024-08-24T21:09:47.268 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f -- /etc/logrotate.d/ceph 2024-08-24T21:09:47.323 INFO:tasks.ceph:Creating extra log directories... 2024-08-24T21:09:47.323 DEBUG:teuthology.orchestra.run.smithi060:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-08-24T21:09:47.327 DEBUG:teuthology.orchestra.run.smithi119:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-08-24T21:09:47.331 DEBUG:teuthology.orchestra.run.smithi179:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-08-24T21:09:47.394 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-08-24T21:09:47.394 INFO:tasks.ceph:config {'conf': {'client': {'rbd default features': 37, 'rbd default map options': 'ms_mode=crc,rxbounce'}, 'global': {'mon warn on pool no app': False, 'ms die on skipped message': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MON_DOWN\\)', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-08-24T21:09:47.395 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-08-17_20:48:17-krbd-main-testing-default-smithi/7858438', 'branch': 'main', 'description': 'krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{crc-rxbounce} thrashers/mon-thrasher thrashosds-health workloads/krbd_diff_continuous}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7858438', 'kernel': {'flavor': 'default', 'kdb': 1, 'sha1': '7503b862ff5bc4e556b3daee1c7881aa3e90ed62'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-08-17_20:48:17-krbd-main-testing-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client': {'rbd default features': 37, 'rbd default map options': 'ms_mode=crc,rxbounce'}, 'global': {'mon warn on pool no app': False, 'ms die on skipped message': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MON_DOWN\\)', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': '4887e20f48210b9f64d81c80656e954e16f399f3'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '4887e20f48210b9f64d81c80656e954e16f399f3'}, 'extra_system_packages': ['pv']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': '797669399b32d2915e64eb6d4b1257ae3c50f80b'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 950, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.c', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['mon.b', 'mgr.y', 'osd.4', 'osd.5', 'osd.6', 'osd.7'], ['client.0']], 'seed': 623, 'sha1': '4887e20f48210b9f64d81c80656e954e16f399f3', 'sleep_before_teardown': 0, 'subset': '3/4', 'suite': 'krbd', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_797669399b32d2915e64eb6d4b1257ae3c50f80b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '797669399b32d2915e64eb6d4b1257ae3c50f80b', 'targets': {'smithi060.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPob2aapu0eI0yJWw5Us9xEdIDZr7ZIQNss1w9pTTZrIxos63aUodWq1JQDPWDdU7ScT8lEIqIs4M9olaGK6JtM=', 'smithi119.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAXzs+lI1f4H9frj7elmKQ7YHIUnp5B+Ut/e2AZnUuGNmpCe2+LQCMgqMjFRKO74nGr/UtaosQE0DKPyIvqnNU8=', 'smithi179.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMt35kufurQGUGaYOaFAVZsx0Pahs2/dKmDXBhGCmQGis4a8xthNk55ayTBSkn8JqT4XyWK0FdduhxOtB8tkxkI='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': 1, 'sha1': '7503b862ff5bc4e556b3daee1c7881aa3e90ed62'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'mon_thrash': {'revive_delay': 20, 'thrash_delay': 1}}, {'workunit': {'clients': {'all': ['rbd/diff_continuous.sh']}, 'env': {'RBD_DEVICE_TYPE': 'krbd'}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '67db276914d29505c9707d04f3a3b8fb9d8aee4b', 'timestamp': '2024-08-17_20:48:17', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-08-24T21:09:47.395 DEBUG:teuthology.orchestra.run.smithi060:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-08-24T21:09:47.399 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-08-24T21:09:47.403 DEBUG:teuthology.orchestra.run.smithi179:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-08-24T21:09:47.437 DEBUG:teuthology.orchestra.run.smithi060:> sudo install -d -m0777 -- /var/run/ceph 2024-08-24T21:09:47.474 DEBUG:teuthology.orchestra.run.smithi119:> sudo install -d -m0777 -- /var/run/ceph 2024-08-24T21:09:47.478 DEBUG:teuthology.orchestra.run.smithi179:> sudo install -d -m0777 -- /var/run/ceph 2024-08-24T21:09:47.533 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-08-24T21:09:47.533 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/scratch_devs of=/dev/stdout 2024-08-24T21:09:47.568 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-24T21:09:47.568 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_1 2024-08-24T21:09:47.643 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-24T21:09:47.644 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-24T21:09:47.644 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 6h/6d Inode: 633 Links: 1 2024-08-24T21:09:47.644 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-24T21:09:47.644 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2024-08-24T21:09:47.644 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2024-08-24 21:09:36.938999389 +0000 2024-08-24T21:09:47.644 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2024-08-24 21:07:23.856220949 +0000 2024-08-24T21:09:47.644 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2024-08-24 21:07:23.856220949 +0000 2024-08-24T21:09:47.644 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: 2024-08-24 21:07:23.856220949 +0000 2024-08-24T21:09:47.644 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-24T21:09:47.736 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2024-08-24T21:09:47.736 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2024-08-24T21:09:47.736 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.000180668 s, 2.8 MB/s 2024-08-24T21:09:47.739 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-24T21:09:47.775 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_2 2024-08-24T21:09:47.850 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-24T21:09:47.851 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-24T21:09:47.851 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 6h/6d Inode: 650 Links: 1 2024-08-24T21:09:47.851 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-24T21:09:47.851 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2024-08-24T21:09:47.851 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2024-08-24 21:09:36.939999380 +0000 2024-08-24T21:09:47.851 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2024-08-24 21:07:24.309216670 +0000 2024-08-24T21:09:47.851 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2024-08-24 21:07:24.309216670 +0000 2024-08-24T21:09:47.851 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: 2024-08-24 21:07:24.309216670 +0000 2024-08-24T21:09:47.851 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-24T21:09:47.943 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2024-08-24T21:09:47.943 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2024-08-24T21:09:47.943 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.000171075 s, 3.0 MB/s 2024-08-24T21:09:47.946 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-24T21:09:47.982 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_3 2024-08-24T21:09:48.059 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-24T21:09:48.059 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-24T21:09:48.059 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 6h/6d Inode: 671 Links: 1 2024-08-24T21:09:48.059 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-24T21:09:48.059 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2024-08-24T21:09:48.059 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2024-08-24 21:09:36.940999370 +0000 2024-08-24T21:09:48.059 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2024-08-24 21:07:24.735212646 +0000 2024-08-24T21:09:48.059 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2024-08-24 21:07:24.735212646 +0000 2024-08-24T21:09:48.059 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: 2024-08-24 21:07:24.735212646 +0000 2024-08-24T21:09:48.060 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-24T21:09:48.151 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2024-08-24T21:09:48.151 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2024-08-24T21:09:48.151 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.000173937 s, 2.9 MB/s 2024-08-24T21:09:48.154 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-24T21:09:48.190 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_4 2024-08-24T21:09:48.266 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-24T21:09:48.266 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-24T21:09:48.266 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 6h/6d Inode: 688 Links: 1 2024-08-24T21:09:48.266 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-24T21:09:48.266 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2024-08-24T21:09:48.266 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2024-08-24 21:09:36.940999370 +0000 2024-08-24T21:09:48.266 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2024-08-24 21:07:25.181208433 +0000 2024-08-24T21:09:48.266 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2024-08-24 21:07:25.181208433 +0000 2024-08-24T21:09:48.266 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: 2024-08-24 21:07:25.181208433 +0000 2024-08-24T21:09:48.267 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-24T21:09:48.358 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2024-08-24T21:09:48.359 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2024-08-24T21:09:48.359 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.00017124 s, 3.0 MB/s 2024-08-24T21:09:48.361 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-24T21:09:48.397 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-24T21:09:48.397 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-08-24T21:09:48.398 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/scratch_devs of=/dev/stdout 2024-08-24T21:09:48.433 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-24T21:09:48.433 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_1 2024-08-24T21:09:48.509 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-24T21:09:48.509 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-24T21:09:48.509 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 6h/6d Inode: 631 Links: 1 2024-08-24T21:09:48.509 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-24T21:09:48.510 INFO:teuthology.orchestra.run.smithi119.stdout:Context: system_u:object_r:device_t:s0 2024-08-24T21:09:48.510 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2024-08-24 21:09:36.636086312 +0000 2024-08-24T21:09:48.510 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2024-08-24 21:07:24.212136644 +0000 2024-08-24T21:09:48.510 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2024-08-24 21:07:24.212136644 +0000 2024-08-24T21:09:48.510 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: 2024-08-24 21:07:24.212136644 +0000 2024-08-24T21:09:48.510 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-24T21:09:48.604 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2024-08-24T21:09:48.605 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2024-08-24T21:09:48.605 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000341809 s, 1.5 MB/s 2024-08-24T21:09:48.607 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-24T21:09:48.647 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_2 2024-08-24T21:09:48.724 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-24T21:09:48.724 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-24T21:09:48.724 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 6h/6d Inode: 652 Links: 1 2024-08-24T21:09:48.724 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-24T21:09:48.724 INFO:teuthology.orchestra.run.smithi119.stdout:Context: system_u:object_r:device_t:s0 2024-08-24T21:09:48.724 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2024-08-24 21:09:36.636086312 +0000 2024-08-24T21:09:48.724 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2024-08-24 21:07:24.714124285 +0000 2024-08-24T21:09:48.725 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2024-08-24 21:07:24.714124285 +0000 2024-08-24T21:09:48.725 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: 2024-08-24 21:07:24.714124285 +0000 2024-08-24T21:09:48.725 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-24T21:09:48.818 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2024-08-24T21:09:48.818 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2024-08-24T21:09:48.818 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000305018 s, 1.7 MB/s 2024-08-24T21:09:48.820 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-24T21:09:48.857 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_3 2024-08-24T21:09:48.932 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-24T21:09:48.932 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-24T21:09:48.932 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 6h/6d Inode: 670 Links: 1 2024-08-24T21:09:48.932 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-24T21:09:48.932 INFO:teuthology.orchestra.run.smithi119.stdout:Context: system_u:object_r:device_t:s0 2024-08-24T21:09:48.932 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2024-08-24 21:09:36.637086287 +0000 2024-08-24T21:09:48.932 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2024-08-24 21:07:25.183112739 +0000 2024-08-24T21:09:48.932 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2024-08-24 21:07:25.183112739 +0000 2024-08-24T21:09:48.933 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: 2024-08-24 21:07:25.183112739 +0000 2024-08-24T21:09:48.933 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-24T21:09:49.025 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2024-08-24T21:09:49.026 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2024-08-24T21:09:49.026 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000253394 s, 2.0 MB/s 2024-08-24T21:09:49.029 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-24T21:09:49.065 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_4 2024-08-24T21:09:49.140 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-24T21:09:49.140 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-24T21:09:49.140 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 6h/6d Inode: 688 Links: 1 2024-08-24T21:09:49.140 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-24T21:09:49.140 INFO:teuthology.orchestra.run.smithi119.stdout:Context: system_u:object_r:device_t:s0 2024-08-24T21:09:49.140 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2024-08-24 21:09:36.638086263 +0000 2024-08-24T21:09:49.141 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2024-08-24 21:07:25.653101168 +0000 2024-08-24T21:09:49.141 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2024-08-24 21:07:25.653101168 +0000 2024-08-24T21:09:49.141 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: 2024-08-24 21:07:25.653101168 +0000 2024-08-24T21:09:49.141 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-24T21:09:49.232 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2024-08-24T21:09:49.232 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2024-08-24T21:09:49.233 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000256021 s, 2.0 MB/s 2024-08-24T21:09:49.235 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-24T21:09:49.271 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-24T21:09:49.271 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi060.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi119.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-08-24T21:09:49.272 INFO:tasks.ceph:Generating config... 2024-08-24T21:09:49.273 INFO:tasks.ceph:[client] rbd default features = 37 2024-08-24T21:09:49.273 INFO:tasks.ceph:[client] rbd default map options = ms_mode=crc,rxbounce 2024-08-24T21:09:49.273 INFO:tasks.ceph:[global] mon warn on pool no app = False 2024-08-24T21:09:49.273 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-08-24T21:09:49.273 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-08-24T21:09:49.273 INFO:tasks.ceph:[mgr] debug ms = 1 2024-08-24T21:09:49.273 INFO:tasks.ceph:[mon] debug mon = 20 2024-08-24T21:09:49.273 INFO:tasks.ceph:[mon] debug ms = 1 2024-08-24T21:09:49.273 INFO:tasks.ceph:[mon] debug paxos = 20 2024-08-24T21:09:49.273 INFO:tasks.ceph:[osd] bdev async discard = True 2024-08-24T21:09:49.274 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-08-24T21:09:49.274 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-08-24T21:09:49.274 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-08-24T21:09:49.274 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-08-24T21:09:49.274 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-08-24T21:09:49.274 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-08-24T21:09:49.274 INFO:tasks.ceph:[osd] debug ms = 1 2024-08-24T21:09:49.274 INFO:tasks.ceph:[osd] debug osd = 20 2024-08-24T21:09:49.274 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-08-24T21:09:49.274 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-08-24T21:09:49.274 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-08-24T21:09:49.274 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-08-24T21:09:49.274 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-08-24T21:09:49.275 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-08-24T21:09:49.275 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-08-24T21:09:49.275 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-08-24T21:09:49.275 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-08-24T21:09:49.275 INFO:tasks.ceph:Setting up mon.a... 2024-08-24T21:09:49.275 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-08-24T21:09:49.370 INFO:teuthology.orchestra.run.smithi060.stdout:creating /etc/ceph/ceph.keyring 2024-08-24T21:09:49.376 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-08-24T21:09:49.462 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-24T21:09:49.518 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.60'), ('mon.c', '[v2:172.21.15.60:3301,v1:172.21.15.60:6790]'), ('mon.b', '172.21.15.119')] 2024-08-24T21:09:49.518 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.60,[v2:172.21.15.60:3301,v1:172.21.15.60:6790],172.21.15.119', 'mon warn on pool no app': False, 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'rbd default features': 37, 'rbd default map options': 'ms_mode=crc,rxbounce'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-08-24T21:09:49.519 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-08-24T21:09:49.520 DEBUG:teuthology.orchestra.run.smithi060:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-08-24T21:09:49.554 DEBUG:teuthology.orchestra.run.smithi060:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.60 --addv c '[v2:172.21.15.60:3301,v1:172.21.15.60:6790]' --add b 172.21.15.119 --print /home/ubuntu/cephtest/ceph.monmap 2024-08-24T21:09:49.674 INFO:teuthology.orchestra.run.smithi060.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-08-24T21:09:49.675 INFO:teuthology.orchestra.run.smithi060.stdout:monmaptool: generated fsid 97068482-6757-4fb2-8da4-aa9f786bab40 2024-08-24T21:09:49.675 INFO:teuthology.orchestra.run.smithi060.stdout:setting min_mon_release = quincy 2024-08-24T21:09:49.675 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 0 2024-08-24T21:09:49.675 INFO:teuthology.orchestra.run.smithi060.stdout:fsid 97068482-6757-4fb2-8da4-aa9f786bab40 2024-08-24T21:09:49.675 INFO:teuthology.orchestra.run.smithi060.stdout:last_changed 2024-08-24T21:09:49.671468+0000 2024-08-24T21:09:49.675 INFO:teuthology.orchestra.run.smithi060.stdout:created 2024-08-24T21:09:49.671468+0000 2024-08-24T21:09:49.675 INFO:teuthology.orchestra.run.smithi060.stdout:min_mon_release 17 (quincy) 2024-08-24T21:09:49.675 INFO:teuthology.orchestra.run.smithi060.stdout:election_strategy: 1 2024-08-24T21:09:49.675 INFO:teuthology.orchestra.run.smithi060.stdout:0: [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] mon.a 2024-08-24T21:09:49.675 INFO:teuthology.orchestra.run.smithi060.stdout:1: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.b 2024-08-24T21:09:49.675 INFO:teuthology.orchestra.run.smithi060.stdout:2: [v2:172.21.15.60:3301/0,v1:172.21.15.60:6790/0] mon.c 2024-08-24T21:09:49.675 INFO:teuthology.orchestra.run.smithi060.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-08-24T21:09:49.676 DEBUG:teuthology.orchestra.run.smithi060:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-08-24T21:09:49.710 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 97068482-6757-4fb2-8da4-aa9f786bab40... 2024-08-24T21:09:49.711 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-24T21:09:49.754 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-24T21:09:49.758 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-24T21:09:49.848 INFO:teuthology.orchestra.run.smithi060.stdout:[global] 2024-08-24T21:09:49.848 INFO:teuthology.orchestra.run.smithi060.stdout: chdir = "" 2024-08-24T21:09:49.848 INFO:teuthology.orchestra.run.smithi060.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-24T21:09:49.848 INFO:teuthology.orchestra.run.smithi060.stdout: auth supported = cephx 2024-08-24T21:09:49.848 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-08-24T21:09:49.848 INFO:teuthology.orchestra.run.smithi060.stdout: filestore xattr use omap = true 2024-08-24T21:09:49.848 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-08-24T21:09:49.848 INFO:teuthology.orchestra.run.smithi060.stdout: mon clock drift allowed = 1.000 2024-08-24T21:09:49.848 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-08-24T21:09:49.848 INFO:teuthology.orchestra.run.smithi060.stdout: osd crush chooseleaf type = 0 2024-08-24T21:09:49.848 INFO:teuthology.orchestra.run.smithi060.stdout: auth debug = true 2024-08-24T21:09:49.848 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-08-24T21:09:49.849 INFO:teuthology.orchestra.run.smithi060.stdout: ms die on old message = true 2024-08-24T21:09:49.849 INFO:teuthology.orchestra.run.smithi060.stdout: ms die on bug = true 2024-08-24T21:09:49.849 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-08-24T21:09:49.849 INFO:teuthology.orchestra.run.smithi060.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-24T21:09:49.849 INFO:teuthology.orchestra.run.smithi060.stdout: mon pg warn max object skew = 0 2024-08-24T21:09:49.849 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-08-24T21:09:49.849 INFO:teuthology.orchestra.run.smithi060.stdout: # disable pg_autoscaler by default for new pools 2024-08-24T21:09:49.849 INFO:teuthology.orchestra.run.smithi060.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-24T21:09:49.849 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-08-24T21:09:49.849 INFO:teuthology.orchestra.run.smithi060.stdout: osd pool default size = 2 2024-08-24T21:09:49.849 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-08-24T21:09:49.849 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd allow primary affinity = true 2024-08-24T21:09:49.849 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd allow pg remap = true 2024-08-24T21:09:49.849 INFO:teuthology.orchestra.run.smithi060.stdout: mon warn on legacy crush tunables = false 2024-08-24T21:09:49.850 INFO:teuthology.orchestra.run.smithi060.stdout: mon warn on crush straw calc version zero = false 2024-08-24T21:09:49.850 INFO:teuthology.orchestra.run.smithi060.stdout: mon warn on no sortbitwise = false 2024-08-24T21:09:49.850 INFO:teuthology.orchestra.run.smithi060.stdout: mon warn on osd down out interval zero = false 2024-08-24T21:09:49.850 INFO:teuthology.orchestra.run.smithi060.stdout: mon warn on too few osds = false 2024-08-24T21:09:49.850 INFO:teuthology.orchestra.run.smithi060.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-24T21:09:49.850 INFO:teuthology.orchestra.run.smithi060.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-24T21:09:49.850 INFO:teuthology.orchestra.run.smithi060.stdout: mon_allow_pool_size_one = true 2024-08-24T21:09:49.850 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-08-24T21:09:49.850 INFO:teuthology.orchestra.run.smithi060.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-24T21:09:49.850 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-08-24T21:09:49.850 INFO:teuthology.orchestra.run.smithi060.stdout: osd default data pool replay window = 5 2024-08-24T21:09:49.850 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-08-24T21:09:49.850 INFO:teuthology.orchestra.run.smithi060.stdout: mon allow pool delete = true 2024-08-24T21:09:49.851 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-08-24T21:09:49.851 INFO:teuthology.orchestra.run.smithi060.stdout: mon cluster log file level = debug 2024-08-24T21:09:49.851 INFO:teuthology.orchestra.run.smithi060.stdout: debug asserts on shutdown = true 2024-08-24T21:09:49.851 INFO:teuthology.orchestra.run.smithi060.stdout: mon health detail to clog = false 2024-08-24T21:09:49.851 INFO:teuthology.orchestra.run.smithi060.stdout: mon host = "172.21.15.60,[v2:172.21.15.60:3301,v1:172.21.15.60:6790],172.21.15.119" 2024-08-24T21:09:49.851 INFO:teuthology.orchestra.run.smithi060.stdout: mon warn on pool no app = False 2024-08-24T21:09:49.851 INFO:teuthology.orchestra.run.smithi060.stdout: ms die on skipped message = False 2024-08-24T21:09:49.851 INFO:teuthology.orchestra.run.smithi060.stdout: fsid = 97068482-6757-4fb2-8da4-aa9f786bab40 2024-08-24T21:09:49.851 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-08-24T21:09:49.851 INFO:teuthology.orchestra.run.smithi060.stdout:[osd] 2024-08-24T21:09:49.851 INFO:teuthology.orchestra.run.smithi060.stdout: osd journal size = 100 2024-08-24T21:09:49.851 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-08-24T21:09:49.852 INFO:teuthology.orchestra.run.smithi060.stdout: osd scrub load threshold = 5.0 2024-08-24T21:09:49.852 INFO:teuthology.orchestra.run.smithi060.stdout: osd scrub max interval = 600 2024-08-24T21:09:49.852 INFO:teuthology.orchestra.run.smithi060.stdout: osd mclock profile = high_recovery_ops 2024-08-24T21:09:49.852 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-08-24T21:09:49.852 INFO:teuthology.orchestra.run.smithi060.stdout: osd recover clone overlap = true 2024-08-24T21:09:49.852 INFO:teuthology.orchestra.run.smithi060.stdout: osd recovery max chunk = 1048576 2024-08-24T21:09:49.852 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-08-24T21:09:49.852 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug shutdown = true 2024-08-24T21:09:49.852 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug op order = true 2024-08-24T21:09:49.852 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug verify stray on activate = true 2024-08-24T21:09:49.852 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug trim objects = true 2024-08-24T21:09:49.852 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-08-24T21:09:49.852 INFO:teuthology.orchestra.run.smithi060.stdout: osd open classes on start = true 2024-08-24T21:09:49.853 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug pg log writeout = true 2024-08-24T21:09:49.853 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-08-24T21:09:49.853 INFO:teuthology.orchestra.run.smithi060.stdout: osd deep scrub update digest min age = 30 2024-08-24T21:09:49.853 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-08-24T21:09:49.853 INFO:teuthology.orchestra.run.smithi060.stdout: osd map max advance = 10 2024-08-24T21:09:49.853 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-08-24T21:09:49.853 INFO:teuthology.orchestra.run.smithi060.stdout: journal zero on create = true 2024-08-24T21:09:49.853 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-08-24T21:09:49.853 INFO:teuthology.orchestra.run.smithi060.stdout: filestore ondisk finisher threads = 3 2024-08-24T21:09:49.853 INFO:teuthology.orchestra.run.smithi060.stdout: filestore apply finisher threads = 3 2024-08-24T21:09:49.853 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-08-24T21:09:49.853 INFO:teuthology.orchestra.run.smithi060.stdout: bdev debug aio = true 2024-08-24T21:09:49.853 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug misdirected ops = true 2024-08-24T21:09:49.853 INFO:teuthology.orchestra.run.smithi060.stdout: bdev async discard = True 2024-08-24T21:09:49.854 INFO:teuthology.orchestra.run.smithi060.stdout: bdev enable discard = True 2024-08-24T21:09:49.854 INFO:teuthology.orchestra.run.smithi060.stdout: bluestore allocator = bitmap 2024-08-24T21:09:49.854 INFO:teuthology.orchestra.run.smithi060.stdout: bluestore block size = 96636764160 2024-08-24T21:09:49.854 INFO:teuthology.orchestra.run.smithi060.stdout: bluestore fsck on mount = True 2024-08-24T21:09:49.854 INFO:teuthology.orchestra.run.smithi060.stdout: debug bluefs = 1/20 2024-08-24T21:09:49.854 INFO:teuthology.orchestra.run.smithi060.stdout: debug bluestore = 1/20 2024-08-24T21:09:49.854 INFO:teuthology.orchestra.run.smithi060.stdout: debug ms = 1 2024-08-24T21:09:49.854 INFO:teuthology.orchestra.run.smithi060.stdout: debug osd = 20 2024-08-24T21:09:49.854 INFO:teuthology.orchestra.run.smithi060.stdout: debug rocksdb = 4/10 2024-08-24T21:09:49.854 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd backfillfull_ratio = 0.85 2024-08-24T21:09:49.854 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd full ratio = 0.9 2024-08-24T21:09:49.854 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd nearfull ratio = 0.8 2024-08-24T21:09:49.854 INFO:teuthology.orchestra.run.smithi060.stdout: osd blocked scrub grace period = 3600 2024-08-24T21:09:49.855 INFO:teuthology.orchestra.run.smithi060.stdout: osd failsafe full ratio = 0.95 2024-08-24T21:09:49.855 INFO:teuthology.orchestra.run.smithi060.stdout: osd max markdown count = 1000 2024-08-24T21:09:49.855 INFO:teuthology.orchestra.run.smithi060.stdout: osd objectstore = bluestore 2024-08-24T21:09:49.855 INFO:teuthology.orchestra.run.smithi060.stdout: osd shutdown pgref assert = True 2024-08-24T21:09:49.855 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-08-24T21:09:49.855 INFO:teuthology.orchestra.run.smithi060.stdout:[mgr] 2024-08-24T21:09:49.855 INFO:teuthology.orchestra.run.smithi060.stdout: debug ms = 1 2024-08-24T21:09:49.855 INFO:teuthology.orchestra.run.smithi060.stdout: debug mgr = 20 2024-08-24T21:09:49.855 INFO:teuthology.orchestra.run.smithi060.stdout: debug mon = 20 2024-08-24T21:09:49.855 INFO:teuthology.orchestra.run.smithi060.stdout: debug auth = 20 2024-08-24T21:09:49.855 INFO:teuthology.orchestra.run.smithi060.stdout: mon reweight min pgs per osd = 4 2024-08-24T21:09:49.855 INFO:teuthology.orchestra.run.smithi060.stdout: mon reweight min bytes per osd = 10 2024-08-24T21:09:49.856 INFO:teuthology.orchestra.run.smithi060.stdout: mgr/telemetry/nag = false 2024-08-24T21:09:49.856 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-08-24T21:09:49.856 INFO:teuthology.orchestra.run.smithi060.stdout:[mon] 2024-08-24T21:09:49.856 INFO:teuthology.orchestra.run.smithi060.stdout: debug ms = 1 2024-08-24T21:09:49.856 INFO:teuthology.orchestra.run.smithi060.stdout: debug mon = 20 2024-08-24T21:09:49.856 INFO:teuthology.orchestra.run.smithi060.stdout: debug paxos = 20 2024-08-24T21:09:49.856 INFO:teuthology.orchestra.run.smithi060.stdout: debug auth = 20 2024-08-24T21:09:49.856 INFO:teuthology.orchestra.run.smithi060.stdout: mon data avail warn = 5 2024-08-24T21:09:49.856 INFO:teuthology.orchestra.run.smithi060.stdout: mon mgr mkfs grace = 240 2024-08-24T21:09:49.856 INFO:teuthology.orchestra.run.smithi060.stdout: mon reweight min pgs per osd = 4 2024-08-24T21:09:49.856 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd reporter subtree level = osd 2024-08-24T21:09:49.856 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd prime pg temp = true 2024-08-24T21:09:49.856 INFO:teuthology.orchestra.run.smithi060.stdout: mon reweight min bytes per osd = 10 2024-08-24T21:09:49.857 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-08-24T21:09:49.857 INFO:teuthology.orchestra.run.smithi060.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-24T21:09:49.857 INFO:teuthology.orchestra.run.smithi060.stdout: auth mon ticket ttl = 660 # 11m 2024-08-24T21:09:49.857 INFO:teuthology.orchestra.run.smithi060.stdout: auth service ticket ttl = 240 # 4m 2024-08-24T21:09:49.857 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-08-24T21:09:49.857 INFO:teuthology.orchestra.run.smithi060.stdout: # don't complain about insecure global_id in the test suite 2024-08-24T21:09:49.857 INFO:teuthology.orchestra.run.smithi060.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-24T21:09:49.857 INFO:teuthology.orchestra.run.smithi060.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-24T21:09:49.857 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-08-24T21:09:49.857 INFO:teuthology.orchestra.run.smithi060.stdout: # 1m isn't quite enough 2024-08-24T21:09:49.857 INFO:teuthology.orchestra.run.smithi060.stdout: mon_down_mkfs_grace = 2m 2024-08-24T21:09:49.857 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-08-24T21:09:49.857 INFO:teuthology.orchestra.run.smithi060.stdout: mon_warn_on_filestore_osds = false 2024-08-24T21:09:49.858 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-08-24T21:09:49.858 INFO:teuthology.orchestra.run.smithi060.stdout:[client] 2024-08-24T21:09:49.858 INFO:teuthology.orchestra.run.smithi060.stdout: rgw cache enabled = true 2024-08-24T21:09:49.858 INFO:teuthology.orchestra.run.smithi060.stdout: rgw enable ops log = true 2024-08-24T21:09:49.858 INFO:teuthology.orchestra.run.smithi060.stdout: rgw enable usage log = true 2024-08-24T21:09:49.858 INFO:teuthology.orchestra.run.smithi060.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-24T21:09:49.858 INFO:teuthology.orchestra.run.smithi060.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-24T21:09:49.858 INFO:teuthology.orchestra.run.smithi060.stdout: rbd default features = 37 2024-08-24T21:09:49.858 INFO:teuthology.orchestra.run.smithi060.stdout: rbd default map options = "ms_mode=crc,rxbounce" 2024-08-24T21:09:49.858 INFO:teuthology.orchestra.run.smithi060.stdout:[mon.a] 2024-08-24T21:09:49.858 INFO:teuthology.orchestra.run.smithi060.stdout:[mon.c] 2024-08-24T21:09:49.858 INFO:teuthology.orchestra.run.smithi060.stdout:[mon.b] 2024-08-24T21:09:49.859 INFO:teuthology.orchestra.run.smithi119.stdout:[global] 2024-08-24T21:09:49.859 INFO:teuthology.orchestra.run.smithi119.stdout: chdir = "" 2024-08-24T21:09:49.859 INFO:teuthology.orchestra.run.smithi119.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-24T21:09:49.859 INFO:teuthology.orchestra.run.smithi119.stdout: auth supported = cephx 2024-08-24T21:09:49.859 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-24T21:09:49.859 INFO:teuthology.orchestra.run.smithi119.stdout: filestore xattr use omap = true 2024-08-24T21:09:49.859 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-24T21:09:49.859 INFO:teuthology.orchestra.run.smithi119.stdout: mon clock drift allowed = 1.000 2024-08-24T21:09:49.859 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-24T21:09:49.860 INFO:teuthology.orchestra.run.smithi119.stdout: osd crush chooseleaf type = 0 2024-08-24T21:09:49.860 INFO:teuthology.orchestra.run.smithi119.stdout: auth debug = true 2024-08-24T21:09:49.860 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-24T21:09:49.860 INFO:teuthology.orchestra.run.smithi119.stdout: ms die on old message = true 2024-08-24T21:09:49.860 INFO:teuthology.orchestra.run.smithi119.stdout: ms die on bug = true 2024-08-24T21:09:49.860 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-24T21:09:49.860 INFO:teuthology.orchestra.run.smithi119.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-24T21:09:49.860 INFO:teuthology.orchestra.run.smithi119.stdout: mon pg warn max object skew = 0 2024-08-24T21:09:49.860 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-24T21:09:49.860 INFO:teuthology.orchestra.run.smithi119.stdout: # disable pg_autoscaler by default for new pools 2024-08-24T21:09:49.860 INFO:teuthology.orchestra.run.smithi119.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-24T21:09:49.860 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-24T21:09:49.860 INFO:teuthology.orchestra.run.smithi119.stdout: osd pool default size = 2 2024-08-24T21:09:49.860 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-24T21:09:49.861 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd allow primary affinity = true 2024-08-24T21:09:49.861 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd allow pg remap = true 2024-08-24T21:09:49.861 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on legacy crush tunables = false 2024-08-24T21:09:49.861 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on crush straw calc version zero = false 2024-08-24T21:09:49.861 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on no sortbitwise = false 2024-08-24T21:09:49.861 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on osd down out interval zero = false 2024-08-24T21:09:49.861 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on too few osds = false 2024-08-24T21:09:49.861 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-24T21:09:49.861 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-24T21:09:49.861 INFO:teuthology.orchestra.run.smithi119.stdout: mon_allow_pool_size_one = true 2024-08-24T21:09:49.861 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-24T21:09:49.861 INFO:teuthology.orchestra.run.smithi119.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-24T21:09:49.861 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-24T21:09:49.861 INFO:teuthology.orchestra.run.smithi119.stdout: osd default data pool replay window = 5 2024-08-24T21:09:49.862 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-24T21:09:49.862 INFO:teuthology.orchestra.run.smithi119.stdout: mon allow pool delete = true 2024-08-24T21:09:49.862 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-24T21:09:49.862 INFO:teuthology.orchestra.run.smithi119.stdout: mon cluster log file level = debug 2024-08-24T21:09:49.862 INFO:teuthology.orchestra.run.smithi119.stdout: debug asserts on shutdown = true 2024-08-24T21:09:49.862 INFO:teuthology.orchestra.run.smithi119.stdout: mon health detail to clog = false 2024-08-24T21:09:49.862 INFO:teuthology.orchestra.run.smithi119.stdout: mon host = "172.21.15.60,[v2:172.21.15.60:3301,v1:172.21.15.60:6790],172.21.15.119" 2024-08-24T21:09:49.862 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on pool no app = False 2024-08-24T21:09:49.862 INFO:teuthology.orchestra.run.smithi119.stdout: ms die on skipped message = False 2024-08-24T21:09:49.862 INFO:teuthology.orchestra.run.smithi119.stdout: fsid = 97068482-6757-4fb2-8da4-aa9f786bab40 2024-08-24T21:09:49.862 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-24T21:09:49.862 INFO:teuthology.orchestra.run.smithi119.stdout:[osd] 2024-08-24T21:09:49.862 INFO:teuthology.orchestra.run.smithi119.stdout: osd journal size = 100 2024-08-24T21:09:49.863 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-24T21:09:49.863 INFO:teuthology.orchestra.run.smithi119.stdout: osd scrub load threshold = 5.0 2024-08-24T21:09:49.863 INFO:teuthology.orchestra.run.smithi119.stdout: osd scrub max interval = 600 2024-08-24T21:09:49.863 INFO:teuthology.orchestra.run.smithi119.stdout: osd mclock profile = high_recovery_ops 2024-08-24T21:09:49.863 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-24T21:09:49.863 INFO:teuthology.orchestra.run.smithi119.stdout: osd recover clone overlap = true 2024-08-24T21:09:49.863 INFO:teuthology.orchestra.run.smithi119.stdout: osd recovery max chunk = 1048576 2024-08-24T21:09:49.863 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-24T21:09:49.863 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug shutdown = true 2024-08-24T21:09:49.863 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug op order = true 2024-08-24T21:09:49.863 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug verify stray on activate = true 2024-08-24T21:09:49.863 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug trim objects = true 2024-08-24T21:09:49.863 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-24T21:09:49.864 INFO:teuthology.orchestra.run.smithi119.stdout: osd open classes on start = true 2024-08-24T21:09:49.864 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug pg log writeout = true 2024-08-24T21:09:49.864 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-24T21:09:49.864 INFO:teuthology.orchestra.run.smithi119.stdout: osd deep scrub update digest min age = 30 2024-08-24T21:09:49.864 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-24T21:09:49.864 INFO:teuthology.orchestra.run.smithi119.stdout: osd map max advance = 10 2024-08-24T21:09:49.864 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-24T21:09:49.864 INFO:teuthology.orchestra.run.smithi119.stdout: journal zero on create = true 2024-08-24T21:09:49.864 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-24T21:09:49.864 INFO:teuthology.orchestra.run.smithi119.stdout: filestore ondisk finisher threads = 3 2024-08-24T21:09:49.864 INFO:teuthology.orchestra.run.smithi119.stdout: filestore apply finisher threads = 3 2024-08-24T21:09:49.864 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-24T21:09:49.864 INFO:teuthology.orchestra.run.smithi119.stdout: bdev debug aio = true 2024-08-24T21:09:49.864 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug misdirected ops = true 2024-08-24T21:09:49.865 INFO:teuthology.orchestra.run.smithi119.stdout: bdev async discard = True 2024-08-24T21:09:49.865 INFO:teuthology.orchestra.run.smithi119.stdout: bdev enable discard = True 2024-08-24T21:09:49.865 INFO:teuthology.orchestra.run.smithi119.stdout: bluestore allocator = bitmap 2024-08-24T21:09:49.865 INFO:teuthology.orchestra.run.smithi119.stdout: bluestore block size = 96636764160 2024-08-24T21:09:49.865 INFO:teuthology.orchestra.run.smithi119.stdout: bluestore fsck on mount = True 2024-08-24T21:09:49.865 INFO:teuthology.orchestra.run.smithi119.stdout: debug bluefs = 1/20 2024-08-24T21:09:49.865 INFO:teuthology.orchestra.run.smithi119.stdout: debug bluestore = 1/20 2024-08-24T21:09:49.865 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2024-08-24T21:09:49.865 INFO:teuthology.orchestra.run.smithi119.stdout: debug osd = 20 2024-08-24T21:09:49.865 INFO:teuthology.orchestra.run.smithi119.stdout: debug rocksdb = 4/10 2024-08-24T21:09:49.865 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd backfillfull_ratio = 0.85 2024-08-24T21:09:49.865 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd full ratio = 0.9 2024-08-24T21:09:49.865 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd nearfull ratio = 0.8 2024-08-24T21:09:49.866 INFO:teuthology.orchestra.run.smithi119.stdout: osd blocked scrub grace period = 3600 2024-08-24T21:09:49.866 INFO:teuthology.orchestra.run.smithi119.stdout: osd failsafe full ratio = 0.95 2024-08-24T21:09:49.866 INFO:teuthology.orchestra.run.smithi119.stdout: osd max markdown count = 1000 2024-08-24T21:09:49.866 INFO:teuthology.orchestra.run.smithi119.stdout: osd objectstore = bluestore 2024-08-24T21:09:49.866 INFO:teuthology.orchestra.run.smithi119.stdout: osd shutdown pgref assert = True 2024-08-24T21:09:49.866 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-24T21:09:49.866 INFO:teuthology.orchestra.run.smithi119.stdout:[mgr] 2024-08-24T21:09:49.866 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2024-08-24T21:09:49.866 INFO:teuthology.orchestra.run.smithi119.stdout: debug mgr = 20 2024-08-24T21:09:49.866 INFO:teuthology.orchestra.run.smithi119.stdout: debug mon = 20 2024-08-24T21:09:49.866 INFO:teuthology.orchestra.run.smithi119.stdout: debug auth = 20 2024-08-24T21:09:49.866 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min pgs per osd = 4 2024-08-24T21:09:49.867 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min bytes per osd = 10 2024-08-24T21:09:49.867 INFO:teuthology.orchestra.run.smithi119.stdout: mgr/telemetry/nag = false 2024-08-24T21:09:49.867 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-24T21:09:49.867 INFO:teuthology.orchestra.run.smithi119.stdout:[mon] 2024-08-24T21:09:49.867 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2024-08-24T21:09:49.867 INFO:teuthology.orchestra.run.smithi119.stdout: debug mon = 20 2024-08-24T21:09:49.867 INFO:teuthology.orchestra.run.smithi119.stdout: debug paxos = 20 2024-08-24T21:09:49.867 INFO:teuthology.orchestra.run.smithi119.stdout: debug auth = 20 2024-08-24T21:09:49.867 INFO:teuthology.orchestra.run.smithi119.stdout: mon data avail warn = 5 2024-08-24T21:09:49.867 INFO:teuthology.orchestra.run.smithi119.stdout: mon mgr mkfs grace = 240 2024-08-24T21:09:49.867 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min pgs per osd = 4 2024-08-24T21:09:49.867 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd reporter subtree level = osd 2024-08-24T21:09:49.867 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd prime pg temp = true 2024-08-24T21:09:49.867 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min bytes per osd = 10 2024-08-24T21:09:49.868 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-24T21:09:49.868 INFO:teuthology.orchestra.run.smithi119.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-24T21:09:49.868 INFO:teuthology.orchestra.run.smithi119.stdout: auth mon ticket ttl = 660 # 11m 2024-08-24T21:09:49.868 INFO:teuthology.orchestra.run.smithi119.stdout: auth service ticket ttl = 240 # 4m 2024-08-24T21:09:49.868 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-24T21:09:49.868 INFO:teuthology.orchestra.run.smithi119.stdout: # don't complain about insecure global_id in the test suite 2024-08-24T21:09:49.868 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-24T21:09:49.868 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-24T21:09:49.868 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-24T21:09:49.868 INFO:teuthology.orchestra.run.smithi119.stdout: # 1m isn't quite enough 2024-08-24T21:09:49.868 INFO:teuthology.orchestra.run.smithi119.stdout: mon_down_mkfs_grace = 2m 2024-08-24T21:09:49.868 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-24T21:09:49.868 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_filestore_osds = false 2024-08-24T21:09:49.868 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-24T21:09:49.869 INFO:teuthology.orchestra.run.smithi119.stdout:[client] 2024-08-24T21:09:49.869 INFO:teuthology.orchestra.run.smithi119.stdout: rgw cache enabled = true 2024-08-24T21:09:49.869 INFO:teuthology.orchestra.run.smithi119.stdout: rgw enable ops log = true 2024-08-24T21:09:49.869 INFO:teuthology.orchestra.run.smithi119.stdout: rgw enable usage log = true 2024-08-24T21:09:49.869 INFO:teuthology.orchestra.run.smithi119.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-24T21:09:49.869 INFO:teuthology.orchestra.run.smithi119.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-24T21:09:49.869 INFO:teuthology.orchestra.run.smithi119.stdout: rbd default features = 37 2024-08-24T21:09:49.869 INFO:teuthology.orchestra.run.smithi119.stdout: rbd default map options = "ms_mode=crc,rxbounce" 2024-08-24T21:09:49.869 INFO:teuthology.orchestra.run.smithi119.stdout:[mon.a] 2024-08-24T21:09:49.869 INFO:teuthology.orchestra.run.smithi119.stdout:[mon.c] 2024-08-24T21:09:49.869 INFO:teuthology.orchestra.run.smithi119.stdout:[mon.b] 2024-08-24T21:09:49.870 INFO:teuthology.orchestra.run.smithi179.stdout:[global] 2024-08-24T21:09:49.870 INFO:teuthology.orchestra.run.smithi179.stdout: chdir = "" 2024-08-24T21:09:49.870 INFO:teuthology.orchestra.run.smithi179.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-24T21:09:49.870 INFO:teuthology.orchestra.run.smithi179.stdout: auth supported = cephx 2024-08-24T21:09:49.870 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-08-24T21:09:49.870 INFO:teuthology.orchestra.run.smithi179.stdout: filestore xattr use omap = true 2024-08-24T21:09:49.870 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-08-24T21:09:49.870 INFO:teuthology.orchestra.run.smithi179.stdout: mon clock drift allowed = 1.000 2024-08-24T21:09:49.870 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-08-24T21:09:49.870 INFO:teuthology.orchestra.run.smithi179.stdout: osd crush chooseleaf type = 0 2024-08-24T21:09:49.871 INFO:teuthology.orchestra.run.smithi179.stdout: auth debug = true 2024-08-24T21:09:49.871 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-08-24T21:09:49.871 INFO:teuthology.orchestra.run.smithi179.stdout: ms die on old message = true 2024-08-24T21:09:49.871 INFO:teuthology.orchestra.run.smithi179.stdout: ms die on bug = true 2024-08-24T21:09:49.871 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-08-24T21:09:49.871 INFO:teuthology.orchestra.run.smithi179.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-24T21:09:49.871 INFO:teuthology.orchestra.run.smithi179.stdout: mon pg warn max object skew = 0 2024-08-24T21:09:49.871 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-08-24T21:09:49.871 INFO:teuthology.orchestra.run.smithi179.stdout: # disable pg_autoscaler by default for new pools 2024-08-24T21:09:49.871 INFO:teuthology.orchestra.run.smithi179.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-24T21:09:49.871 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-08-24T21:09:49.871 INFO:teuthology.orchestra.run.smithi179.stdout: osd pool default size = 2 2024-08-24T21:09:49.872 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-08-24T21:09:49.872 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd allow primary affinity = true 2024-08-24T21:09:49.872 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd allow pg remap = true 2024-08-24T21:09:49.872 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on legacy crush tunables = false 2024-08-24T21:09:49.872 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on crush straw calc version zero = false 2024-08-24T21:09:49.872 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on no sortbitwise = false 2024-08-24T21:09:49.872 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on osd down out interval zero = false 2024-08-24T21:09:49.872 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on too few osds = false 2024-08-24T21:09:49.872 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-24T21:09:49.872 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-24T21:09:49.872 INFO:teuthology.orchestra.run.smithi179.stdout: mon_allow_pool_size_one = true 2024-08-24T21:09:49.872 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-08-24T21:09:49.872 INFO:teuthology.orchestra.run.smithi179.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-24T21:09:49.873 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-08-24T21:09:49.873 INFO:teuthology.orchestra.run.smithi179.stdout: osd default data pool replay window = 5 2024-08-24T21:09:49.873 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-08-24T21:09:49.873 INFO:teuthology.orchestra.run.smithi179.stdout: mon allow pool delete = true 2024-08-24T21:09:49.873 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-08-24T21:09:49.873 INFO:teuthology.orchestra.run.smithi179.stdout: mon cluster log file level = debug 2024-08-24T21:09:49.873 INFO:teuthology.orchestra.run.smithi179.stdout: debug asserts on shutdown = true 2024-08-24T21:09:49.873 INFO:teuthology.orchestra.run.smithi179.stdout: mon health detail to clog = false 2024-08-24T21:09:49.873 INFO:teuthology.orchestra.run.smithi179.stdout: mon host = "172.21.15.60,[v2:172.21.15.60:3301,v1:172.21.15.60:6790],172.21.15.119" 2024-08-24T21:09:49.873 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on pool no app = False 2024-08-24T21:09:49.873 INFO:teuthology.orchestra.run.smithi179.stdout: ms die on skipped message = False 2024-08-24T21:09:49.873 INFO:teuthology.orchestra.run.smithi179.stdout: fsid = 97068482-6757-4fb2-8da4-aa9f786bab40 2024-08-24T21:09:49.873 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-08-24T21:09:49.874 INFO:teuthology.orchestra.run.smithi179.stdout:[osd] 2024-08-24T21:09:49.874 INFO:teuthology.orchestra.run.smithi179.stdout: osd journal size = 100 2024-08-24T21:09:49.874 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-08-24T21:09:49.874 INFO:teuthology.orchestra.run.smithi179.stdout: osd scrub load threshold = 5.0 2024-08-24T21:09:49.874 INFO:teuthology.orchestra.run.smithi179.stdout: osd scrub max interval = 600 2024-08-24T21:09:49.874 INFO:teuthology.orchestra.run.smithi179.stdout: osd mclock profile = high_recovery_ops 2024-08-24T21:09:49.874 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-08-24T21:09:49.874 INFO:teuthology.orchestra.run.smithi179.stdout: osd recover clone overlap = true 2024-08-24T21:09:49.874 INFO:teuthology.orchestra.run.smithi179.stdout: osd recovery max chunk = 1048576 2024-08-24T21:09:49.874 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-08-24T21:09:49.874 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug shutdown = true 2024-08-24T21:09:49.874 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug op order = true 2024-08-24T21:09:49.874 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug verify stray on activate = true 2024-08-24T21:09:49.875 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug trim objects = true 2024-08-24T21:09:49.875 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-08-24T21:09:49.875 INFO:teuthology.orchestra.run.smithi179.stdout: osd open classes on start = true 2024-08-24T21:09:49.875 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug pg log writeout = true 2024-08-24T21:09:49.875 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-08-24T21:09:49.875 INFO:teuthology.orchestra.run.smithi179.stdout: osd deep scrub update digest min age = 30 2024-08-24T21:09:49.875 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-08-24T21:09:49.875 INFO:teuthology.orchestra.run.smithi179.stdout: osd map max advance = 10 2024-08-24T21:09:49.875 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-08-24T21:09:49.875 INFO:teuthology.orchestra.run.smithi179.stdout: journal zero on create = true 2024-08-24T21:09:49.875 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-08-24T21:09:49.875 INFO:teuthology.orchestra.run.smithi179.stdout: filestore ondisk finisher threads = 3 2024-08-24T21:09:49.875 INFO:teuthology.orchestra.run.smithi179.stdout: filestore apply finisher threads = 3 2024-08-24T21:09:49.876 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-08-24T21:09:49.876 INFO:teuthology.orchestra.run.smithi179.stdout: bdev debug aio = true 2024-08-24T21:09:49.876 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug misdirected ops = true 2024-08-24T21:09:49.876 INFO:teuthology.orchestra.run.smithi179.stdout: bdev async discard = True 2024-08-24T21:09:49.876 INFO:teuthology.orchestra.run.smithi179.stdout: bdev enable discard = True 2024-08-24T21:09:49.876 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore allocator = bitmap 2024-08-24T21:09:49.876 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore block size = 96636764160 2024-08-24T21:09:49.876 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore fsck on mount = True 2024-08-24T21:09:49.876 INFO:teuthology.orchestra.run.smithi179.stdout: debug bluefs = 1/20 2024-08-24T21:09:49.876 INFO:teuthology.orchestra.run.smithi179.stdout: debug bluestore = 1/20 2024-08-24T21:09:49.876 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-08-24T21:09:49.876 INFO:teuthology.orchestra.run.smithi179.stdout: debug osd = 20 2024-08-24T21:09:49.876 INFO:teuthology.orchestra.run.smithi179.stdout: debug rocksdb = 4/10 2024-08-24T21:09:49.877 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd backfillfull_ratio = 0.85 2024-08-24T21:09:49.877 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd full ratio = 0.9 2024-08-24T21:09:49.877 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd nearfull ratio = 0.8 2024-08-24T21:09:49.877 INFO:teuthology.orchestra.run.smithi179.stdout: osd blocked scrub grace period = 3600 2024-08-24T21:09:49.877 INFO:teuthology.orchestra.run.smithi179.stdout: osd failsafe full ratio = 0.95 2024-08-24T21:09:49.877 INFO:teuthology.orchestra.run.smithi179.stdout: osd max markdown count = 1000 2024-08-24T21:09:49.877 INFO:teuthology.orchestra.run.smithi179.stdout: osd objectstore = bluestore 2024-08-24T21:09:49.877 INFO:teuthology.orchestra.run.smithi179.stdout: osd shutdown pgref assert = True 2024-08-24T21:09:49.877 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-08-24T21:09:49.877 INFO:teuthology.orchestra.run.smithi179.stdout:[mgr] 2024-08-24T21:09:49.877 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-08-24T21:09:49.877 INFO:teuthology.orchestra.run.smithi179.stdout: debug mgr = 20 2024-08-24T21:09:49.877 INFO:teuthology.orchestra.run.smithi179.stdout: debug mon = 20 2024-08-24T21:09:49.877 INFO:teuthology.orchestra.run.smithi179.stdout: debug auth = 20 2024-08-24T21:09:49.878 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min pgs per osd = 4 2024-08-24T21:09:49.878 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min bytes per osd = 10 2024-08-24T21:09:49.878 INFO:teuthology.orchestra.run.smithi179.stdout: mgr/telemetry/nag = false 2024-08-24T21:09:49.878 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-08-24T21:09:49.878 INFO:teuthology.orchestra.run.smithi179.stdout:[mon] 2024-08-24T21:09:49.878 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-08-24T21:09:49.878 INFO:teuthology.orchestra.run.smithi179.stdout: debug mon = 20 2024-08-24T21:09:49.878 INFO:teuthology.orchestra.run.smithi179.stdout: debug paxos = 20 2024-08-24T21:09:49.878 INFO:teuthology.orchestra.run.smithi179.stdout: debug auth = 20 2024-08-24T21:09:49.878 INFO:teuthology.orchestra.run.smithi179.stdout: mon data avail warn = 5 2024-08-24T21:09:49.878 INFO:teuthology.orchestra.run.smithi179.stdout: mon mgr mkfs grace = 240 2024-08-24T21:09:49.878 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min pgs per osd = 4 2024-08-24T21:09:49.879 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd reporter subtree level = osd 2024-08-24T21:09:49.879 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd prime pg temp = true 2024-08-24T21:09:49.879 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min bytes per osd = 10 2024-08-24T21:09:49.879 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-08-24T21:09:49.879 INFO:teuthology.orchestra.run.smithi179.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-24T21:09:49.879 INFO:teuthology.orchestra.run.smithi179.stdout: auth mon ticket ttl = 660 # 11m 2024-08-24T21:09:49.879 INFO:teuthology.orchestra.run.smithi179.stdout: auth service ticket ttl = 240 # 4m 2024-08-24T21:09:49.879 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-08-24T21:09:49.879 INFO:teuthology.orchestra.run.smithi179.stdout: # don't complain about insecure global_id in the test suite 2024-08-24T21:09:49.879 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-24T21:09:49.879 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-24T21:09:49.879 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-08-24T21:09:49.879 INFO:teuthology.orchestra.run.smithi179.stdout: # 1m isn't quite enough 2024-08-24T21:09:49.880 INFO:teuthology.orchestra.run.smithi179.stdout: mon_down_mkfs_grace = 2m 2024-08-24T21:09:49.880 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-08-24T21:09:49.880 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_filestore_osds = false 2024-08-24T21:09:49.880 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-08-24T21:09:49.880 INFO:teuthology.orchestra.run.smithi179.stdout:[client] 2024-08-24T21:09:49.880 INFO:teuthology.orchestra.run.smithi179.stdout: rgw cache enabled = true 2024-08-24T21:09:49.880 INFO:teuthology.orchestra.run.smithi179.stdout: rgw enable ops log = true 2024-08-24T21:09:49.880 INFO:teuthology.orchestra.run.smithi179.stdout: rgw enable usage log = true 2024-08-24T21:09:49.880 INFO:teuthology.orchestra.run.smithi179.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-24T21:09:49.880 INFO:teuthology.orchestra.run.smithi179.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-24T21:09:49.880 INFO:teuthology.orchestra.run.smithi179.stdout: rbd default features = 37 2024-08-24T21:09:49.880 INFO:teuthology.orchestra.run.smithi179.stdout: rbd default map options = "ms_mode=crc,rxbounce" 2024-08-24T21:09:49.880 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.a] 2024-08-24T21:09:49.880 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.c] 2024-08-24T21:09:49.881 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.b] 2024-08-24T21:09:49.887 INFO:tasks.ceph:Creating admin key on mon.a... 2024-08-24T21:09:49.887 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-08-24T21:09:49.984 INFO:tasks.ceph:Copying monmap to all nodes... 2024-08-24T21:09:49.985 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-08-24T21:09:49.985 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-08-24T21:09:50.020 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-08-24T21:09:50.020 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-08-24T21:09:50.094 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi060.front.sepia.ceph.com 2024-08-24T21:09:50.094 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-08-24T21:09:50.094 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/ceph/ceph.keyring 2024-08-24T21:09:50.094 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-24T21:09:50.212 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-08-24T21:09:50.212 DEBUG:teuthology.orchestra.run.smithi060:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-08-24T21:09:50.286 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi119.front.sepia.ceph.com 2024-08-24T21:09:50.287 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-08-24T21:09:50.287 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/ceph/ceph.keyring 2024-08-24T21:09:50.287 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-24T21:09:50.365 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-08-24T21:09:50.365 DEBUG:teuthology.orchestra.run.smithi119:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-08-24T21:09:50.439 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi179.front.sepia.ceph.com 2024-08-24T21:09:50.439 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-08-24T21:09:50.440 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/ceph/ceph.keyring 2024-08-24T21:09:50.440 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-24T21:09:50.520 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-08-24T21:09:50.520 DEBUG:teuthology.orchestra.run.smithi179:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-08-24T21:09:50.595 INFO:tasks.ceph:Setting up mon nodes... 2024-08-24T21:09:50.595 INFO:tasks.ceph:Setting up mgr nodes... 2024-08-24T21:09:50.595 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-08-24T21:09:50.701 INFO:teuthology.orchestra.run.smithi060.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-08-24T21:09:50.707 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-08-24T21:09:50.819 INFO:teuthology.orchestra.run.smithi119.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-08-24T21:09:50.826 INFO:tasks.ceph:Setting up mds nodes... 2024-08-24T21:09:50.826 INFO:tasks.ceph_client:Setting up client nodes... 2024-08-24T21:09:50.827 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-08-24T21:09:50.915 INFO:teuthology.orchestra.run.smithi179.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-08-24T21:09:50.943 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-08-24T21:09:50.943 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi060.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi119.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-08-24T21:09:50.944 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-08-24T21:09:51.001 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-24T21:09:51.001 INFO:tasks.ceph:role: osd.0 2024-08-24T21:09:51.001 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi060.front.sepia.ceph.com 2024-08-24T21:09:51.001 DEBUG:teuthology.orchestra.run.smithi060:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-08-24T21:09:51.056 INFO:teuthology.orchestra.run.smithi060.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-08-24T21:09:51.056 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-24T21:09:51.056 INFO:teuthology.orchestra.run.smithi060.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-24T21:09:51.056 INFO:teuthology.orchestra.run.smithi060.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-24T21:09:51.056 INFO:teuthology.orchestra.run.smithi060.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-24T21:09:51.056 INFO:teuthology.orchestra.run.smithi060.stdout: = sunit=0 swidth=0 blks 2024-08-24T21:09:51.056 INFO:teuthology.orchestra.run.smithi060.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-24T21:09:51.056 INFO:teuthology.orchestra.run.smithi060.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-24T21:09:51.056 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-24T21:09:51.056 INFO:teuthology.orchestra.run.smithi060.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-24T21:09:51.090 INFO:teuthology.orchestra.run.smithi060.stdout:Discarding blocks...Done. 2024-08-24T21:09:51.093 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi060.front.sepia.ceph.com -o noatime 2024-08-24T21:09:51.094 DEBUG:teuthology.orchestra.run.smithi060:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-08-24T21:09:51.173 DEBUG:teuthology.orchestra.run.smithi060:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-08-24T21:09:51.235 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-08-24T21:09:51.292 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-24T21:09:51.293 INFO:tasks.ceph:role: osd.1 2024-08-24T21:09:51.293 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi060.front.sepia.ceph.com 2024-08-24T21:09:51.293 DEBUG:teuthology.orchestra.run.smithi060:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-08-24T21:09:51.348 INFO:teuthology.orchestra.run.smithi060.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-08-24T21:09:51.349 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-24T21:09:51.349 INFO:teuthology.orchestra.run.smithi060.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-24T21:09:51.349 INFO:teuthology.orchestra.run.smithi060.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-24T21:09:51.349 INFO:teuthology.orchestra.run.smithi060.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-24T21:09:51.349 INFO:teuthology.orchestra.run.smithi060.stdout: = sunit=0 swidth=0 blks 2024-08-24T21:09:51.349 INFO:teuthology.orchestra.run.smithi060.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-24T21:09:51.349 INFO:teuthology.orchestra.run.smithi060.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-24T21:09:51.349 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-24T21:09:51.349 INFO:teuthology.orchestra.run.smithi060.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-24T21:09:51.381 INFO:teuthology.orchestra.run.smithi060.stdout:Discarding blocks...Done. 2024-08-24T21:09:51.385 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi060.front.sepia.ceph.com -o noatime 2024-08-24T21:09:51.386 DEBUG:teuthology.orchestra.run.smithi060:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-08-24T21:09:51.466 DEBUG:teuthology.orchestra.run.smithi060:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-08-24T21:09:51.529 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-08-24T21:09:51.586 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-24T21:09:51.586 INFO:tasks.ceph:role: osd.2 2024-08-24T21:09:51.586 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi060.front.sepia.ceph.com 2024-08-24T21:09:51.586 DEBUG:teuthology.orchestra.run.smithi060:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-08-24T21:09:51.641 INFO:teuthology.orchestra.run.smithi060.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-08-24T21:09:51.641 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-24T21:09:51.642 INFO:teuthology.orchestra.run.smithi060.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-24T21:09:51.642 INFO:teuthology.orchestra.run.smithi060.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-24T21:09:51.642 INFO:teuthology.orchestra.run.smithi060.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-24T21:09:51.642 INFO:teuthology.orchestra.run.smithi060.stdout: = sunit=0 swidth=0 blks 2024-08-24T21:09:51.642 INFO:teuthology.orchestra.run.smithi060.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-24T21:09:51.642 INFO:teuthology.orchestra.run.smithi060.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-24T21:09:51.642 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-24T21:09:51.642 INFO:teuthology.orchestra.run.smithi060.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-24T21:09:51.675 INFO:teuthology.orchestra.run.smithi060.stdout:Discarding blocks...Done. 2024-08-24T21:09:51.678 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi060.front.sepia.ceph.com -o noatime 2024-08-24T21:09:51.678 DEBUG:teuthology.orchestra.run.smithi060:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-08-24T21:09:51.760 DEBUG:teuthology.orchestra.run.smithi060:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-08-24T21:09:51.825 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-08-24T21:09:51.885 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-24T21:09:51.885 INFO:tasks.ceph:role: osd.3 2024-08-24T21:09:51.885 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi060.front.sepia.ceph.com 2024-08-24T21:09:51.885 DEBUG:teuthology.orchestra.run.smithi060:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-08-24T21:09:51.941 INFO:teuthology.orchestra.run.smithi060.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-08-24T21:09:51.941 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-24T21:09:51.941 INFO:teuthology.orchestra.run.smithi060.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-24T21:09:51.941 INFO:teuthology.orchestra.run.smithi060.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-24T21:09:51.941 INFO:teuthology.orchestra.run.smithi060.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-24T21:09:51.941 INFO:teuthology.orchestra.run.smithi060.stdout: = sunit=0 swidth=0 blks 2024-08-24T21:09:51.941 INFO:teuthology.orchestra.run.smithi060.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-24T21:09:51.942 INFO:teuthology.orchestra.run.smithi060.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-24T21:09:51.942 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-24T21:09:51.942 INFO:teuthology.orchestra.run.smithi060.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-24T21:09:51.975 INFO:teuthology.orchestra.run.smithi060.stdout:Discarding blocks...Done. 2024-08-24T21:09:51.979 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi060.front.sepia.ceph.com -o noatime 2024-08-24T21:09:51.979 DEBUG:teuthology.orchestra.run.smithi060:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-08-24T21:09:52.064 DEBUG:teuthology.orchestra.run.smithi060:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-08-24T21:09:52.130 DEBUG:teuthology.orchestra.run.smithi060:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-24T21:09:52.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-08-24T21:09:52.232+0000 7ff5ae063640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-08-24T21:09:52.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-08-24T21:09:52.233+0000 7ff5ae063640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-08-24T21:09:52.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-08-24T21:09:52.233+0000 7ff5ae063640 -1 bdev(0x557b0b015800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-08-24T21:09:52.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-08-24T21:09:52.233+0000 7ff5ae063640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-08-24T21:09:55.272 DEBUG:teuthology.orchestra.run.smithi060:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-08-24T21:09:55.334 DEBUG:teuthology.orchestra.run.smithi060:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-24T21:09:55.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-08-24T21:09:55.426+0000 7f0c0b2f0640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-08-24T21:09:55.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-08-24T21:09:55.426+0000 7f0c0b2f0640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-08-24T21:09:55.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-08-24T21:09:55.426+0000 7f0c0b2f0640 -1 bdev(0x559f2ebc7800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-08-24T21:09:55.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-08-24T21:09:55.426+0000 7f0c0b2f0640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-08-24T21:09:58.666 DEBUG:teuthology.orchestra.run.smithi060:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-08-24T21:09:58.728 DEBUG:teuthology.orchestra.run.smithi060:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-24T21:09:58.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-08-24T21:09:58.819+0000 7f5e54614640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-08-24T21:09:58.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-08-24T21:09:58.820+0000 7f5e54614640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-08-24T21:09:58.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-08-24T21:09:58.820+0000 7f5e54614640 -1 bdev(0x5569ad6e1800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-08-24T21:09:58.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-08-24T21:09:58.820+0000 7f5e54614640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-08-24T21:10:01.844 DEBUG:teuthology.orchestra.run.smithi060:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-08-24T21:10:01.904 DEBUG:teuthology.orchestra.run.smithi060:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-24T21:10:01.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-08-24T21:10:01.995+0000 7f743b60e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-08-24T21:10:01.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-08-24T21:10:01.996+0000 7f743b60e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-08-24T21:10:01.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-08-24T21:10:01.996+0000 7f743b60e640 -1 bdev(0x561d398a7800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-08-24T21:10:01.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-08-24T21:10:01.996+0000 7f743b60e640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-08-24T21:10:04.997 DEBUG:teuthology.orchestra.run.smithi060:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-08-24T21:10:05.058 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-08-24T21:10:05.121 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-24T21:10:05.121 INFO:tasks.ceph:role: osd.4 2024-08-24T21:10:05.121 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi119.front.sepia.ceph.com 2024-08-24T21:10:05.122 DEBUG:teuthology.orchestra.run.smithi119:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-08-24T21:10:05.188 INFO:teuthology.orchestra.run.smithi119.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-08-24T21:10:05.188 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-24T21:10:05.188 INFO:teuthology.orchestra.run.smithi119.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-24T21:10:05.188 INFO:teuthology.orchestra.run.smithi119.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-24T21:10:05.188 INFO:teuthology.orchestra.run.smithi119.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-24T21:10:05.188 INFO:teuthology.orchestra.run.smithi119.stdout: = sunit=0 swidth=0 blks 2024-08-24T21:10:05.188 INFO:teuthology.orchestra.run.smithi119.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-24T21:10:05.188 INFO:teuthology.orchestra.run.smithi119.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-24T21:10:05.188 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-24T21:10:05.188 INFO:teuthology.orchestra.run.smithi119.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-24T21:10:05.596 INFO:teuthology.orchestra.run.smithi119.stdout:Discarding blocks...Done. 2024-08-24T21:10:05.600 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi119.front.sepia.ceph.com -o noatime 2024-08-24T21:10:05.600 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-08-24T21:10:05.748 DEBUG:teuthology.orchestra.run.smithi119:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-08-24T21:10:05.814 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-08-24T21:10:05.870 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-24T21:10:05.870 INFO:tasks.ceph:role: osd.5 2024-08-24T21:10:05.870 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi119.front.sepia.ceph.com 2024-08-24T21:10:05.870 DEBUG:teuthology.orchestra.run.smithi119:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-08-24T21:10:05.933 INFO:teuthology.orchestra.run.smithi119.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-08-24T21:10:05.933 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-24T21:10:05.933 INFO:teuthology.orchestra.run.smithi119.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-24T21:10:05.933 INFO:teuthology.orchestra.run.smithi119.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-24T21:10:05.933 INFO:teuthology.orchestra.run.smithi119.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-24T21:10:05.933 INFO:teuthology.orchestra.run.smithi119.stdout: = sunit=0 swidth=0 blks 2024-08-24T21:10:05.933 INFO:teuthology.orchestra.run.smithi119.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-24T21:10:05.933 INFO:teuthology.orchestra.run.smithi119.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-24T21:10:05.933 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-24T21:10:05.933 INFO:teuthology.orchestra.run.smithi119.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-24T21:10:06.291 INFO:teuthology.orchestra.run.smithi119.stdout:Discarding blocks...Done. 2024-08-24T21:10:06.294 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi119.front.sepia.ceph.com -o noatime 2024-08-24T21:10:06.294 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-08-24T21:10:06.378 DEBUG:teuthology.orchestra.run.smithi119:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-08-24T21:10:06.440 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-08-24T21:10:06.495 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-24T21:10:06.496 INFO:tasks.ceph:role: osd.6 2024-08-24T21:10:06.496 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi119.front.sepia.ceph.com 2024-08-24T21:10:06.496 DEBUG:teuthology.orchestra.run.smithi119:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-08-24T21:10:06.559 INFO:teuthology.orchestra.run.smithi119.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-08-24T21:10:06.559 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-24T21:10:06.559 INFO:teuthology.orchestra.run.smithi119.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-24T21:10:06.559 INFO:teuthology.orchestra.run.smithi119.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-24T21:10:06.559 INFO:teuthology.orchestra.run.smithi119.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-24T21:10:06.559 INFO:teuthology.orchestra.run.smithi119.stdout: = sunit=0 swidth=0 blks 2024-08-24T21:10:06.559 INFO:teuthology.orchestra.run.smithi119.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-24T21:10:06.560 INFO:teuthology.orchestra.run.smithi119.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-24T21:10:06.560 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-24T21:10:06.560 INFO:teuthology.orchestra.run.smithi119.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-24T21:10:06.951 INFO:teuthology.orchestra.run.smithi119.stdout:Discarding blocks...Done. 2024-08-24T21:10:06.955 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi119.front.sepia.ceph.com -o noatime 2024-08-24T21:10:06.955 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-08-24T21:10:07.058 DEBUG:teuthology.orchestra.run.smithi119:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-08-24T21:10:07.122 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-08-24T21:10:07.177 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-24T21:10:07.177 INFO:tasks.ceph:role: osd.7 2024-08-24T21:10:07.177 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi119.front.sepia.ceph.com 2024-08-24T21:10:07.177 DEBUG:teuthology.orchestra.run.smithi119:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-08-24T21:10:07.242 INFO:teuthology.orchestra.run.smithi119.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-08-24T21:10:07.243 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-24T21:10:07.243 INFO:teuthology.orchestra.run.smithi119.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-24T21:10:07.243 INFO:teuthology.orchestra.run.smithi119.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-24T21:10:07.243 INFO:teuthology.orchestra.run.smithi119.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-24T21:10:07.243 INFO:teuthology.orchestra.run.smithi119.stdout: = sunit=0 swidth=0 blks 2024-08-24T21:10:07.243 INFO:teuthology.orchestra.run.smithi119.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-24T21:10:07.243 INFO:teuthology.orchestra.run.smithi119.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-24T21:10:07.243 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-24T21:10:07.243 INFO:teuthology.orchestra.run.smithi119.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-24T21:10:07.665 INFO:teuthology.orchestra.run.smithi119.stdout:Discarding blocks...Done. 2024-08-24T21:10:07.669 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi119.front.sepia.ceph.com -o noatime 2024-08-24T21:10:07.669 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-08-24T21:10:07.792 DEBUG:teuthology.orchestra.run.smithi119:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-08-24T21:10:07.854 DEBUG:teuthology.orchestra.run.smithi119:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-24T21:10:07.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-24T21:10:07.972+0000 7f64b8eea640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-08-24T21:10:07.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-24T21:10:07.978+0000 7f64b8eea640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-08-24T21:10:07.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-24T21:10:07.978+0000 7f64b8eea640 -1 bdev(0x560518145800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-08-24T21:10:07.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-24T21:10:07.978+0000 7f64b8eea640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-08-24T21:10:11.003 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-08-24T21:10:11.064 DEBUG:teuthology.orchestra.run.smithi119:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-24T21:10:11.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-24T21:10:11.154+0000 7fbb31e16640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-08-24T21:10:11.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-24T21:10:11.155+0000 7fbb31e16640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-08-24T21:10:11.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-24T21:10:11.155+0000 7fbb31e16640 -1 bdev(0x55bb40e3d800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-08-24T21:10:11.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-24T21:10:11.155+0000 7fbb31e16640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-08-24T21:10:14.210 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-08-24T21:10:14.266 DEBUG:teuthology.orchestra.run.smithi119:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-24T21:10:14.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-24T21:10:14.355+0000 7fa390a16640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-08-24T21:10:14.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-24T21:10:14.355+0000 7fa390a16640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-08-24T21:10:14.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-24T21:10:14.355+0000 7fa390a16640 -1 bdev(0x56505aa61800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-08-24T21:10:14.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-24T21:10:14.356+0000 7fa390a16640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-08-24T21:10:17.404 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-08-24T21:10:17.459 DEBUG:teuthology.orchestra.run.smithi119:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-24T21:10:17.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-24T21:10:17.547+0000 7f4b04a0d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-08-24T21:10:17.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-24T21:10:17.547+0000 7f4b04a0d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-08-24T21:10:17.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-24T21:10:17.547+0000 7f4b04a0d640 -1 bdev(0x56227c939800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-08-24T21:10:17.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-24T21:10:17.548+0000 7f4b04a0d640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-08-24T21:10:20.581 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-08-24T21:10:20.637 INFO:tasks.ceph:Reading keys from all nodes... 2024-08-24T21:10:20.637 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-08-24T21:10:20.637 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-08-24T21:10:20.700 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-08-24T21:10:20.700 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-08-24T21:10:20.799 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-08-24T21:10:20.799 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-08-24T21:10:20.897 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-08-24T21:10:20.897 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-08-24T21:10:20.992 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-08-24T21:10:20.992 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-08-24T21:10:21.088 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-08-24T21:10:21.088 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-08-24T21:10:21.143 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-08-24T21:10:21.143 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-08-24T21:10:21.239 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-08-24T21:10:21.239 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-08-24T21:10:21.335 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-08-24T21:10:21.335 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-08-24T21:10:21.429 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-08-24T21:10:21.430 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-08-24T21:10:21.525 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-08-24T21:10:21.525 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-08-24T21:10:21.562 INFO:tasks.ceph:Adding keys to all mons... 2024-08-24T21:10:21.562 DEBUG:teuthology.orchestra.run.smithi060:> sudo tee -a /etc/ceph/ceph.keyring 2024-08-24T21:10:21.566 DEBUG:teuthology.orchestra.run.smithi119:> sudo tee -a /etc/ceph/ceph.keyring 2024-08-24T21:10:21.617 INFO:teuthology.orchestra.run.smithi060.stdout:[mgr.x] 2024-08-24T21:10:21.617 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQAeTMpmRFnNKRAAQ6pvwRnnEx+3JDnDAUSOyA== 2024-08-24T21:10:21.617 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.0] 2024-08-24T21:10:21.617 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQAgTMpmjFv7DRAATYH7tkgmDJim2JNCqp0j+g== 2024-08-24T21:10:21.618 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.1] 2024-08-24T21:10:21.618 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQAjTMpm/mmAGRAAujB5y9EK9GM4MRGaZxfzOg== 2024-08-24T21:10:21.618 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.2] 2024-08-24T21:10:21.618 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQAmTMpmzAP5MBAAibQUv8iMOPcvFDGCctEmCQ== 2024-08-24T21:10:21.618 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.3] 2024-08-24T21:10:21.618 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQApTMpmset1OxAAQ5v1WKYdlQNt/3l668JsXw== 2024-08-24T21:10:21.618 INFO:teuthology.orchestra.run.smithi060.stdout:[mgr.y] 2024-08-24T21:10:21.618 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQAeTMpmR5vYMBAATu+5xn4ianHWiaOO9Z2+rw== 2024-08-24T21:10:21.618 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.4] 2024-08-24T21:10:21.618 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQAvTMpm+s4COhAAsWVexD+h1a57qePK8SpDMA== 2024-08-24T21:10:21.618 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.5] 2024-08-24T21:10:21.619 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQAzTMpmkzNFCRAAs2wgHkMsTlH1DJEWqp3DyA== 2024-08-24T21:10:21.619 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.6] 2024-08-24T21:10:21.619 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQA2TMpm7wU4FRAA1HrsNy3+f6d/PInzBCAy3Q== 2024-08-24T21:10:21.619 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.7] 2024-08-24T21:10:21.619 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQA5TMpmK+yrIBAA+g1KSe6rmVqNZNtLeHy2JQ== 2024-08-24T21:10:21.619 INFO:teuthology.orchestra.run.smithi060.stdout:[client.0] 2024-08-24T21:10:21.619 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQAeTMpmvsGTNhAAvpYbH8kEc3K7HfsC3HP9NQ== 2024-08-24T21:10:21.619 INFO:teuthology.orchestra.run.smithi119.stdout:[mgr.x] 2024-08-24T21:10:21.620 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQAeTMpmRFnNKRAAQ6pvwRnnEx+3JDnDAUSOyA== 2024-08-24T21:10:21.620 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.0] 2024-08-24T21:10:21.620 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQAgTMpmjFv7DRAATYH7tkgmDJim2JNCqp0j+g== 2024-08-24T21:10:21.620 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.1] 2024-08-24T21:10:21.620 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQAjTMpm/mmAGRAAujB5y9EK9GM4MRGaZxfzOg== 2024-08-24T21:10:21.620 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.2] 2024-08-24T21:10:21.620 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQAmTMpmzAP5MBAAibQUv8iMOPcvFDGCctEmCQ== 2024-08-24T21:10:21.620 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.3] 2024-08-24T21:10:21.620 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQApTMpmset1OxAAQ5v1WKYdlQNt/3l668JsXw== 2024-08-24T21:10:21.620 INFO:teuthology.orchestra.run.smithi119.stdout:[mgr.y] 2024-08-24T21:10:21.620 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQAeTMpmR5vYMBAATu+5xn4ianHWiaOO9Z2+rw== 2024-08-24T21:10:21.620 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.4] 2024-08-24T21:10:21.620 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQAvTMpm+s4COhAAsWVexD+h1a57qePK8SpDMA== 2024-08-24T21:10:21.620 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.5] 2024-08-24T21:10:21.621 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQAzTMpmkzNFCRAAs2wgHkMsTlH1DJEWqp3DyA== 2024-08-24T21:10:21.621 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.6] 2024-08-24T21:10:21.621 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQA2TMpm7wU4FRAA1HrsNy3+f6d/PInzBCAy3Q== 2024-08-24T21:10:21.621 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.7] 2024-08-24T21:10:21.621 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQA5TMpmK+yrIBAA+g1KSe6rmVqNZNtLeHy2JQ== 2024-08-24T21:10:21.621 INFO:teuthology.orchestra.run.smithi119.stdout:[client.0] 2024-08-24T21:10:21.621 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQAeTMpmvsGTNhAAvpYbH8kEc3K7HfsC3HP9NQ== 2024-08-24T21:10:21.622 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-24T21:10:21.666 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-24T21:10:21.758 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-24T21:10:21.762 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-24T21:10:21.855 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-24T21:10:21.859 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-24T21:10:21.953 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-24T21:10:21.958 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-24T21:10:22.051 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-24T21:10:22.055 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-24T21:10:22.148 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-24T21:10:22.151 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-24T21:10:22.244 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-24T21:10:22.248 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-24T21:10:22.341 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-24T21:10:22.345 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-24T21:10:22.439 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-24T21:10:22.443 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-24T21:10:22.537 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-24T21:10:22.541 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-24T21:10:22.635 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-24T21:10:22.639 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-24T21:10:22.735 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-08-24T21:10:22.735 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-08-24T21:10:22.790 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-24T21:10:22.900 DEBUG:teuthology.orchestra.run.smithi060:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-08-24T21:10:22.955 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-08-24T21:10:23.010 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-24T21:10:23.118 DEBUG:teuthology.orchestra.run.smithi060:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-08-24T21:10:23.173 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-08-24T21:10:23.230 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-24T21:10:23.339 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-08-24T21:10:23.394 DEBUG:teuthology.orchestra.run.smithi060:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-08-24T21:10:23.399 DEBUG:teuthology.orchestra.run.smithi119:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-08-24T21:10:23.433 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-08-24T21:10:23.433 INFO:tasks.ceph.mon.a:Restarting daemon 2024-08-24T21:10:23.434 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-08-24T21:10:23.475 INFO:tasks.ceph.mon.a:Started 2024-08-24T21:10:23.475 INFO:tasks.ceph.mon.c:Restarting daemon 2024-08-24T21:10:23.475 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-08-24T21:10:23.479 INFO:tasks.ceph.mon.c:Started 2024-08-24T21:10:23.479 INFO:tasks.ceph.mon.b:Restarting daemon 2024-08-24T21:10:23.479 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-08-24T21:10:23.483 INFO:tasks.ceph.mon.b:Started 2024-08-24T21:10:23.483 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-08-24T21:10:23.483 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-08-24T21:10:23.483 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-08-24T21:10:23.487 INFO:tasks.ceph.mgr.x:Started 2024-08-24T21:10:23.487 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-08-24T21:10:23.487 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-08-24T21:10:23.491 INFO:tasks.ceph.mgr.y:Started 2024-08-24T21:10:23.491 DEBUG:tasks.ceph:set 0 configs 2024-08-24T21:10:23.491 INFO:tasks.ceph:Setting crush tunables to default 2024-08-24T21:10:23.491 DEBUG:teuthology.orchestra.run.smithi060:> sudo ceph --cluster ceph osd crush tunables default 2024-08-24T21:10:33.753 INFO:teuthology.orchestra.run.smithi060.stderr:adjusted tunables profile to default 2024-08-24T21:10:33.770 INFO:tasks.ceph:check_enable_crimson: False 2024-08-24T21:10:33.770 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-08-24T21:10:33.770 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-08-24T21:10:33.770 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-08-24T21:10:33.827 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-08-24T21:10:33.827 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-08-24T21:10:33.924 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-08-24T21:10:33.924 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-08-24T21:10:34.019 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-08-24T21:10:34.019 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-08-24T21:10:34.116 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-08-24T21:10:34.117 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-08-24T21:10:34.173 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-08-24T21:10:34.173 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-08-24T21:10:34.269 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-08-24T21:10:34.269 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-08-24T21:10:34.365 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-08-24T21:10:34.365 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-08-24T21:10:34.460 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd new 81276562-69e6-4a19-87ab-4278ccca38d2 0 2024-08-24T21:10:34.744 INFO:teuthology.orchestra.run.smithi119.stdout:0 2024-08-24T21:10:34.759 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd new baa87752-ecc7-4bca-9bad-4b9c3e0d5ada 1 2024-08-24T21:10:35.000 INFO:teuthology.orchestra.run.smithi119.stdout:1 2024-08-24T21:10:35.017 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd new 1a98131d-c3ba-41e3-8a85-82343060113c 2 2024-08-24T21:10:35.259 INFO:teuthology.orchestra.run.smithi119.stdout:2 2024-08-24T21:10:35.276 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd new 51fff59f-3a70-43e0-984b-f312ae046631 3 2024-08-24T21:10:35.517 INFO:teuthology.orchestra.run.smithi119.stdout:3 2024-08-24T21:10:35.532 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd new bcf54633-a99b-4e7c-8721-157871e97b4a 4 2024-08-24T21:10:35.773 INFO:teuthology.orchestra.run.smithi119.stdout:4 2024-08-24T21:10:35.789 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd new 40d4b6f4-afff-4c16-9210-5e1e2bc79d53 5 2024-08-24T21:10:36.032 INFO:teuthology.orchestra.run.smithi119.stdout:5 2024-08-24T21:10:36.047 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd new a22db233-efee-485a-92f9-e1bc9fabb0b8 6 2024-08-24T21:10:36.279 INFO:teuthology.orchestra.run.smithi119.stdout:6 2024-08-24T21:10:36.296 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd new 04c4911c-349f-40c6-9537-bddfb4401f0c 7 2024-08-24T21:10:36.536 INFO:teuthology.orchestra.run.smithi119.stdout:7 2024-08-24T21:10:36.551 INFO:tasks.ceph.osd.0:Restarting daemon 2024-08-24T21:10:36.551 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-08-24T21:10:36.555 INFO:tasks.ceph.osd.0:Started 2024-08-24T21:10:36.555 INFO:tasks.ceph.osd.1:Restarting daemon 2024-08-24T21:10:36.556 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-08-24T21:10:36.559 INFO:tasks.ceph.osd.1:Started 2024-08-24T21:10:36.559 INFO:tasks.ceph.osd.2:Restarting daemon 2024-08-24T21:10:36.559 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-08-24T21:10:36.563 INFO:tasks.ceph.osd.2:Started 2024-08-24T21:10:36.563 INFO:tasks.ceph.osd.3:Restarting daemon 2024-08-24T21:10:36.563 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-08-24T21:10:36.568 INFO:tasks.ceph.osd.3:Started 2024-08-24T21:10:36.568 INFO:tasks.ceph.osd.4:Restarting daemon 2024-08-24T21:10:36.568 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-08-24T21:10:36.572 INFO:tasks.ceph.osd.4:Started 2024-08-24T21:10:36.572 INFO:tasks.ceph.osd.5:Restarting daemon 2024-08-24T21:10:36.573 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-08-24T21:10:36.576 INFO:tasks.ceph.osd.5:Started 2024-08-24T21:10:36.577 INFO:tasks.ceph.osd.6:Restarting daemon 2024-08-24T21:10:36.577 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-08-24T21:10:36.581 INFO:tasks.ceph.osd.6:Started 2024-08-24T21:10:36.582 INFO:tasks.ceph.osd.7:Restarting daemon 2024-08-24T21:10:36.582 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-08-24T21:10:36.587 INFO:tasks.ceph.osd.7:Started 2024-08-24T21:10:36.587 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-24T21:10:36.881 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-08-24T21:10:36.881 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":10,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","created":"2024-08-24T21:10:33.650756+0000","modified":"2024-08-24T21:10:36.528636+0000","last_up_change":"0.000000","last_in_change":"2024-08-24T21:10:36.528636+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"81276562-69e6-4a19-87ab-4278ccca38d2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"baa87752-ecc7-4bca-9bad-4b9c3e0d5ada","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1a98131d-c3ba-41e3-8a85-82343060113c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"51fff59f-3a70-43e0-984b-f312ae046631","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"bcf54633-a99b-4e7c-8721-157871e97b4a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"40d4b6f4-afff-4c16-9210-5e1e2bc79d53","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a22db233-efee-485a-92f9-e1bc9fabb0b8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"04c4911c-349f-40c6-9537-bddfb4401f0c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-24T21:10:36.896 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-08-24T21:10:36.897 INFO:tasks.ceph:Waiting for OSDs to come up 2024-08-24T21:10:37.705 DEBUG:teuthology.orchestra.run.smithi060:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-24T21:10:37.942 INFO:teuthology.misc.health.smithi060.stdout: 2024-08-24T21:10:37.942 INFO:teuthology.misc.health.smithi060.stdout:{"epoch":10,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","created":"2024-08-24T21:10:33.650756+0000","modified":"2024-08-24T21:10:36.528636+0000","last_up_change":"0.000000","last_in_change":"2024-08-24T21:10:36.528636+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"81276562-69e6-4a19-87ab-4278ccca38d2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"baa87752-ecc7-4bca-9bad-4b9c3e0d5ada","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1a98131d-c3ba-41e3-8a85-82343060113c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"51fff59f-3a70-43e0-984b-f312ae046631","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"bcf54633-a99b-4e7c-8721-157871e97b4a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"40d4b6f4-afff-4c16-9210-5e1e2bc79d53","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a22db233-efee-485a-92f9-e1bc9fabb0b8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"04c4911c-349f-40c6-9537-bddfb4401f0c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-24T21:10:37.954 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-08-24T21:10:38.126 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-08-24T21:10:38.125+0000 7f7269229640 -1 Falling back to public interface 2024-08-24T21:10:38.145 INFO:tasks.ceph.osd.5.smithi119.stderr:2024-08-24T21:10:38.144+0000 7f7383e30640 -1 Falling back to public interface 2024-08-24T21:10:38.160 INFO:tasks.ceph.osd.3.smithi060.stderr:2024-08-24T21:10:38.159+0000 7fc4ba60d640 -1 Falling back to public interface 2024-08-24T21:10:38.176 INFO:tasks.ceph.osd.2.smithi060.stderr:2024-08-24T21:10:38.176+0000 7fb3820f0640 -1 Falling back to public interface 2024-08-24T21:10:38.177 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-08-24T21:10:38.176+0000 7f8c58c1b640 -1 Falling back to public interface 2024-08-24T21:10:38.191 INFO:tasks.ceph.osd.1.smithi060.stderr:2024-08-24T21:10:38.190+0000 7efc3c9a5640 -1 Falling back to public interface 2024-08-24T21:10:38.374 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-08-24T21:10:38.373+0000 7f0b92443640 -1 Falling back to public interface 2024-08-24T21:10:38.407 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-08-24T21:10:38.406+0000 7fc333da1640 -1 Falling back to public interface 2024-08-24T21:10:39.688 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-08-24T21:10:39.687+0000 7f86eca00640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-08-24T21:10:39.690 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-08-24T21:10:39.689+0000 7f86eca00640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-08-24T21:10:41.813 INFO:tasks.ceph.osd.3.smithi060.stderr:2024-08-24T21:10:41.812+0000 7fc4ba60d640 -1 osd.3 0 log_to_monitors true 2024-08-24T21:10:41.894 INFO:tasks.ceph.osd.1.smithi060.stderr:2024-08-24T21:10:41.893+0000 7efc3c9a5640 -1 osd.1 0 log_to_monitors true 2024-08-24T21:10:41.926 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-08-24T21:10:41.925+0000 7f8c58c1b640 -1 osd.6 0 log_to_monitors true 2024-08-24T21:10:41.996 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-08-24T21:10:41.995+0000 7f7269229640 -1 osd.4 0 log_to_monitors true 2024-08-24T21:10:42.326 INFO:tasks.ceph.osd.5.smithi119.stderr:2024-08-24T21:10:42.325+0000 7f7383e30640 -1 osd.5 0 log_to_monitors true 2024-08-24T21:10:42.375 INFO:tasks.ceph.osd.2.smithi060.stderr:2024-08-24T21:10:42.374+0000 7fb3820f0640 -1 osd.2 0 log_to_monitors true 2024-08-24T21:10:42.554 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-08-24T21:10:42.552+0000 7f0b92443640 -1 osd.0 0 log_to_monitors true 2024-08-24T21:10:42.599 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-08-24T21:10:42.598+0000 7fc333da1640 -1 osd.7 0 log_to_monitors true 2024-08-24T21:10:44.764 DEBUG:teuthology.orchestra.run.smithi060:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-24T21:10:45.450 INFO:teuthology.misc.health.smithi060.stdout: 2024-08-24T21:10:45.450 INFO:teuthology.misc.health.smithi060.stdout:{"epoch":12,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","created":"2024-08-24T21:10:33.650756+0000","modified":"2024-08-24T21:10:43.694079+0000","last_up_change":"0.000000","last_in_change":"2024-08-24T21:10:36.528636+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"81276562-69e6-4a19-87ab-4278ccca38d2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"baa87752-ecc7-4bca-9bad-4b9c3e0d5ada","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1a98131d-c3ba-41e3-8a85-82343060113c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"51fff59f-3a70-43e0-984b-f312ae046631","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"bcf54633-a99b-4e7c-8721-157871e97b4a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"40d4b6f4-afff-4c16-9210-5e1e2bc79d53","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a22db233-efee-485a-92f9-e1bc9fabb0b8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"04c4911c-349f-40c6-9537-bddfb4401f0c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-24T21:10:45.473 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-08-24T21:10:45.492 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-08-24T21:10:45.491+0000 7f0b8d200640 -1 osd.0 0 waiting for initial osdmap 2024-08-24T21:10:45.498 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-08-24T21:10:45.497+0000 7f0b83200640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-24T21:10:45.517 INFO:tasks.ceph.osd.1.smithi060.stderr:2024-08-24T21:10:45.516+0000 7efc38200640 -1 osd.1 0 waiting for initial osdmap 2024-08-24T21:10:45.529 INFO:tasks.ceph.osd.1.smithi060.stderr:2024-08-24T21:10:45.528+0000 7efc2d800640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-24T21:10:45.588 INFO:tasks.ceph.osd.2.smithi060.stderr:2024-08-24T21:10:45.587+0000 7fb37da00640 -1 osd.2 0 waiting for initial osdmap 2024-08-24T21:10:45.595 INFO:tasks.ceph.osd.2.smithi060.stderr:2024-08-24T21:10:45.594+0000 7fb373000640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-24T21:10:45.606 INFO:tasks.ceph.osd.3.smithi060.stderr:2024-08-24T21:10:45.605+0000 7fc4b5000640 -1 osd.3 0 waiting for initial osdmap 2024-08-24T21:10:45.612 INFO:tasks.ceph.osd.3.smithi060.stderr:2024-08-24T21:10:45.611+0000 7fc4ab000640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-24T21:10:45.989 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-08-24T21:10:45.988+0000 7f8c53400640 -1 osd.6 0 waiting for initial osdmap 2024-08-24T21:10:45.995 INFO:tasks.ceph.osd.5.smithi119.stderr:2024-08-24T21:10:45.994+0000 7f737ec00640 -1 osd.5 0 waiting for initial osdmap 2024-08-24T21:10:46.000 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-08-24T21:10:45.999+0000 7f8c49400640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-24T21:10:46.000 INFO:tasks.ceph.osd.5.smithi119.stderr:2024-08-24T21:10:45.999+0000 7f7374200640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-24T21:10:46.025 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-08-24T21:10:46.024+0000 7fc32ec00640 -1 osd.7 0 waiting for initial osdmap 2024-08-24T21:10:46.031 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-08-24T21:10:46.030+0000 7fc324c00640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-24T21:10:46.032 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-08-24T21:10:46.031+0000 7f7264000640 -1 osd.4 0 waiting for initial osdmap 2024-08-24T21:10:46.050 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-08-24T21:10:46.049+0000 7f725a000640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-24T21:10:52.282 DEBUG:teuthology.orchestra.run.smithi060:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-24T21:10:52.640 INFO:teuthology.misc.health.smithi060.stdout: 2024-08-24T21:10:52.640 INFO:teuthology.misc.health.smithi060.stdout:{"epoch":16,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","created":"2024-08-24T21:10:33.650756+0000","modified":"2024-08-24T21:10:49.507641+0000","last_up_change":"2024-08-24T21:10:46.496096+0000","last_in_change":"2024-08-24T21:10:36.528636+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-24T21:10:46.693216+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"81276562-69e6-4a19-87ab-4278ccca38d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":4066438574},{"type":"v1","addr":"172.21.15.60:6825","nonce":4066438574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":4066438574},{"type":"v1","addr":"172.21.15.60:6827","nonce":4066438574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":4066438574},{"type":"v1","addr":"172.21.15.60:6831","nonce":4066438574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":4066438574},{"type":"v1","addr":"172.21.15.60:6829","nonce":4066438574}]},"public_addr":"172.21.15.60:6825/4066438574","cluster_addr":"172.21.15.60:6827/4066438574","heartbeat_back_addr":"172.21.15.60:6831/4066438574","heartbeat_front_addr":"172.21.15.60:6829/4066438574","state":["exists","up"]},{"osd":1,"uuid":"baa87752-ecc7-4bca-9bad-4b9c3e0d5ada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":584732176},{"type":"v1","addr":"172.21.15.60:6817","nonce":584732176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":584732176},{"type":"v1","addr":"172.21.15.60:6819","nonce":584732176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":584732176},{"type":"v1","addr":"172.21.15.60:6823","nonce":584732176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":584732176},{"type":"v1","addr":"172.21.15.60:6821","nonce":584732176}]},"public_addr":"172.21.15.60:6817/584732176","cluster_addr":"172.21.15.60:6819/584732176","heartbeat_back_addr":"172.21.15.60:6823/584732176","heartbeat_front_addr":"172.21.15.60:6821/584732176","state":["exists","up"]},{"osd":2,"uuid":"1a98131d-c3ba-41e3-8a85-82343060113c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":258042578},{"type":"v1","addr":"172.21.15.60:6809","nonce":258042578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":258042578},{"type":"v1","addr":"172.21.15.60:6811","nonce":258042578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":258042578},{"type":"v1","addr":"172.21.15.60:6815","nonce":258042578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":258042578},{"type":"v1","addr":"172.21.15.60:6813","nonce":258042578}]},"public_addr":"172.21.15.60:6809/258042578","cluster_addr":"172.21.15.60:6811/258042578","heartbeat_back_addr":"172.21.15.60:6815/258042578","heartbeat_front_addr":"172.21.15.60:6813/258042578","state":["exists","up"]},{"osd":3,"uuid":"51fff59f-3a70-43e0-984b-f312ae046631","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":3146668690},{"type":"v1","addr":"172.21.15.60:6801","nonce":3146668690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":3146668690},{"type":"v1","addr":"172.21.15.60:6803","nonce":3146668690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":3146668690},{"type":"v1","addr":"172.21.15.60:6807","nonce":3146668690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":3146668690},{"type":"v1","addr":"172.21.15.60:6805","nonce":3146668690}]},"public_addr":"172.21.15.60:6801/3146668690","cluster_addr":"172.21.15.60:6803/3146668690","heartbeat_back_addr":"172.21.15.60:6807/3146668690","heartbeat_front_addr":"172.21.15.60:6805/3146668690","state":["exists","up"]},{"osd":4,"uuid":"bcf54633-a99b-4e7c-8721-157871e97b4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2066252957},{"type":"v1","addr":"172.21.15.119:6801","nonce":2066252957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2066252957},{"type":"v1","addr":"172.21.15.119:6803","nonce":2066252957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2066252957},{"type":"v1","addr":"172.21.15.119:6807","nonce":2066252957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2066252957},{"type":"v1","addr":"172.21.15.119:6805","nonce":2066252957}]},"public_addr":"172.21.15.119:6801/2066252957","cluster_addr":"172.21.15.119:6803/2066252957","heartbeat_back_addr":"172.21.15.119:6807/2066252957","heartbeat_front_addr":"172.21.15.119:6805/2066252957","state":["exists","up"]},{"osd":5,"uuid":"40d4b6f4-afff-4c16-9210-5e1e2bc79d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2312604438},{"type":"v1","addr":"172.21.15.119:6809","nonce":2312604438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2312604438},{"type":"v1","addr":"172.21.15.119:6811","nonce":2312604438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2312604438},{"type":"v1","addr":"172.21.15.119:6815","nonce":2312604438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2312604438},{"type":"v1","addr":"172.21.15.119:6813","nonce":2312604438}]},"public_addr":"172.21.15.119:6809/2312604438","cluster_addr":"172.21.15.119:6811/2312604438","heartbeat_back_addr":"172.21.15.119:6815/2312604438","heartbeat_front_addr":"172.21.15.119:6813/2312604438","state":["exists","up"]},{"osd":6,"uuid":"a22db233-efee-485a-92f9-e1bc9fabb0b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2997150625},{"type":"v1","addr":"172.21.15.119:6817","nonce":2997150625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":2997150625},{"type":"v1","addr":"172.21.15.119:6819","nonce":2997150625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2997150625},{"type":"v1","addr":"172.21.15.119:6823","nonce":2997150625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2997150625},{"type":"v1","addr":"172.21.15.119:6821","nonce":2997150625}]},"public_addr":"172.21.15.119:6817/2997150625","cluster_addr":"172.21.15.119:6819/2997150625","heartbeat_back_addr":"172.21.15.119:6823/2997150625","heartbeat_front_addr":"172.21.15.119:6821/2997150625","state":["exists","up"]},{"osd":7,"uuid":"04c4911c-349f-40c6-9537-bddfb4401f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2893412933},{"type":"v1","addr":"172.21.15.119:6825","nonce":2893412933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2893412933},{"type":"v1","addr":"172.21.15.119:6827","nonce":2893412933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2893412933},{"type":"v1","addr":"172.21.15.119:6831","nonce":2893412933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2893412933},{"type":"v1","addr":"172.21.15.119:6829","nonce":2893412933}]},"public_addr":"172.21.15.119:6825/2893412933","cluster_addr":"172.21.15.119:6827/2893412933","heartbeat_back_addr":"172.21.15.119:6831/2893412933","heartbeat_front_addr":"172.21.15.119:6829/2893412933","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-24T21:10:43.531698+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-24T21:10:42.914156+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-24T21:10:43.356140+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-24T21:10:42.832390+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-24T21:10:42.981659+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-24T21:10:43.310045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-24T21:10:42.930814+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-24T21:10:43.611225+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-24T21:10:52.655 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-08-24T21:10:52.655 INFO:tasks.ceph:Creating RBD pool 2024-08-24T21:10:52.655 DEBUG:teuthology.orchestra.run.smithi060:> sudo ceph --cluster ceph osd pool create rbd 8 2024-08-24T21:10:53.725 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'rbd' created 2024-08-24T21:10:53.748 DEBUG:teuthology.orchestra.run.smithi060:> rbd --cluster ceph pool init rbd 2024-08-24T21:10:56.769 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-08-24T21:10:56.770 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-08-24T21:10:56.770 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-08-24T21:10:57.144 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-08-24T21:10:57.162 INFO:teuthology.orchestra.run.smithi060.stdout:[{"version":9,"timestamp":"2024-08-24T21:10:46.033224+0000","name":"","changes":[{"name":"osd.4/osd_mclock_max_capacity_iops_ssd","new_value":"3864.572050"}]}] 2024-08-24T21:10:57.162 INFO:tasks.ceph_manager:config epoch is 9 2024-08-24T21:10:57.162 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-08-24T21:10:57.162 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-08-24T21:10:57.162 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-08-24T21:10:57.584 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-08-24T21:10:57.600 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":5,"flags":0,"active_gid":4102,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":703003239},{"type":"v1","addr":"172.21.15.119:6833","nonce":703003239}]},"active_addr":"172.21.15.119:6833/703003239","active_change":"2024-08-24T21:10:38.653104+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4109,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.119:0","nonce":1319711108}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.119:0","nonce":3841635621}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.119:0","nonce":515011880}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.119:0","nonce":1623887922}]}]} 2024-08-24T21:10:57.606 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-08-24T21:10:57.606 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-08-24T21:10:57.606 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-24T21:10:57.978 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-08-24T21:10:57.978 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":20,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","created":"2024-08-24T21:10:33.650756+0000","modified":"2024-08-24T21:10:56.737284+0000","last_up_change":"2024-08-24T21:10:46.496096+0000","last_in_change":"2024-08-24T21:10:36.528636+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-24T21:10:46.693216+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-08-24T21:10:53.031382+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"81276562-69e6-4a19-87ab-4278ccca38d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":4066438574},{"type":"v1","addr":"172.21.15.60:6825","nonce":4066438574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":4066438574},{"type":"v1","addr":"172.21.15.60:6827","nonce":4066438574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":4066438574},{"type":"v1","addr":"172.21.15.60:6831","nonce":4066438574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":4066438574},{"type":"v1","addr":"172.21.15.60:6829","nonce":4066438574}]},"public_addr":"172.21.15.60:6825/4066438574","cluster_addr":"172.21.15.60:6827/4066438574","heartbeat_back_addr":"172.21.15.60:6831/4066438574","heartbeat_front_addr":"172.21.15.60:6829/4066438574","state":["exists","up"]},{"osd":1,"uuid":"baa87752-ecc7-4bca-9bad-4b9c3e0d5ada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":584732176},{"type":"v1","addr":"172.21.15.60:6817","nonce":584732176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":584732176},{"type":"v1","addr":"172.21.15.60:6819","nonce":584732176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":584732176},{"type":"v1","addr":"172.21.15.60:6823","nonce":584732176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":584732176},{"type":"v1","addr":"172.21.15.60:6821","nonce":584732176}]},"public_addr":"172.21.15.60:6817/584732176","cluster_addr":"172.21.15.60:6819/584732176","heartbeat_back_addr":"172.21.15.60:6823/584732176","heartbeat_front_addr":"172.21.15.60:6821/584732176","state":["exists","up"]},{"osd":2,"uuid":"1a98131d-c3ba-41e3-8a85-82343060113c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":258042578},{"type":"v1","addr":"172.21.15.60:6809","nonce":258042578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":258042578},{"type":"v1","addr":"172.21.15.60:6811","nonce":258042578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":258042578},{"type":"v1","addr":"172.21.15.60:6815","nonce":258042578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":258042578},{"type":"v1","addr":"172.21.15.60:6813","nonce":258042578}]},"public_addr":"172.21.15.60:6809/258042578","cluster_addr":"172.21.15.60:6811/258042578","heartbeat_back_addr":"172.21.15.60:6815/258042578","heartbeat_front_addr":"172.21.15.60:6813/258042578","state":["exists","up"]},{"osd":3,"uuid":"51fff59f-3a70-43e0-984b-f312ae046631","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":3146668690},{"type":"v1","addr":"172.21.15.60:6801","nonce":3146668690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":3146668690},{"type":"v1","addr":"172.21.15.60:6803","nonce":3146668690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":3146668690},{"type":"v1","addr":"172.21.15.60:6807","nonce":3146668690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":3146668690},{"type":"v1","addr":"172.21.15.60:6805","nonce":3146668690}]},"public_addr":"172.21.15.60:6801/3146668690","cluster_addr":"172.21.15.60:6803/3146668690","heartbeat_back_addr":"172.21.15.60:6807/3146668690","heartbeat_front_addr":"172.21.15.60:6805/3146668690","state":["exists","up"]},{"osd":4,"uuid":"bcf54633-a99b-4e7c-8721-157871e97b4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2066252957},{"type":"v1","addr":"172.21.15.119:6801","nonce":2066252957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2066252957},{"type":"v1","addr":"172.21.15.119:6803","nonce":2066252957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2066252957},{"type":"v1","addr":"172.21.15.119:6807","nonce":2066252957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2066252957},{"type":"v1","addr":"172.21.15.119:6805","nonce":2066252957}]},"public_addr":"172.21.15.119:6801/2066252957","cluster_addr":"172.21.15.119:6803/2066252957","heartbeat_back_addr":"172.21.15.119:6807/2066252957","heartbeat_front_addr":"172.21.15.119:6805/2066252957","state":["exists","up"]},{"osd":5,"uuid":"40d4b6f4-afff-4c16-9210-5e1e2bc79d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2312604438},{"type":"v1","addr":"172.21.15.119:6809","nonce":2312604438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2312604438},{"type":"v1","addr":"172.21.15.119:6811","nonce":2312604438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2312604438},{"type":"v1","addr":"172.21.15.119:6815","nonce":2312604438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2312604438},{"type":"v1","addr":"172.21.15.119:6813","nonce":2312604438}]},"public_addr":"172.21.15.119:6809/2312604438","cluster_addr":"172.21.15.119:6811/2312604438","heartbeat_back_addr":"172.21.15.119:6815/2312604438","heartbeat_front_addr":"172.21.15.119:6813/2312604438","state":["exists","up"]},{"osd":6,"uuid":"a22db233-efee-485a-92f9-e1bc9fabb0b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2997150625},{"type":"v1","addr":"172.21.15.119:6817","nonce":2997150625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":2997150625},{"type":"v1","addr":"172.21.15.119:6819","nonce":2997150625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2997150625},{"type":"v1","addr":"172.21.15.119:6823","nonce":2997150625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2997150625},{"type":"v1","addr":"172.21.15.119:6821","nonce":2997150625}]},"public_addr":"172.21.15.119:6817/2997150625","cluster_addr":"172.21.15.119:6819/2997150625","heartbeat_back_addr":"172.21.15.119:6823/2997150625","heartbeat_front_addr":"172.21.15.119:6821/2997150625","state":["exists","up"]},{"osd":7,"uuid":"04c4911c-349f-40c6-9537-bddfb4401f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2893412933},{"type":"v1","addr":"172.21.15.119:6825","nonce":2893412933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2893412933},{"type":"v1","addr":"172.21.15.119:6827","nonce":2893412933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2893412933},{"type":"v1","addr":"172.21.15.119:6831","nonce":2893412933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2893412933},{"type":"v1","addr":"172.21.15.119:6829","nonce":2893412933}]},"public_addr":"172.21.15.119:6825/2893412933","cluster_addr":"172.21.15.119:6827/2893412933","heartbeat_back_addr":"172.21.15.119:6831/2893412933","heartbeat_front_addr":"172.21.15.119:6829/2893412933","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-24T21:10:43.531698+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-24T21:10:42.914156+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-24T21:10:43.356140+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-24T21:10:42.832390+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-24T21:10:42.981659+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-24T21:10:43.310045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-24T21:10:42.930814+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-24T21:10:43.611225+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-24T21:10:57.996 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-08-24T21:10:57.996 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-24T21:10:58.363 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-08-24T21:10:58.363 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":20,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","created":"2024-08-24T21:10:33.650756+0000","modified":"2024-08-24T21:10:56.737284+0000","last_up_change":"2024-08-24T21:10:46.496096+0000","last_in_change":"2024-08-24T21:10:36.528636+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-24T21:10:46.693216+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-08-24T21:10:53.031382+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"81276562-69e6-4a19-87ab-4278ccca38d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":4066438574},{"type":"v1","addr":"172.21.15.60:6825","nonce":4066438574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":4066438574},{"type":"v1","addr":"172.21.15.60:6827","nonce":4066438574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":4066438574},{"type":"v1","addr":"172.21.15.60:6831","nonce":4066438574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":4066438574},{"type":"v1","addr":"172.21.15.60:6829","nonce":4066438574}]},"public_addr":"172.21.15.60:6825/4066438574","cluster_addr":"172.21.15.60:6827/4066438574","heartbeat_back_addr":"172.21.15.60:6831/4066438574","heartbeat_front_addr":"172.21.15.60:6829/4066438574","state":["exists","up"]},{"osd":1,"uuid":"baa87752-ecc7-4bca-9bad-4b9c3e0d5ada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":584732176},{"type":"v1","addr":"172.21.15.60:6817","nonce":584732176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":584732176},{"type":"v1","addr":"172.21.15.60:6819","nonce":584732176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":584732176},{"type":"v1","addr":"172.21.15.60:6823","nonce":584732176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":584732176},{"type":"v1","addr":"172.21.15.60:6821","nonce":584732176}]},"public_addr":"172.21.15.60:6817/584732176","cluster_addr":"172.21.15.60:6819/584732176","heartbeat_back_addr":"172.21.15.60:6823/584732176","heartbeat_front_addr":"172.21.15.60:6821/584732176","state":["exists","up"]},{"osd":2,"uuid":"1a98131d-c3ba-41e3-8a85-82343060113c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":258042578},{"type":"v1","addr":"172.21.15.60:6809","nonce":258042578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":258042578},{"type":"v1","addr":"172.21.15.60:6811","nonce":258042578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":258042578},{"type":"v1","addr":"172.21.15.60:6815","nonce":258042578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":258042578},{"type":"v1","addr":"172.21.15.60:6813","nonce":258042578}]},"public_addr":"172.21.15.60:6809/258042578","cluster_addr":"172.21.15.60:6811/258042578","heartbeat_back_addr":"172.21.15.60:6815/258042578","heartbeat_front_addr":"172.21.15.60:6813/258042578","state":["exists","up"]},{"osd":3,"uuid":"51fff59f-3a70-43e0-984b-f312ae046631","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":3146668690},{"type":"v1","addr":"172.21.15.60:6801","nonce":3146668690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":3146668690},{"type":"v1","addr":"172.21.15.60:6803","nonce":3146668690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":3146668690},{"type":"v1","addr":"172.21.15.60:6807","nonce":3146668690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":3146668690},{"type":"v1","addr":"172.21.15.60:6805","nonce":3146668690}]},"public_addr":"172.21.15.60:6801/3146668690","cluster_addr":"172.21.15.60:6803/3146668690","heartbeat_back_addr":"172.21.15.60:6807/3146668690","heartbeat_front_addr":"172.21.15.60:6805/3146668690","state":["exists","up"]},{"osd":4,"uuid":"bcf54633-a99b-4e7c-8721-157871e97b4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2066252957},{"type":"v1","addr":"172.21.15.119:6801","nonce":2066252957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2066252957},{"type":"v1","addr":"172.21.15.119:6803","nonce":2066252957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2066252957},{"type":"v1","addr":"172.21.15.119:6807","nonce":2066252957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2066252957},{"type":"v1","addr":"172.21.15.119:6805","nonce":2066252957}]},"public_addr":"172.21.15.119:6801/2066252957","cluster_addr":"172.21.15.119:6803/2066252957","heartbeat_back_addr":"172.21.15.119:6807/2066252957","heartbeat_front_addr":"172.21.15.119:6805/2066252957","state":["exists","up"]},{"osd":5,"uuid":"40d4b6f4-afff-4c16-9210-5e1e2bc79d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2312604438},{"type":"v1","addr":"172.21.15.119:6809","nonce":2312604438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2312604438},{"type":"v1","addr":"172.21.15.119:6811","nonce":2312604438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2312604438},{"type":"v1","addr":"172.21.15.119:6815","nonce":2312604438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2312604438},{"type":"v1","addr":"172.21.15.119:6813","nonce":2312604438}]},"public_addr":"172.21.15.119:6809/2312604438","cluster_addr":"172.21.15.119:6811/2312604438","heartbeat_back_addr":"172.21.15.119:6815/2312604438","heartbeat_front_addr":"172.21.15.119:6813/2312604438","state":["exists","up"]},{"osd":6,"uuid":"a22db233-efee-485a-92f9-e1bc9fabb0b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2997150625},{"type":"v1","addr":"172.21.15.119:6817","nonce":2997150625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":2997150625},{"type":"v1","addr":"172.21.15.119:6819","nonce":2997150625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2997150625},{"type":"v1","addr":"172.21.15.119:6823","nonce":2997150625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2997150625},{"type":"v1","addr":"172.21.15.119:6821","nonce":2997150625}]},"public_addr":"172.21.15.119:6817/2997150625","cluster_addr":"172.21.15.119:6819/2997150625","heartbeat_back_addr":"172.21.15.119:6823/2997150625","heartbeat_front_addr":"172.21.15.119:6821/2997150625","state":["exists","up"]},{"osd":7,"uuid":"04c4911c-349f-40c6-9537-bddfb4401f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2893412933},{"type":"v1","addr":"172.21.15.119:6825","nonce":2893412933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2893412933},{"type":"v1","addr":"172.21.15.119:6827","nonce":2893412933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2893412933},{"type":"v1","addr":"172.21.15.119:6831","nonce":2893412933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2893412933},{"type":"v1","addr":"172.21.15.119:6829","nonce":2893412933}]},"public_addr":"172.21.15.119:6825/2893412933","cluster_addr":"172.21.15.119:6827/2893412933","heartbeat_back_addr":"172.21.15.119:6831/2893412933","heartbeat_front_addr":"172.21.15.119:6829/2893412933","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-24T21:10:43.531698+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-24T21:10:42.914156+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-24T21:10:43.356140+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-24T21:10:42.832390+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-24T21:10:42.981659+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-24T21:10:43.310045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-24T21:10:42.930814+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-24T21:10:43.611225+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-24T21:10:58.381 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-08-24T21:10:58.381 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-08-24T21:10:58.381 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-08-24T21:10:58.382 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-08-24T21:10:58.382 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-08-24T21:10:58.383 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-08-24T21:10:58.383 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-08-24T21:10:58.383 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-08-24T21:10:58.759 INFO:teuthology.orchestra.run.smithi060.stdout:55834574853 2024-08-24T21:10:58.760 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-08-24T21:10:58.766 INFO:teuthology.orchestra.run.smithi060.stdout:55834574852 2024-08-24T21:10:58.766 INFO:teuthology.orchestra.run.smithi060.stdout:55834574852 2024-08-24T21:10:58.767 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-08-24T21:10:58.767 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-08-24T21:10:58.768 INFO:teuthology.orchestra.run.smithi060.stdout:55834574853 2024-08-24T21:10:58.768 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-08-24T21:10:58.771 INFO:teuthology.orchestra.run.smithi060.stdout:55834574854 2024-08-24T21:10:58.772 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-08-24T21:10:58.776 INFO:teuthology.orchestra.run.smithi060.stdout:55834574853 2024-08-24T21:10:58.777 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-08-24T21:10:58.786 INFO:teuthology.orchestra.run.smithi060.stdout:55834574853 2024-08-24T21:10:58.786 INFO:teuthology.orchestra.run.smithi060.stdout:55834574852 2024-08-24T21:10:58.787 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-08-24T21:10:58.787 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-08-24T21:10:59.488 INFO:teuthology.orchestra.run.smithi060.stdout:55834574851 2024-08-24T21:10:59.500 INFO:teuthology.orchestra.run.smithi060.stdout:55834574852 2024-08-24T21:10:59.514 INFO:teuthology.orchestra.run.smithi060.stdout:55834574851 2024-08-24T21:10:59.518 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.3 2024-08-24T21:10:59.530 INFO:teuthology.orchestra.run.smithi060.stdout:55834574852 2024-08-24T21:10:59.534 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.0 2024-08-24T21:10:59.538 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.6 2024-08-24T21:10:59.550 INFO:teuthology.orchestra.run.smithi060.stdout:55834574853 2024-08-24T21:10:59.551 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.1 2024-08-24T21:10:59.560 INFO:teuthology.orchestra.run.smithi060.stdout:55834574852 2024-08-24T21:10:59.564 INFO:teuthology.orchestra.run.smithi060.stdout:55834574852 2024-08-24T21:10:59.569 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.2 2024-08-24T21:10:59.582 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.4 2024-08-24T21:10:59.584 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.5 2024-08-24T21:10:59.586 INFO:teuthology.orchestra.run.smithi060.stdout:55834574851 2024-08-24T21:10:59.603 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.7 2024-08-24T21:11:00.519 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-08-24T21:11:00.534 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-08-24T21:11:00.539 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-08-24T21:11:00.551 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-08-24T21:11:00.570 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-08-24T21:11:00.584 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-08-24T21:11:00.585 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-08-24T21:11:00.605 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-08-24T21:11:01.207 INFO:teuthology.orchestra.run.smithi060.stdout:55834574852 2024-08-24T21:11:01.236 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.3 2024-08-24T21:11:01.237 DEBUG:teuthology.parallel:result is None 2024-08-24T21:11:01.277 INFO:teuthology.orchestra.run.smithi060.stdout:55834574852 2024-08-24T21:11:01.299 INFO:teuthology.orchestra.run.smithi060.stdout:55834574853 2024-08-24T21:11:01.307 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.6 2024-08-24T21:11:01.307 INFO:teuthology.orchestra.run.smithi060.stdout:55834574853 2024-08-24T21:11:01.307 DEBUG:teuthology.parallel:result is None 2024-08-24T21:11:01.312 INFO:teuthology.orchestra.run.smithi060.stdout:55834574853 2024-08-24T21:11:01.327 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.4 2024-08-24T21:11:01.327 DEBUG:teuthology.parallel:result is None 2024-08-24T21:11:01.330 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.0 2024-08-24T21:11:01.330 DEBUG:teuthology.parallel:result is None 2024-08-24T21:11:01.341 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.1 2024-08-24T21:11:01.341 DEBUG:teuthology.parallel:result is None 2024-08-24T21:11:01.345 INFO:teuthology.orchestra.run.smithi060.stdout:55834574854 2024-08-24T21:11:01.357 INFO:teuthology.orchestra.run.smithi060.stdout:55834574853 2024-08-24T21:11:01.358 INFO:teuthology.orchestra.run.smithi060.stdout:55834574852 2024-08-24T21:11:01.365 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2024-08-24T21:11:01.366 DEBUG:teuthology.parallel:result is None 2024-08-24T21:11:01.377 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.5 2024-08-24T21:11:01.378 DEBUG:teuthology.parallel:result is None 2024-08-24T21:11:01.378 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.7 2024-08-24T21:11:01.378 DEBUG:teuthology.parallel:result is None 2024-08-24T21:11:01.378 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-24T21:11:01.379 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-24T21:11:01.781 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-08-24T21:11:01.782 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-08-24T21:11:01.800 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-08-24T21:11:00.667110+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":235668,"kb_used_data":2768,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739052,"statfs":{"total":773094113280,"available":772852789248,"internally_reserved":0,"allocated":2834432,"data_stored":1731942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001159"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-24T21:10:56.934480+0000","last_change":"2024-08-24T21:10:56.934834+0000","last_active":"2024-08-24T21:10:56.934480+0000","last_peered":"2024-08-24T21:10:56.934480+0000","last_clean":"2024-08-24T21:10:56.934480+0000","last_became_active":"2024-08-24T21:10:54.740448+0000","last_became_peered":"2024-08-24T21:10:54.740448+0000","last_unstale":"2024-08-24T21:10:56.934480+0000","last_undegraded":"2024-08-24T21:10:56.934480+0000","last_fullsized":"2024-08-24T21:10:56.934480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T03:12:30.503053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063699500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-24T21:10:56.745843+0000","last_change":"2024-08-24T21:10:56.746217+0000","last_active":"2024-08-24T21:10:56.745843+0000","last_peered":"2024-08-24T21:10:56.745843+0000","last_clean":"2024-08-24T21:10:56.745843+0000","last_became_active":"2024-08-24T21:10:54.740255+0000","last_became_peered":"2024-08-24T21:10:54.740255+0000","last_unstale":"2024-08-24T21:10:56.745843+0000","last_undegraded":"2024-08-24T21:10:56.745843+0000","last_fullsized":"2024-08-24T21:10:56.745843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T01:07:10.465404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065658299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-24T21:10:56.908590+0000","last_change":"2024-08-24T21:10:56.908791+0000","last_active":"2024-08-24T21:10:56.908590+0000","last_peered":"2024-08-24T21:10:56.908590+0000","last_clean":"2024-08-24T21:10:56.908590+0000","last_became_active":"2024-08-24T21:10:55.004842+0000","last_became_peered":"2024-08-24T21:10:55.004842+0000","last_unstale":"2024-08-24T21:10:56.908590+0000","last_undegraded":"2024-08-24T21:10:56.908590+0000","last_fullsized":"2024-08-24T21:10:56.908590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-25T22:16:48.240982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039021900000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-24T21:10:56.745774+0000","last_change":"2024-08-24T21:10:56.746203+0000","last_active":"2024-08-24T21:10:56.745774+0000","last_peered":"2024-08-24T21:10:56.745774+0000","last_clean":"2024-08-24T21:10:56.745774+0000","last_became_active":"2024-08-24T21:10:55.004437+0000","last_became_peered":"2024-08-24T21:10:55.004437+0000","last_unstale":"2024-08-24T21:10:56.745774+0000","last_undegraded":"2024-08-24T21:10:56.745774+0000","last_fullsized":"2024-08-24T21:10:56.745774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T06:44:33.277180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000725513,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"20'2","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-24T21:10:56.750634+0000","last_change":"2024-08-24T21:10:56.750634+0000","last_active":"2024-08-24T21:10:56.750634+0000","last_peered":"2024-08-24T21:10:56.750634+0000","last_clean":"2024-08-24T21:10:56.750634+0000","last_became_active":"2024-08-24T21:10:54.740821+0000","last_became_peered":"2024-08-24T21:10:54.740821+0000","last_unstale":"2024-08-24T21:10:56.750634+0000","last_undegraded":"2024-08-24T21:10:56.750634+0000","last_fullsized":"2024-08-24T21:10:56.750634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T01:07:10.465404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096400900000000005,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-24T21:10:57.267308+0000","last_change":"2024-08-24T21:10:57.267485+0000","last_active":"2024-08-24T21:10:57.267308+0000","last_peered":"2024-08-24T21:10:57.267308+0000","last_clean":"2024-08-24T21:10:57.267308+0000","last_became_active":"2024-08-24T21:10:54.739867+0000","last_became_peered":"2024-08-24T21:10:54.739867+0000","last_unstale":"2024-08-24T21:10:57.267308+0000","last_undegraded":"2024-08-24T21:10:57.267308+0000","last_fullsized":"2024-08-24T21:10:57.267308+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T03:12:30.503053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032487299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-24T21:10:56.908549+0000","last_change":"2024-08-24T21:10:56.908772+0000","last_active":"2024-08-24T21:10:56.908549+0000","last_peered":"2024-08-24T21:10:56.908549+0000","last_clean":"2024-08-24T21:10:56.908549+0000","last_became_active":"2024-08-24T21:10:54.739290+0000","last_became_peered":"2024-08-24T21:10:54.739290+0000","last_unstale":"2024-08-24T21:10:56.908549+0000","last_undegraded":"2024-08-24T21:10:56.908549+0000","last_fullsized":"2024-08-24T21:10:56.908549+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-25T22:52:13.645125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041195799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-24T21:10:56.749877+0000","last_change":"2024-08-24T21:10:56.750104+0000","last_active":"2024-08-24T21:10:56.749877+0000","last_peered":"2024-08-24T21:10:56.749877+0000","last_clean":"2024-08-24T21:10:56.749877+0000","last_became_active":"2024-08-24T21:10:54.741763+0000","last_became_peered":"2024-08-24T21:10:54.741763+0000","last_unstale":"2024-08-24T21:10:56.749877+0000","last_undegraded":"2024-08-24T21:10:56.749877+0000","last_fullsized":"2024-08-24T21:10:56.749877+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T06:44:33.277180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044521900000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'72","reported_seq":111,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-24T21:10:56.908307+0000","last_change":"2024-08-24T21:10:48.523941+0000","last_active":"2024-08-24T21:10:56.908307+0000","last_peered":"2024-08-24T21:10:56.908307+0000","last_clean":"2024-08-24T21:10:56.908307+0000","last_became_active":"2024-08-24T21:10:48.522968+0000","last_became_peered":"2024-08-24T21:10:48.522968+0000","last_unstale":"2024-08-24T21:10:56.908307+0000","last_undegraded":"2024-08-24T21:10:56.908307+0000","last_fullsized":"2024-08-24T21:10:56.908307+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:47.498247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:47.498247+0000","last_clean_scrub_stamp":"2024-08-24T21:10:47.498247+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T07:03:32.558304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":798720,"data_stored":659264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":204800,"data_stored":68896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":68915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27240,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":204800,"data_stored":68896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":204800,"data_stored":68896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":204800,"data_stored":68896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":208896,"data_stored":68915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31968,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339872,"statfs":{"total":96636764160,"available":96604028928,"internally_reserved":0,"allocated":798720,"data_stored":659264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-24T21:11:01.801 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-24T21:11:02.164 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-08-24T21:11:02.164 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-08-24T21:11:02.181 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-08-24T21:11:00.667110+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":235668,"kb_used_data":2768,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739052,"statfs":{"total":773094113280,"available":772852789248,"internally_reserved":0,"allocated":2834432,"data_stored":1731942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001159"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-24T21:10:56.934480+0000","last_change":"2024-08-24T21:10:56.934834+0000","last_active":"2024-08-24T21:10:56.934480+0000","last_peered":"2024-08-24T21:10:56.934480+0000","last_clean":"2024-08-24T21:10:56.934480+0000","last_became_active":"2024-08-24T21:10:54.740448+0000","last_became_peered":"2024-08-24T21:10:54.740448+0000","last_unstale":"2024-08-24T21:10:56.934480+0000","last_undegraded":"2024-08-24T21:10:56.934480+0000","last_fullsized":"2024-08-24T21:10:56.934480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T03:12:30.503053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063699500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-24T21:10:56.745843+0000","last_change":"2024-08-24T21:10:56.746217+0000","last_active":"2024-08-24T21:10:56.745843+0000","last_peered":"2024-08-24T21:10:56.745843+0000","last_clean":"2024-08-24T21:10:56.745843+0000","last_became_active":"2024-08-24T21:10:54.740255+0000","last_became_peered":"2024-08-24T21:10:54.740255+0000","last_unstale":"2024-08-24T21:10:56.745843+0000","last_undegraded":"2024-08-24T21:10:56.745843+0000","last_fullsized":"2024-08-24T21:10:56.745843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T01:07:10.465404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065658299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-24T21:10:56.908590+0000","last_change":"2024-08-24T21:10:56.908791+0000","last_active":"2024-08-24T21:10:56.908590+0000","last_peered":"2024-08-24T21:10:56.908590+0000","last_clean":"2024-08-24T21:10:56.908590+0000","last_became_active":"2024-08-24T21:10:55.004842+0000","last_became_peered":"2024-08-24T21:10:55.004842+0000","last_unstale":"2024-08-24T21:10:56.908590+0000","last_undegraded":"2024-08-24T21:10:56.908590+0000","last_fullsized":"2024-08-24T21:10:56.908590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-25T22:16:48.240982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039021900000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-24T21:10:56.745774+0000","last_change":"2024-08-24T21:10:56.746203+0000","last_active":"2024-08-24T21:10:56.745774+0000","last_peered":"2024-08-24T21:10:56.745774+0000","last_clean":"2024-08-24T21:10:56.745774+0000","last_became_active":"2024-08-24T21:10:55.004437+0000","last_became_peered":"2024-08-24T21:10:55.004437+0000","last_unstale":"2024-08-24T21:10:56.745774+0000","last_undegraded":"2024-08-24T21:10:56.745774+0000","last_fullsized":"2024-08-24T21:10:56.745774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T06:44:33.277180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000725513,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"20'2","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-24T21:10:56.750634+0000","last_change":"2024-08-24T21:10:56.750634+0000","last_active":"2024-08-24T21:10:56.750634+0000","last_peered":"2024-08-24T21:10:56.750634+0000","last_clean":"2024-08-24T21:10:56.750634+0000","last_became_active":"2024-08-24T21:10:54.740821+0000","last_became_peered":"2024-08-24T21:10:54.740821+0000","last_unstale":"2024-08-24T21:10:56.750634+0000","last_undegraded":"2024-08-24T21:10:56.750634+0000","last_fullsized":"2024-08-24T21:10:56.750634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T01:07:10.465404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096400900000000005,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-24T21:10:57.267308+0000","last_change":"2024-08-24T21:10:57.267485+0000","last_active":"2024-08-24T21:10:57.267308+0000","last_peered":"2024-08-24T21:10:57.267308+0000","last_clean":"2024-08-24T21:10:57.267308+0000","last_became_active":"2024-08-24T21:10:54.739867+0000","last_became_peered":"2024-08-24T21:10:54.739867+0000","last_unstale":"2024-08-24T21:10:57.267308+0000","last_undegraded":"2024-08-24T21:10:57.267308+0000","last_fullsized":"2024-08-24T21:10:57.267308+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T03:12:30.503053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032487299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-24T21:10:56.908549+0000","last_change":"2024-08-24T21:10:56.908772+0000","last_active":"2024-08-24T21:10:56.908549+0000","last_peered":"2024-08-24T21:10:56.908549+0000","last_clean":"2024-08-24T21:10:56.908549+0000","last_became_active":"2024-08-24T21:10:54.739290+0000","last_became_peered":"2024-08-24T21:10:54.739290+0000","last_unstale":"2024-08-24T21:10:56.908549+0000","last_undegraded":"2024-08-24T21:10:56.908549+0000","last_fullsized":"2024-08-24T21:10:56.908549+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-25T22:52:13.645125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041195799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-24T21:10:56.749877+0000","last_change":"2024-08-24T21:10:56.750104+0000","last_active":"2024-08-24T21:10:56.749877+0000","last_peered":"2024-08-24T21:10:56.749877+0000","last_clean":"2024-08-24T21:10:56.749877+0000","last_became_active":"2024-08-24T21:10:54.741763+0000","last_became_peered":"2024-08-24T21:10:54.741763+0000","last_unstale":"2024-08-24T21:10:56.749877+0000","last_undegraded":"2024-08-24T21:10:56.749877+0000","last_fullsized":"2024-08-24T21:10:56.749877+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T06:44:33.277180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044521900000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'72","reported_seq":111,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-24T21:10:56.908307+0000","last_change":"2024-08-24T21:10:48.523941+0000","last_active":"2024-08-24T21:10:56.908307+0000","last_peered":"2024-08-24T21:10:56.908307+0000","last_clean":"2024-08-24T21:10:56.908307+0000","last_became_active":"2024-08-24T21:10:48.522968+0000","last_became_peered":"2024-08-24T21:10:48.522968+0000","last_unstale":"2024-08-24T21:10:56.908307+0000","last_undegraded":"2024-08-24T21:10:56.908307+0000","last_fullsized":"2024-08-24T21:10:56.908307+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:47.498247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:47.498247+0000","last_clean_scrub_stamp":"2024-08-24T21:10:47.498247+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T07:03:32.558304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":798720,"data_stored":659264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":204800,"data_stored":68896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":68915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27240,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":204800,"data_stored":68896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":204800,"data_stored":68896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":204800,"data_stored":68896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":208896,"data_stored":68915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31968,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339872,"statfs":{"total":96636764160,"available":96604028928,"internally_reserved":0,"allocated":798720,"data_stored":659264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-24T21:11:02.181 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-24T21:11:02.182 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-08-24T21:11:02.182 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-08-24T21:11:02.182 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-08-24T21:11:02.583 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-08-24T21:11:02.583 INFO:teuthology.orchestra.run.smithi060.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-08-24T21:11:02.600 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-08-24T21:11:02.600 INFO:teuthology.run_tasks:Running task mon_thrash... 2024-08-24T21:11:02.658 INFO:tasks.mon_thrash:Beginning mon_thrash... 2024-08-24T21:11:02.659 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-24T21:11:03.026 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-08-24T21:11:03.026 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":20,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","created":"2024-08-24T21:10:33.650756+0000","modified":"2024-08-24T21:10:56.737284+0000","last_up_change":"2024-08-24T21:10:46.496096+0000","last_in_change":"2024-08-24T21:10:36.528636+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-24T21:10:46.693216+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-08-24T21:10:53.031382+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"81276562-69e6-4a19-87ab-4278ccca38d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":4066438574},{"type":"v1","addr":"172.21.15.60:6825","nonce":4066438574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":4066438574},{"type":"v1","addr":"172.21.15.60:6827","nonce":4066438574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":4066438574},{"type":"v1","addr":"172.21.15.60:6831","nonce":4066438574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":4066438574},{"type":"v1","addr":"172.21.15.60:6829","nonce":4066438574}]},"public_addr":"172.21.15.60:6825/4066438574","cluster_addr":"172.21.15.60:6827/4066438574","heartbeat_back_addr":"172.21.15.60:6831/4066438574","heartbeat_front_addr":"172.21.15.60:6829/4066438574","state":["exists","up"]},{"osd":1,"uuid":"baa87752-ecc7-4bca-9bad-4b9c3e0d5ada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":584732176},{"type":"v1","addr":"172.21.15.60:6817","nonce":584732176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":584732176},{"type":"v1","addr":"172.21.15.60:6819","nonce":584732176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":584732176},{"type":"v1","addr":"172.21.15.60:6823","nonce":584732176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":584732176},{"type":"v1","addr":"172.21.15.60:6821","nonce":584732176}]},"public_addr":"172.21.15.60:6817/584732176","cluster_addr":"172.21.15.60:6819/584732176","heartbeat_back_addr":"172.21.15.60:6823/584732176","heartbeat_front_addr":"172.21.15.60:6821/584732176","state":["exists","up"]},{"osd":2,"uuid":"1a98131d-c3ba-41e3-8a85-82343060113c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":258042578},{"type":"v1","addr":"172.21.15.60:6809","nonce":258042578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":258042578},{"type":"v1","addr":"172.21.15.60:6811","nonce":258042578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":258042578},{"type":"v1","addr":"172.21.15.60:6815","nonce":258042578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":258042578},{"type":"v1","addr":"172.21.15.60:6813","nonce":258042578}]},"public_addr":"172.21.15.60:6809/258042578","cluster_addr":"172.21.15.60:6811/258042578","heartbeat_back_addr":"172.21.15.60:6815/258042578","heartbeat_front_addr":"172.21.15.60:6813/258042578","state":["exists","up"]},{"osd":3,"uuid":"51fff59f-3a70-43e0-984b-f312ae046631","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":3146668690},{"type":"v1","addr":"172.21.15.60:6801","nonce":3146668690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":3146668690},{"type":"v1","addr":"172.21.15.60:6803","nonce":3146668690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":3146668690},{"type":"v1","addr":"172.21.15.60:6807","nonce":3146668690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":3146668690},{"type":"v1","addr":"172.21.15.60:6805","nonce":3146668690}]},"public_addr":"172.21.15.60:6801/3146668690","cluster_addr":"172.21.15.60:6803/3146668690","heartbeat_back_addr":"172.21.15.60:6807/3146668690","heartbeat_front_addr":"172.21.15.60:6805/3146668690","state":["exists","up"]},{"osd":4,"uuid":"bcf54633-a99b-4e7c-8721-157871e97b4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2066252957},{"type":"v1","addr":"172.21.15.119:6801","nonce":2066252957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2066252957},{"type":"v1","addr":"172.21.15.119:6803","nonce":2066252957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2066252957},{"type":"v1","addr":"172.21.15.119:6807","nonce":2066252957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2066252957},{"type":"v1","addr":"172.21.15.119:6805","nonce":2066252957}]},"public_addr":"172.21.15.119:6801/2066252957","cluster_addr":"172.21.15.119:6803/2066252957","heartbeat_back_addr":"172.21.15.119:6807/2066252957","heartbeat_front_addr":"172.21.15.119:6805/2066252957","state":["exists","up"]},{"osd":5,"uuid":"40d4b6f4-afff-4c16-9210-5e1e2bc79d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2312604438},{"type":"v1","addr":"172.21.15.119:6809","nonce":2312604438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2312604438},{"type":"v1","addr":"172.21.15.119:6811","nonce":2312604438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2312604438},{"type":"v1","addr":"172.21.15.119:6815","nonce":2312604438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2312604438},{"type":"v1","addr":"172.21.15.119:6813","nonce":2312604438}]},"public_addr":"172.21.15.119:6809/2312604438","cluster_addr":"172.21.15.119:6811/2312604438","heartbeat_back_addr":"172.21.15.119:6815/2312604438","heartbeat_front_addr":"172.21.15.119:6813/2312604438","state":["exists","up"]},{"osd":6,"uuid":"a22db233-efee-485a-92f9-e1bc9fabb0b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2997150625},{"type":"v1","addr":"172.21.15.119:6817","nonce":2997150625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":2997150625},{"type":"v1","addr":"172.21.15.119:6819","nonce":2997150625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2997150625},{"type":"v1","addr":"172.21.15.119:6823","nonce":2997150625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2997150625},{"type":"v1","addr":"172.21.15.119:6821","nonce":2997150625}]},"public_addr":"172.21.15.119:6817/2997150625","cluster_addr":"172.21.15.119:6819/2997150625","heartbeat_back_addr":"172.21.15.119:6823/2997150625","heartbeat_front_addr":"172.21.15.119:6821/2997150625","state":["exists","up"]},{"osd":7,"uuid":"04c4911c-349f-40c6-9537-bddfb4401f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2893412933},{"type":"v1","addr":"172.21.15.119:6825","nonce":2893412933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2893412933},{"type":"v1","addr":"172.21.15.119:6827","nonce":2893412933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2893412933},{"type":"v1","addr":"172.21.15.119:6831","nonce":2893412933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2893412933},{"type":"v1","addr":"172.21.15.119:6829","nonce":2893412933}]},"public_addr":"172.21.15.119:6825/2893412933","cluster_addr":"172.21.15.119:6827/2893412933","heartbeat_back_addr":"172.21.15.119:6831/2893412933","heartbeat_front_addr":"172.21.15.119:6829/2893412933","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-24T21:10:43.531698+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-24T21:10:42.914156+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-24T21:10:43.356140+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-24T21:10:42.832390+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-24T21:10:42.981659+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-24T21:10:43.310045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-24T21:10:42.930814+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-24T21:10:43.611225+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-24T21:11:03.044 INFO:tasks.mon_thrash.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-24T21:10:46.693216+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-08-24T21:10:53.031382+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 20, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-08-24T21:11:03.044 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-24T21:11:03.413 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2024-08-24T21:11:03.431 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-08-24T21:11:03.805 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2024-08-24T21:11:03.823 INFO:tasks.mon_thrash.ceph_manager:waiting for clean 2024-08-24T21:11:03.823 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-24T21:11:04.185 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-08-24T21:11:04.186 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-08-24T21:11:04.202 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-08-24T21:11:03.631331+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":235668,"kb_used_data":2768,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739052,"statfs":{"total":773094113280,"available":772852789248,"internally_reserved":0,"allocated":2834432,"data_stored":1731942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.893416"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-24T21:10:56.934480+0000","last_change":"2024-08-24T21:10:56.934834+0000","last_active":"2024-08-24T21:10:56.934480+0000","last_peered":"2024-08-24T21:10:56.934480+0000","last_clean":"2024-08-24T21:10:56.934480+0000","last_became_active":"2024-08-24T21:10:54.740448+0000","last_became_peered":"2024-08-24T21:10:54.740448+0000","last_unstale":"2024-08-24T21:10:56.934480+0000","last_undegraded":"2024-08-24T21:10:56.934480+0000","last_fullsized":"2024-08-24T21:10:56.934480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T03:12:30.503053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063699500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-24T21:10:56.745843+0000","last_change":"2024-08-24T21:10:56.746217+0000","last_active":"2024-08-24T21:10:56.745843+0000","last_peered":"2024-08-24T21:10:56.745843+0000","last_clean":"2024-08-24T21:10:56.745843+0000","last_became_active":"2024-08-24T21:10:54.740255+0000","last_became_peered":"2024-08-24T21:10:54.740255+0000","last_unstale":"2024-08-24T21:10:56.745843+0000","last_undegraded":"2024-08-24T21:10:56.745843+0000","last_fullsized":"2024-08-24T21:10:56.745843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T01:07:10.465404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065658299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-24T21:10:56.908590+0000","last_change":"2024-08-24T21:10:56.908791+0000","last_active":"2024-08-24T21:10:56.908590+0000","last_peered":"2024-08-24T21:10:56.908590+0000","last_clean":"2024-08-24T21:10:56.908590+0000","last_became_active":"2024-08-24T21:10:55.004842+0000","last_became_peered":"2024-08-24T21:10:55.004842+0000","last_unstale":"2024-08-24T21:10:56.908590+0000","last_undegraded":"2024-08-24T21:10:56.908590+0000","last_fullsized":"2024-08-24T21:10:56.908590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-25T22:16:48.240982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039021900000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-24T21:10:56.745774+0000","last_change":"2024-08-24T21:10:56.746203+0000","last_active":"2024-08-24T21:10:56.745774+0000","last_peered":"2024-08-24T21:10:56.745774+0000","last_clean":"2024-08-24T21:10:56.745774+0000","last_became_active":"2024-08-24T21:10:55.004437+0000","last_became_peered":"2024-08-24T21:10:55.004437+0000","last_unstale":"2024-08-24T21:10:56.745774+0000","last_undegraded":"2024-08-24T21:10:56.745774+0000","last_fullsized":"2024-08-24T21:10:56.745774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T06:44:33.277180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000725513,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"20'2","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-24T21:10:56.750634+0000","last_change":"2024-08-24T21:10:56.750634+0000","last_active":"2024-08-24T21:10:56.750634+0000","last_peered":"2024-08-24T21:10:56.750634+0000","last_clean":"2024-08-24T21:10:56.750634+0000","last_became_active":"2024-08-24T21:10:54.740821+0000","last_became_peered":"2024-08-24T21:10:54.740821+0000","last_unstale":"2024-08-24T21:10:56.750634+0000","last_undegraded":"2024-08-24T21:10:56.750634+0000","last_fullsized":"2024-08-24T21:10:56.750634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T01:07:10.465404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096400900000000005,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-24T21:10:57.267308+0000","last_change":"2024-08-24T21:10:57.267485+0000","last_active":"2024-08-24T21:10:57.267308+0000","last_peered":"2024-08-24T21:10:57.267308+0000","last_clean":"2024-08-24T21:10:57.267308+0000","last_became_active":"2024-08-24T21:10:54.739867+0000","last_became_peered":"2024-08-24T21:10:54.739867+0000","last_unstale":"2024-08-24T21:10:57.267308+0000","last_undegraded":"2024-08-24T21:10:57.267308+0000","last_fullsized":"2024-08-24T21:10:57.267308+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T03:12:30.503053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032487299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-24T21:10:56.908549+0000","last_change":"2024-08-24T21:10:56.908772+0000","last_active":"2024-08-24T21:10:56.908549+0000","last_peered":"2024-08-24T21:10:56.908549+0000","last_clean":"2024-08-24T21:10:56.908549+0000","last_became_active":"2024-08-24T21:10:54.739290+0000","last_became_peered":"2024-08-24T21:10:54.739290+0000","last_unstale":"2024-08-24T21:10:56.908549+0000","last_undegraded":"2024-08-24T21:10:56.908549+0000","last_fullsized":"2024-08-24T21:10:56.908549+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-25T22:52:13.645125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041195799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-24T21:10:56.749877+0000","last_change":"2024-08-24T21:10:56.750104+0000","last_active":"2024-08-24T21:10:56.749877+0000","last_peered":"2024-08-24T21:10:56.749877+0000","last_clean":"2024-08-24T21:10:56.749877+0000","last_became_active":"2024-08-24T21:10:54.741763+0000","last_became_peered":"2024-08-24T21:10:54.741763+0000","last_unstale":"2024-08-24T21:10:56.749877+0000","last_undegraded":"2024-08-24T21:10:56.749877+0000","last_fullsized":"2024-08-24T21:10:56.749877+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T06:44:33.277180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044521900000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'72","reported_seq":111,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-24T21:10:56.908307+0000","last_change":"2024-08-24T21:10:48.523941+0000","last_active":"2024-08-24T21:10:56.908307+0000","last_peered":"2024-08-24T21:10:56.908307+0000","last_clean":"2024-08-24T21:10:56.908307+0000","last_became_active":"2024-08-24T21:10:48.522968+0000","last_became_peered":"2024-08-24T21:10:48.522968+0000","last_unstale":"2024-08-24T21:10:56.908307+0000","last_undegraded":"2024-08-24T21:10:56.908307+0000","last_fullsized":"2024-08-24T21:10:56.908307+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:47.498247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:47.498247+0000","last_clean_scrub_stamp":"2024-08-24T21:10:47.498247+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T07:03:32.558304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":798720,"data_stored":659264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":204800,"data_stored":68896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":68915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27240,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":204800,"data_stored":68896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":204800,"data_stored":68896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":204800,"data_stored":68896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":208896,"data_stored":68915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31968,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339872,"statfs":{"total":96636764160,"available":96604028928,"internally_reserved":0,"allocated":798720,"data_stored":659264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-24T21:11:04.203 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-24T21:11:04.566 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-08-24T21:11:04.566 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-08-24T21:11:04.583 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-08-24T21:11:03.631331+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":235668,"kb_used_data":2768,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739052,"statfs":{"total":773094113280,"available":772852789248,"internally_reserved":0,"allocated":2834432,"data_stored":1731942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.893416"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-24T21:10:56.934480+0000","last_change":"2024-08-24T21:10:56.934834+0000","last_active":"2024-08-24T21:10:56.934480+0000","last_peered":"2024-08-24T21:10:56.934480+0000","last_clean":"2024-08-24T21:10:56.934480+0000","last_became_active":"2024-08-24T21:10:54.740448+0000","last_became_peered":"2024-08-24T21:10:54.740448+0000","last_unstale":"2024-08-24T21:10:56.934480+0000","last_undegraded":"2024-08-24T21:10:56.934480+0000","last_fullsized":"2024-08-24T21:10:56.934480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T03:12:30.503053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063699500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-24T21:10:56.745843+0000","last_change":"2024-08-24T21:10:56.746217+0000","last_active":"2024-08-24T21:10:56.745843+0000","last_peered":"2024-08-24T21:10:56.745843+0000","last_clean":"2024-08-24T21:10:56.745843+0000","last_became_active":"2024-08-24T21:10:54.740255+0000","last_became_peered":"2024-08-24T21:10:54.740255+0000","last_unstale":"2024-08-24T21:10:56.745843+0000","last_undegraded":"2024-08-24T21:10:56.745843+0000","last_fullsized":"2024-08-24T21:10:56.745843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T01:07:10.465404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065658299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-24T21:10:56.908590+0000","last_change":"2024-08-24T21:10:56.908791+0000","last_active":"2024-08-24T21:10:56.908590+0000","last_peered":"2024-08-24T21:10:56.908590+0000","last_clean":"2024-08-24T21:10:56.908590+0000","last_became_active":"2024-08-24T21:10:55.004842+0000","last_became_peered":"2024-08-24T21:10:55.004842+0000","last_unstale":"2024-08-24T21:10:56.908590+0000","last_undegraded":"2024-08-24T21:10:56.908590+0000","last_fullsized":"2024-08-24T21:10:56.908590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-25T22:16:48.240982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039021900000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-24T21:10:56.745774+0000","last_change":"2024-08-24T21:10:56.746203+0000","last_active":"2024-08-24T21:10:56.745774+0000","last_peered":"2024-08-24T21:10:56.745774+0000","last_clean":"2024-08-24T21:10:56.745774+0000","last_became_active":"2024-08-24T21:10:55.004437+0000","last_became_peered":"2024-08-24T21:10:55.004437+0000","last_unstale":"2024-08-24T21:10:56.745774+0000","last_undegraded":"2024-08-24T21:10:56.745774+0000","last_fullsized":"2024-08-24T21:10:56.745774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T06:44:33.277180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000725513,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"20'2","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-24T21:10:56.750634+0000","last_change":"2024-08-24T21:10:56.750634+0000","last_active":"2024-08-24T21:10:56.750634+0000","last_peered":"2024-08-24T21:10:56.750634+0000","last_clean":"2024-08-24T21:10:56.750634+0000","last_became_active":"2024-08-24T21:10:54.740821+0000","last_became_peered":"2024-08-24T21:10:54.740821+0000","last_unstale":"2024-08-24T21:10:56.750634+0000","last_undegraded":"2024-08-24T21:10:56.750634+0000","last_fullsized":"2024-08-24T21:10:56.750634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T01:07:10.465404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096400900000000005,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-24T21:10:57.267308+0000","last_change":"2024-08-24T21:10:57.267485+0000","last_active":"2024-08-24T21:10:57.267308+0000","last_peered":"2024-08-24T21:10:57.267308+0000","last_clean":"2024-08-24T21:10:57.267308+0000","last_became_active":"2024-08-24T21:10:54.739867+0000","last_became_peered":"2024-08-24T21:10:54.739867+0000","last_unstale":"2024-08-24T21:10:57.267308+0000","last_undegraded":"2024-08-24T21:10:57.267308+0000","last_fullsized":"2024-08-24T21:10:57.267308+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T03:12:30.503053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032487299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-24T21:10:56.908549+0000","last_change":"2024-08-24T21:10:56.908772+0000","last_active":"2024-08-24T21:10:56.908549+0000","last_peered":"2024-08-24T21:10:56.908549+0000","last_clean":"2024-08-24T21:10:56.908549+0000","last_became_active":"2024-08-24T21:10:54.739290+0000","last_became_peered":"2024-08-24T21:10:54.739290+0000","last_unstale":"2024-08-24T21:10:56.908549+0000","last_undegraded":"2024-08-24T21:10:56.908549+0000","last_fullsized":"2024-08-24T21:10:56.908549+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-25T22:52:13.645125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041195799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-24T21:10:56.749877+0000","last_change":"2024-08-24T21:10:56.750104+0000","last_active":"2024-08-24T21:10:56.749877+0000","last_peered":"2024-08-24T21:10:56.749877+0000","last_clean":"2024-08-24T21:10:56.749877+0000","last_became_active":"2024-08-24T21:10:54.741763+0000","last_became_peered":"2024-08-24T21:10:54.741763+0000","last_unstale":"2024-08-24T21:10:56.749877+0000","last_undegraded":"2024-08-24T21:10:56.749877+0000","last_fullsized":"2024-08-24T21:10:56.749877+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T06:44:33.277180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044521900000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'72","reported_seq":111,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-24T21:10:56.908307+0000","last_change":"2024-08-24T21:10:48.523941+0000","last_active":"2024-08-24T21:10:56.908307+0000","last_peered":"2024-08-24T21:10:56.908307+0000","last_clean":"2024-08-24T21:10:56.908307+0000","last_became_active":"2024-08-24T21:10:48.522968+0000","last_became_peered":"2024-08-24T21:10:48.522968+0000","last_unstale":"2024-08-24T21:10:56.908307+0000","last_undegraded":"2024-08-24T21:10:56.908307+0000","last_fullsized":"2024-08-24T21:10:56.908307+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:47.498247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:47.498247+0000","last_clean_scrub_stamp":"2024-08-24T21:10:47.498247+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T07:03:32.558304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":798720,"data_stored":659264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":204800,"data_stored":68896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":68915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27240,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":204800,"data_stored":68896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":204800,"data_stored":68896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":204800,"data_stored":68896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":208896,"data_stored":68915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31968,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339872,"statfs":{"total":96636764160,"available":96604028928,"internally_reserved":0,"allocated":798720,"data_stored":659264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-24T21:11:04.584 INFO:tasks.mon_thrash.ceph_manager:clean! 2024-08-24T21:11:04.584 DEBUG:tasks.mon_thrash:Yielding 2024-08-24T21:11:04.584 INFO:teuthology.run_tasks:Running task workunit... 2024-08-24T21:11:04.596 INFO:tasks.workunit:Pulling workunits from ref 797669399b32d2915e64eb6d4b1257ae3c50f80b 2024-08-24T21:11:04.596 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-08-24T21:11:04.597 INFO:tasks.workunit:timeout=3h 2024-08-24T21:11:04.597 INFO:tasks.workunit:cleanup=True 2024-08-24T21:11:04.597 DEBUG:teuthology.orchestra.run.smithi179:> stat -- /home/ubuntu/cephtest/mnt.0 2024-08-24T21:11:04.597 INFO:tasks.mon_thrash.mon_thrasher:start thrashing 2024-08-24T21:11:04.597 INFO:tasks.mon_thrash.mon_thrasher:seed: 1724533864, revive delay: 20.0, thrash delay: 1.0 thrash many: False, maintain quorum: True store thrash: False, probability: 50 freeze mon: prob 10.0 duration 15.0 2024-08-24T21:11:04.597 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:11:04.598 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:11:04.636 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-24T21:11:04.636 INFO:teuthology.orchestra.run.smithi179.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-08-24T21:11:04.636 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-08-24T21:11:04.713 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-08-24T21:11:04.713 DEBUG:teuthology.orchestra.run.smithi179:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-08-24T21:11:04.789 DEBUG:teuthology.orchestra.run.smithi179:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 797669399b32d2915e64eb6d4b1257ae3c50f80b 2024-08-24T21:11:04.867 INFO:tasks.workunit.client.0.smithi179.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-08-24T21:11:05.038 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":31,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:11:05.057 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:11:05.057 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-08-24T21:11:05.057 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:11:05.058 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:11:05.232 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:11:05.232 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:11:05.232 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:11:05.232 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:11:05.232 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 6, 2024-08-24T21:11:05.232 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 41614, 2024-08-24T21:11:05.232 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:11:05.232 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:11:05.233 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:11:05.233 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:11:05.233 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:11:05.233 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 31, 2024-08-24T21:11:05.233 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:11:05.233 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:11:05.233 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:11:05.233 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:11:05.233 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:11:05.233 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:11:05.233 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:11:05.233 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:11:05.233 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:11:05.233 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:11:05.234 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:11:05.234 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:11:05.234 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:11:05.234 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:11:05.234 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:11:05.234 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:11:05.234 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:11:05.234 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:11:05.234 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:11:05.234 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:11:05.234 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:11:05.234 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:11:05.234 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:11:05.234 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:11:05.235 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:11:05.235 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:11:05.235 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:11:05.235 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:11:05.235 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:05.235 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:05.235 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:11:05.235 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:11:05.235 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:11:05.235 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:11:05.235 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:11:05.235 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:11:05.235 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:11:05.236 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:11:05.236 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:11:05.236 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:11:05.236 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:11:05.236 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:11:05.236 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:11:05.236 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:11:05.236 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:11:05.236 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:11:05.236 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:11:05.236 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:11:05.236 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:11:05.236 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:11:05.236 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:11:05.237 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:11:05.237 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:11:05.237 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:11:05.237 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:11:05.237 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:11:05.237 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:11:05.237 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:11:05.237 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:11:05.237 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:11:05.237 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:05.237 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:11:05.237 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:05.237 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:11:05.237 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:11:05.237 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:11:05.238 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:11:05.238 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:05.238 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:11:05.238 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:11:05.238 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:05.238 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:05.238 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:05.238 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:11:05.238 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:11:05.238 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:05.238 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:05.238 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:05.238 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:05.238 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:11:05.239 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:11:05.239 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:11:05.239 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:11:05.239 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:11:05.239 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:05.239 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:05.239 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:11:05.239 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:11:05.239 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:11:05.239 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:11:05.239 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:05.239 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:11:05.239 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:11:05.239 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:05.239 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:05.240 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:05.240 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:11:05.240 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:11:05.240 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:05.240 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:05.240 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:05.240 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:05.240 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:11:05.240 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:11:05.240 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:11:05.240 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:11:05.240 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:11:05.240 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:05.240 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:05.240 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:11:05.241 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:11:05.241 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:11:05.241 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:11:05.241 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:05.241 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:11:05.241 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:11:05.241 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:05.241 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:05.241 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:05.241 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:11:05.241 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:11:05.241 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:05.241 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:05.241 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:05.242 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:05.242 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:11:05.242 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:11:05.242 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:11:05.242 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:11:05.242 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:11:05.242 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:05.242 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:05.242 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:05.242 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:11:05.242 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:11:05.242 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:05.242 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:11:05.242 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:11:05.243 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:11:05.243 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:05.243 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:11:05.243 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:11:05.243 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:05.243 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:11:05.243 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:11:05.243 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:11:05.243 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:05.243 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:11:05.243 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:11:05.243 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:05.243 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:11:05.243 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:11:05.243 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:11:05.244 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:05.244 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:05.244 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:05.244 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:11:05.244 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:11:05.247 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:11:05.247 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:11:05.247 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:11:05.421 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:11:05.421 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:11:05.421 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:11:05.422 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:11:05.422 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 6, 2024-08-24T21:11:05.422 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 41803, 2024-08-24T21:11:05.422 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:11:05.422 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:11:05.422 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:11:05.422 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:11:05.422 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:11:05.422 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 31, 2024-08-24T21:11:05.422 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:11:05.422 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:11:05.422 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:11:05.422 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:11:05.423 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:11:05.423 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:11:05.423 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:11:05.423 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:11:05.423 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:11:05.423 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:11:05.423 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:11:05.423 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:11:05.423 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:11:05.423 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:11:05.423 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:11:05.423 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:11:05.424 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:11:05.424 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:11:05.424 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:11:05.424 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:11:05.424 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:11:05.424 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:11:05.424 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:11:05.424 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:11:05.424 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:11:05.424 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:11:05.424 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:11:05.424 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:11:05.424 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:05.424 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:05.425 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:11:05.425 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:11:05.425 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:11:05.425 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:11:05.425 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:11:05.425 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:11:05.425 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:11:05.425 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:11:05.425 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:11:05.425 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:11:05.425 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:11:05.425 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:11:05.426 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:11:05.426 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:11:05.426 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:11:05.426 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:11:05.426 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:11:05.426 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:11:05.426 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:11:05.426 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:11:05.426 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:11:05.426 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:11:05.427 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:11:05.427 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:11:05.427 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:11:05.427 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:11:05.427 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:11:05.427 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:11:05.427 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:11:05.427 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:11:05.427 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:05.428 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:11:05.428 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:05.428 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:11:05.428 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:11:05.428 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:11:05.428 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:11:05.428 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:05.428 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:11:05.428 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:11:05.428 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:05.428 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:05.428 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:05.428 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:11:05.429 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:11:05.429 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:05.429 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:05.429 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:05.429 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:05.429 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:11:05.429 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:11:05.429 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:11:05.429 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:11:05.429 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:11:05.429 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:05.429 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:05.429 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:11:05.429 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:11:05.430 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:11:05.430 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:11:05.430 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:05.430 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:11:05.430 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:11:05.430 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:05.430 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:05.430 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:05.430 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:11:05.430 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:11:05.430 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:05.430 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:05.430 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:05.431 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:05.431 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:11:05.431 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:11:05.431 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:11:05.431 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:11:05.431 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:11:05.431 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:05.431 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:05.431 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:11:05.431 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:11:05.431 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:11:05.431 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:11:05.431 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:05.432 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:11:05.432 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:11:05.432 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:05.432 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:05.432 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:05.432 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:11:05.432 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:11:05.432 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:05.432 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:05.432 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:05.432 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:05.432 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:11:05.432 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:11:05.432 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:11:05.433 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:11:05.433 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:11:05.433 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:05.433 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:05.433 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:05.433 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:11:05.433 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:11:05.433 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:05.433 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:11:05.433 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:11:05.433 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:11:05.433 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:05.433 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:11:05.434 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:11:05.434 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:05.434 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:11:05.434 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:11:05.434 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:11:05.434 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:05.434 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:11:05.434 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:11:05.434 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:05.434 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:11:05.434 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:11:05.434 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:11:05.435 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:05.435 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:11:05.435 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:11:05.435 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:05.435 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:11:05.435 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:11:05.435 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:11:05.435 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:05.435 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:05.435 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:05.435 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:11:05.435 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:11:05.437 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:11:05.437 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:11:05.437 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:11:05.613 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:11:05.613 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:11:05.613 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:11:05.613 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:11:05.613 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 6, 2024-08-24T21:11:05.613 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 41995, 2024-08-24T21:11:05.613 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:11:05.614 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:11:05.614 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:11:05.614 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:11:05.614 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:11:05.614 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 31, 2024-08-24T21:11:05.614 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:11:05.614 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:11:05.614 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:11:05.614 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:11:05.614 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:11:05.614 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:11:05.614 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:11:05.614 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:11:05.615 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:11:05.615 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:11:05.615 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:11:05.615 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:11:05.615 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:11:05.615 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:11:05.615 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:11:05.615 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:11:05.615 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:11:05.615 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:11:05.615 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:11:05.615 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:11:05.616 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:11:05.616 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:11:05.616 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:11:05.616 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:11:05.616 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:11:05.616 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:11:05.616 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:11:05.616 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:11:05.616 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:05.616 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:05.616 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:11:05.616 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:11:05.616 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:11:05.617 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:11:05.617 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:11:05.617 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:11:05.617 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:11:05.617 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:11:05.617 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:11:05.617 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:11:05.617 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:11:05.617 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:11:05.617 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:11:05.617 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:11:05.617 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:11:05.617 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:11:05.617 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:11:05.618 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:11:05.618 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:11:05.618 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:11:05.618 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:11:05.618 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:11:05.618 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:11:05.618 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:11:05.618 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:11:05.618 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:11:05.618 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:11:05.618 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:11:05.618 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:11:05.618 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:11:05.618 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:05.619 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:11:05.619 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:05.619 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:11:05.619 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:11:05.619 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:11:05.619 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:11:05.619 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:05.619 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:11:05.619 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:11:05.619 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:05.619 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:05.619 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:05.619 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:11:05.619 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:11:05.620 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:05.620 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:05.620 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:05.620 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:05.620 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:11:05.620 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:11:05.620 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:11:05.620 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:11:05.620 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:11:05.620 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:05.620 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:05.620 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:11:05.620 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:11:05.620 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:11:05.620 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:11:05.621 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:05.621 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:11:05.621 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:11:05.621 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:05.621 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:05.621 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:05.621 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:11:05.621 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:11:05.621 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:05.621 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:05.621 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:05.621 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:05.621 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:11:05.621 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:11:05.622 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:11:05.622 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:11:05.622 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:11:05.622 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:05.622 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:05.622 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:11:05.622 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:11:05.622 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:11:05.622 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:11:05.622 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:05.622 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:11:05.622 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:11:05.622 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:05.623 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:05.623 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:05.623 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:11:05.623 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:11:05.623 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:05.623 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:05.623 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:05.623 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:05.623 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:11:05.623 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:11:05.623 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:11:05.623 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:11:05.623 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:11:05.623 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:05.623 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:05.624 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:05.624 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:11:05.624 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:11:05.624 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:05.624 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:11:05.624 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:11:05.624 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:11:05.624 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:05.624 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:11:05.624 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:11:05.624 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:05.624 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:11:05.625 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:11:05.625 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-08-24T21:11:05.625 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:05.625 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:11:05.625 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:11:05.625 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:05.625 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:11:05.625 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:11:05.625 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:11:05.625 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:05.625 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:05.625 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:05.625 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:11:05.625 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:11:05.627 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:11:05.628 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2024-08-24T21:11:05.628 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-08-24T21:11:05.628 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-08-24T21:11:05.628 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-08-24T21:11:05.628 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-08-24T21:11:05.628 INFO:teuthology.orchestra.run:waiting for 300 2024-08-24T21:11:05.648 INFO:tasks.ceph.mon.c:Stopped 2024-08-24T21:11:05.648 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-08-24T21:11:05.648 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:11:06.124 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":32,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:11:09.143 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:11:09.590 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":35,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:11:12.608 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:11:13.062 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":39,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:11:16.082 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:11:20.140 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":10,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:11:20.159 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-08-24T21:11:20.159 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-08-24T21:11:20.159 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:11:20.335 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:11:20.335 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:11:20.335 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:11:20.336 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:11:20.336 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 10, 2024-08-24T21:11:20.336 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 56717, 2024-08-24T21:11:20.336 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:11:20.336 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:11:20.336 INFO:teuthology.orchestra.run.smithi060.stdout: 1 2024-08-24T21:11:20.336 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:11:20.336 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:11:20.336 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:11:20.336 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:11:20.336 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:11:20.336 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:11:20.336 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:11:20.336 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:11:20.337 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:11:20.337 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:11:20.337 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:11:20.337 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:11:20.337 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:11:20.337 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:11:20.337 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:11:20.337 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:11:20.337 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:11:20.337 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:11:20.337 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:11:20.337 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:11:20.338 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:11:20.338 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:11:20.338 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:11:20.338 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:11:20.338 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:11:20.338 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:11:20.338 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:11:20.338 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:11:20.338 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:11:20.338 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:11:20.338 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:20.338 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:20.338 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:11:20.339 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:11:20.339 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:11:20.339 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:11:20.339 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:11:20.339 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:11:20.339 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:11:20.339 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:11:20.339 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:11:20.339 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:11:20.339 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:11:20.339 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:11:20.339 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:11:20.339 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:11:20.340 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:11:20.340 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:11:20.340 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:11:20.340 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:11:20.340 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:11:20.340 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:11:20.340 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:11:20.340 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:11:20.340 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:11:20.340 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:11:20.340 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:11:20.340 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:11:20.340 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:11:20.341 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:11:20.341 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:11:20.341 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:11:20.341 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:20.341 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:11:20.341 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:20.341 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:11:20.341 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:11:20.341 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:11:20.341 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:11:20.341 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:20.342 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:11:20.342 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:11:20.342 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:20.342 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:20.342 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:20.342 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:11:20.342 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:11:20.342 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:20.342 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:20.342 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:20.342 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:20.342 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:11:20.343 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:11:20.343 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:11:20.343 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:11:20.343 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:11:20.343 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:20.343 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:20.343 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:11:20.343 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:11:20.343 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:11:20.343 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:11:20.343 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:20.343 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:11:20.343 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:11:20.343 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:20.343 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:20.344 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:20.344 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:11:20.344 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:11:20.344 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:20.344 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:20.344 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:20.344 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:20.344 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:11:20.344 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:11:20.344 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:11:20.344 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:11:20.344 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:11:20.345 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:20.345 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:20.345 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:11:20.345 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:11:20.345 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:11:20.345 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:11:20.345 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:20.345 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:11:20.345 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:11:20.345 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:20.345 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:20.345 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:20.345 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:11:20.345 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:11:20.346 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:20.346 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:20.346 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:20.346 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:20.346 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:11:20.346 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:11:20.346 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:11:20.346 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:11:20.346 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:11:20.346 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:20.346 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:20.346 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:20.346 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:11:20.346 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:11:20.347 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:20.347 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:11:20.347 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:11:20.347 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:11:20.347 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:20.347 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:11:20.347 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:11:20.347 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:20.347 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:11:20.347 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:11:20.347 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:11:20.347 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:20.347 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:11:20.347 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:11:20.347 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:20.348 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:11:20.348 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:11:20.348 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:11:20.348 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:20.348 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:20.348 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:20.348 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:11:20.348 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:11:20.350 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:11:20.350 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-08-24T21:11:20.350 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:11:20.526 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:11:20.526 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:11:20.526 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:11:20.526 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:11:20.526 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 10, 2024-08-24T21:11:20.526 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 56909, 2024-08-24T21:11:20.526 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:11:20.527 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:11:20.527 INFO:teuthology.orchestra.run.smithi060.stdout: 1 2024-08-24T21:11:20.527 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:11:20.527 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:11:20.527 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:11:20.527 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:11:20.527 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:11:20.527 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:11:20.527 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:11:20.527 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:11:20.527 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:11:20.527 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:11:20.527 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:11:20.527 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:11:20.528 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:11:20.528 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:11:20.528 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:11:20.528 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:11:20.528 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:11:20.528 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:11:20.528 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:11:20.528 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:11:20.528 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:11:20.528 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:11:20.528 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:11:20.528 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:11:20.528 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:11:20.528 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:11:20.528 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:11:20.529 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:11:20.529 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:11:20.529 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:11:20.529 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:20.529 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:20.529 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:11:20.529 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:11:20.529 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:11:20.529 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:11:20.529 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:11:20.529 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:11:20.529 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:11:20.529 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:11:20.530 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:11:20.530 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:11:20.530 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:11:20.530 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:11:20.530 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:11:20.530 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:11:20.530 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:11:20.530 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:11:20.530 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:11:20.530 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:11:20.530 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:11:20.530 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:11:20.530 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:11:20.530 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:11:20.531 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:11:20.531 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:11:20.531 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:11:20.531 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:11:20.531 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:11:20.531 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:11:20.531 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:11:20.531 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:11:20.531 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:20.531 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:11:20.531 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:20.531 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:11:20.531 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:11:20.531 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:11:20.531 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:11:20.532 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:20.532 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:11:20.532 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:11:20.532 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:20.532 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:20.532 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:20.532 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:11:20.532 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:11:20.532 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:20.532 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:20.532 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:20.533 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:20.533 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:11:20.533 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:11:20.533 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:11:20.533 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:11:20.533 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:11:20.533 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:20.533 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:20.533 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:11:20.533 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:11:20.533 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:11:20.533 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:11:20.533 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:20.534 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:11:20.534 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:11:20.534 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:20.534 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:20.534 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:20.534 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:11:20.534 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:11:20.534 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:20.534 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:20.534 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:20.534 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:20.534 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:11:20.534 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:11:20.534 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:11:20.535 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:11:20.535 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:11:20.535 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:20.535 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:20.535 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:11:20.535 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:11:20.535 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:11:20.535 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:11:20.535 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:20.535 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:11:20.535 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:11:20.535 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:20.535 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:20.536 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:20.536 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:11:20.536 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:11:20.536 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:20.536 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:20.536 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:20.536 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:20.536 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:11:20.536 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:11:20.536 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:11:20.536 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:11:20.536 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:11:20.536 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:20.536 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:20.536 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:20.537 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:11:20.537 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:11:20.537 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:20.537 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:11:20.537 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:11:20.537 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:11:20.537 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:20.537 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:11:20.537 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:11:20.537 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:20.537 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:11:20.537 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:11:20.537 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:11:20.537 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:20.538 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:11:20.538 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:11:20.538 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:20.538 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:11:20.538 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:11:20.538 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:11:20.538 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:20.538 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:11:20.538 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:11:20.538 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:20.538 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:11:20.538 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:11:20.538 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:11:20.538 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:20.538 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:20.539 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:20.539 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:11:20.539 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:11:20.540 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:11:20.540 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-08-24T21:11:40.542 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-08-24T21:11:40.542 INFO:tasks.ceph.mon.c:Restarting daemon 2024-08-24T21:11:40.542 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-08-24T21:11:40.547 INFO:tasks.ceph.mon.c:Started 2024-08-24T21:11:40.547 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:11:40.548 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:11:41.004 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":12,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:11:41.023 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:11:41.023 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:11:41.023 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:11:41.200 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:11:41.200 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:11:41.200 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:11:41.200 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:11:41.200 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 12, 2024-08-24T21:11:41.200 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 77581, 2024-08-24T21:11:41.200 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:11:41.200 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:11:41.200 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:11:41.200 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:11:41.201 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:11:41.201 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:11:41.201 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:11:41.201 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:11:41.201 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:11:41.201 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:11:41.201 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:11:41.201 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:11:41.201 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:11:41.201 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:11:41.201 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:11:41.201 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:11:41.201 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:11:41.202 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:11:41.202 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:11:41.202 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:11:41.202 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:11:41.202 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:11:41.202 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:11:41.202 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:11:41.202 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:11:41.202 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:11:41.202 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:11:41.202 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:11:41.202 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:11:41.203 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:11:41.203 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:11:41.203 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:11:41.203 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:11:41.203 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:11:41.203 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:41.203 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:41.203 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:11:41.203 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:11:41.203 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:11:41.203 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:11:41.203 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:11:41.203 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:11:41.203 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:11:41.204 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:11:41.204 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:11:41.204 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:11:41.204 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:11:41.204 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:11:41.204 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:11:41.204 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:11:41.204 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:11:41.204 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:11:41.204 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:11:41.204 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:11:41.204 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:11:41.204 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:11:41.205 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:11:41.205 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:11:41.205 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:11:41.205 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:11:41.205 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:11:41.205 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:11:41.205 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:11:41.205 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:11:41.205 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:11:41.205 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:11:41.205 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:41.205 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:11:41.205 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:41.205 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:11:41.205 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:11:41.206 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:11:41.206 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:11:41.206 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:41.206 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:11:41.206 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:11:41.206 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:41.206 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:41.206 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:41.206 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:11:41.206 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:11:41.206 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:41.206 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:41.206 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:41.207 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:41.207 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:11:41.207 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:11:41.207 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:11:41.207 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:11:41.207 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:11:41.207 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:41.207 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:41.207 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:11:41.207 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:11:41.207 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:11:41.207 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:11:41.207 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:41.208 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:11:41.208 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:11:41.208 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:41.208 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:41.208 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:41.208 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:11:41.208 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:11:41.208 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:41.208 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:41.208 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:41.208 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:41.208 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:11:41.208 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:11:41.208 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:11:41.209 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:11:41.209 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:11:41.209 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:41.209 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:41.209 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:11:41.209 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:11:41.209 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:11:41.209 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:11:41.209 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:41.209 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:11:41.209 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:11:41.209 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:41.209 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:41.209 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:41.209 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:11:41.210 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:11:41.210 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:41.210 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:41.210 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:41.210 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:41.210 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:11:41.210 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:11:41.210 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:11:41.210 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:11:41.210 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:11:41.210 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:41.210 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:41.210 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:41.210 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:11:41.210 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:11:41.211 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:41.211 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:11:41.211 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:11:41.211 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:11:41.211 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:41.211 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:11:41.211 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:11:41.211 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:41.211 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:11:41.211 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:11:41.211 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:11:41.211 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:41.211 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:11:41.212 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:11:41.212 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:41.212 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:11:41.212 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:11:41.212 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:11:41.212 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:41.212 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:41.212 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:41.212 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:11:41.212 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:11:41.214 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:11:41.214 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:11:41.215 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:11:45.992 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:11:45.992 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:11:45.992 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:11:45.992 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:11:45.992 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 12, 2024-08-24T21:11:45.992 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 5287, 2024-08-24T21:11:45.993 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:11:45.993 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:11:45.993 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:11:45.993 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:11:45.993 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:11:45.993 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 5, 2024-08-24T21:11:45.993 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:11:45.993 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:11:45.993 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:11:45.993 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:11:45.993 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:11:45.993 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:11:45.993 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:11:45.994 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:11:45.994 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:11:45.994 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:11:45.994 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:11:45.994 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:11:45.994 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:11:45.994 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:11:45.994 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:11:45.994 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:11:45.994 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:11:45.994 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:11:45.994 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:11:45.995 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:11:45.995 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:11:45.995 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:11:45.995 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:11:45.995 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:11:45.995 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:11:45.995 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:11:45.995 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:11:45.995 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:11:45.995 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:45.995 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:45.995 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:11:45.996 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:11:45.996 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:11:45.996 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:11:45.996 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:11:45.996 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:11:45.996 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:11:45.996 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:11:45.996 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:11:45.996 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:11:45.996 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:11:45.996 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:11:45.996 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:11:45.997 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:11:45.997 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:11:45.997 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:11:45.997 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:11:45.997 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:11:45.997 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:11:45.997 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:11:45.997 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:11:45.997 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:11:45.997 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:11:45.997 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:11:45.997 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:11:45.998 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:11:45.998 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:11:45.998 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:11:45.998 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:11:45.998 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:11:45.998 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:45.998 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:11:45.998 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:45.998 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:11:45.998 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:11:45.998 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:11:45.998 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:11:45.999 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:45.999 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:11:45.999 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:11:45.999 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:45.999 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:45.999 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:45.999 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:11:45.999 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:11:45.999 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:45.999 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:45.999 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:45.999 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:45.999 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:11:46.000 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:11:46.000 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:11:46.000 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:11:46.000 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:11:46.000 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:46.000 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:46.000 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:11:46.000 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:11:46.000 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:11:46.000 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:11:46.000 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:46.000 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:11:46.000 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:11:46.001 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:46.001 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:46.001 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:46.001 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:11:46.001 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:11:46.001 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:46.001 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:46.001 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:46.001 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:46.001 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:11:46.001 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:11:46.001 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:11:46.001 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:11:46.002 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:11:46.002 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:46.002 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:46.002 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:11:46.002 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:11:46.002 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:11:46.002 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:11:46.002 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:46.002 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:11:46.002 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:11:46.002 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:46.002 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:46.003 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:46.003 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:11:46.003 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:11:46.003 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:46.003 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:46.003 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:46.003 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:46.003 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:11:46.003 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:11:46.003 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:11:46.003 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:11:46.003 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:11:46.004 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:46.004 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:46.004 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:46.004 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:11:46.004 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:11:46.004 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:46.004 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:11:46.004 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:11:46.004 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:11:46.004 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:46.004 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:11:46.004 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:11:46.004 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:46.004 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:11:46.005 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:11:46.005 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:11:46.005 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:46.005 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:46.005 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:46.005 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:11:46.005 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:11:46.011 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:11:46.011 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:11:46.011 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:11:46.195 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:11:46.195 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:11:46.195 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:11:46.196 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:11:46.196 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 12, 2024-08-24T21:11:46.196 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 82578, 2024-08-24T21:11:46.196 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:11:46.196 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:11:46.196 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:11:46.196 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:11:46.196 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:11:46.196 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 5, 2024-08-24T21:11:46.196 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:11:46.196 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:11:46.196 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:11:46.197 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:11:46.197 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:11:46.197 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:11:46.197 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:11:46.197 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:11:46.197 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:11:46.197 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:11:46.197 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:11:46.197 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:11:46.197 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:11:46.197 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:11:46.197 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:11:46.197 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:11:46.198 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:11:46.198 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:11:46.198 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:11:46.198 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:11:46.198 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:11:46.198 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:11:46.198 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:11:46.198 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:11:46.198 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:11:46.198 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:11:46.198 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:11:46.198 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:11:46.198 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:46.199 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:46.199 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:11:46.199 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:11:46.199 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:11:46.199 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:11:46.199 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:11:46.199 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:11:46.199 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:11:46.199 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:11:46.199 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:11:46.199 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:11:46.199 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:11:46.199 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:11:46.200 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:11:46.200 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:11:46.200 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:11:46.200 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:11:46.200 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:11:46.200 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:11:46.200 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:11:46.200 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:11:46.200 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:11:46.200 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:11:46.200 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:11:46.200 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:11:46.200 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:11:46.201 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:11:46.201 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:11:46.201 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:11:46.201 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:11:46.201 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:11:46.201 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:46.201 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:11:46.201 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:46.201 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:11:46.201 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:11:46.201 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:11:46.201 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:11:46.201 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:46.202 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:11:46.202 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:11:46.202 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:46.202 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:46.202 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:46.202 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:11:46.202 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:11:46.202 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:46.202 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:46.202 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:46.202 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:46.202 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:11:46.202 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:11:46.203 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:11:46.203 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:11:46.203 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:11:46.203 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:46.203 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:46.203 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:11:46.203 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:11:46.203 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:11:46.203 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:11:46.203 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:46.203 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:11:46.203 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:11:46.204 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:46.204 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:46.204 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:46.204 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:11:46.204 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:11:46.204 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:46.204 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:46.204 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:46.204 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:46.204 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:11:46.204 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:11:46.204 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:11:46.204 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:11:46.205 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:11:46.205 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:46.205 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:46.205 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:11:46.205 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:11:46.205 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:11:46.205 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:11:46.205 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:46.205 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:11:46.205 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:11:46.205 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:46.205 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:46.205 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:46.205 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:11:46.206 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:11:46.206 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:46.206 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:46.206 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:46.206 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:46.206 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:11:46.206 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:11:46.206 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:11:46.206 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:11:46.206 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:11:46.206 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:46.206 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:46.206 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:46.207 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:11:46.207 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:11:46.207 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:46.207 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:11:46.207 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:11:46.207 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:11:46.207 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:46.207 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:11:46.207 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:11:46.207 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:46.207 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:11:46.207 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:11:46.207 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:11:46.207 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:46.208 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:11:46.208 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:11:46.208 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:46.208 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:11:46.208 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:11:46.208 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:11:46.208 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:46.208 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:11:46.208 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:11:46.208 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:46.208 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:11:46.208 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:11:46.208 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:11:46.208 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:46.209 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:46.209 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:46.209 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:11:46.209 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:11:46.210 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:11:46.210 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-08-24T21:11:46.211 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-08-24T21:11:46.669 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-08-24T21:11:47.670 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:11:47.671 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:11:48.113 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":12,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:11:48.131 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:11:48.131 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-08-24T21:11:48.131 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:11:48.131 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:11:48.308 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:11:48.308 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:11:48.308 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:11:48.308 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:11:48.308 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 12, 2024-08-24T21:11:48.308 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 84689, 2024-08-24T21:11:48.308 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:11:48.308 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:11:48.308 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:11:48.308 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:11:48.309 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:11:48.309 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 7, 2024-08-24T21:11:48.309 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:11:48.309 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:11:48.309 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:11:48.309 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:11:48.309 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:11:48.309 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:11:48.309 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:11:48.309 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:11:48.309 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:11:48.309 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:11:48.310 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:11:48.310 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:11:48.310 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:11:48.310 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:11:48.310 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:11:48.310 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:11:48.310 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:11:48.310 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:11:48.310 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:11:48.310 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:11:48.310 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:11:48.310 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:11:48.311 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:11:48.311 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:11:48.311 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:11:48.311 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:11:48.311 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:11:48.311 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:11:48.311 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:48.311 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:48.311 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:11:48.311 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:11:48.312 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:11:48.312 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:11:48.312 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:11:48.312 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:11:48.312 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:11:48.312 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:11:48.312 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:11:48.312 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:11:48.312 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:11:48.312 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:11:48.313 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:11:48.313 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:11:48.313 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:11:48.313 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:11:48.313 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:11:48.313 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:11:48.313 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:11:48.313 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:11:48.313 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:11:48.313 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:11:48.313 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:11:48.314 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:11:48.314 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:11:48.314 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:11:48.314 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:11:48.314 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:11:48.314 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:11:48.314 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:11:48.314 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:48.314 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:11:48.314 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:48.314 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:11:48.314 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:11:48.315 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:11:48.315 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:11:48.315 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:48.315 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:11:48.315 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:11:48.315 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:48.315 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:48.315 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:48.315 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:11:48.315 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:11:48.315 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:48.315 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:48.315 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:48.316 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:48.316 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:11:48.316 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:11:48.316 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:11:48.316 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:11:48.316 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:11:48.316 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:48.316 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:48.316 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:11:48.316 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:11:48.316 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:11:48.316 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:11:48.317 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:48.317 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:11:48.317 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:11:48.317 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:48.317 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:48.317 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:48.317 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:11:48.317 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:11:48.317 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:48.317 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:48.317 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:48.317 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:48.317 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:11:48.318 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:11:48.318 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:11:48.318 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:11:48.318 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:11:48.318 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:48.318 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:48.318 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:11:48.318 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:11:48.318 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:11:48.318 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:11:48.318 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:48.319 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:11:48.319 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:11:48.319 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:48.319 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:48.319 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:48.319 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:11:48.319 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:11:48.319 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:48.319 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:48.319 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:48.319 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:48.319 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:11:48.320 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:11:48.320 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:11:48.320 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:11:48.320 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:11:48.320 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:48.320 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:48.320 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:48.320 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:11:48.320 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:11:48.320 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:48.320 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:11:48.320 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:11:48.321 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:11:48.321 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:48.321 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:11:48.321 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:11:48.321 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:48.321 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:11:48.321 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:11:48.321 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:11:48.321 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:48.321 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:11:48.321 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:11:48.321 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:48.322 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:11:48.322 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:11:48.322 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:11:48.322 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:48.322 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:48.322 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:48.322 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:11:48.322 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:11:48.323 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:11:48.323 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:11:48.323 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:11:48.499 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:11:48.499 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:11:48.499 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:11:48.499 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:11:48.499 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 12, 2024-08-24T21:11:48.500 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 7794, 2024-08-24T21:11:48.500 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:11:48.500 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:11:48.500 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:11:48.500 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:11:48.500 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:11:48.500 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 7, 2024-08-24T21:11:48.500 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:11:48.500 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:11:48.500 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:11:48.500 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:11:48.500 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:11:48.500 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:11:48.500 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:11:48.501 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:11:48.501 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:11:48.501 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:11:48.501 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:11:48.501 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:11:48.501 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:11:48.501 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:11:48.501 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:11:48.501 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:11:48.501 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:11:48.501 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:11:48.501 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:11:48.501 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:11:48.501 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:11:48.501 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:11:48.502 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:11:48.502 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:11:48.502 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:11:48.502 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:11:48.502 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:11:48.502 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:11:48.502 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:48.502 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:48.502 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:11:48.502 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:11:48.502 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:11:48.502 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:11:48.503 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:11:48.503 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:11:48.503 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:11:48.503 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:11:48.503 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:11:48.503 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:11:48.503 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:11:48.503 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:11:48.503 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:11:48.503 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:11:48.503 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:11:48.503 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:11:48.504 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:11:48.504 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:11:48.504 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:11:48.504 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:11:48.504 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:11:48.504 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:11:48.504 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:11:48.504 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:11:48.504 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:11:48.504 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:11:48.504 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:11:48.504 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:11:48.504 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:11:48.505 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:11:48.505 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:48.505 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:11:48.505 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:48.505 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:11:48.505 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:11:48.505 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:11:48.505 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:11:48.505 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:48.505 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:11:48.505 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:11:48.505 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:48.505 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:48.506 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:48.506 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:11:48.506 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:11:48.506 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:48.506 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:48.506 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:48.506 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:48.506 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:11:48.506 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:11:48.506 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:11:48.506 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:11:48.506 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:11:48.506 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:48.507 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:48.507 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:11:48.507 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:11:48.507 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:11:48.507 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:11:48.507 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:48.507 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:11:48.507 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:11:48.507 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:48.507 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:48.507 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:48.507 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:11:48.508 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:11:48.508 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:48.508 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:48.508 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:48.508 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:48.508 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:11:48.508 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:11:48.508 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:11:48.508 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:11:48.508 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:11:48.508 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:48.508 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:48.509 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:11:48.509 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:11:48.509 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:11:48.509 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:11:48.509 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:48.509 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:11:48.509 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:11:48.509 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:48.509 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:48.509 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:48.509 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:11:48.509 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:11:48.509 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:48.510 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:48.510 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:48.510 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:48.510 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:11:48.510 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:11:48.510 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:11:48.510 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:11:48.510 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:11:48.510 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:48.510 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:48.510 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:48.510 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:11:48.510 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:11:48.510 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:48.511 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:11:48.511 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:11:48.511 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:11:48.511 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:48.511 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:11:48.511 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:11:48.511 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:48.511 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:11:48.511 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:11:48.511 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:11:48.511 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:48.511 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:48.512 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:48.512 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:11:48.514 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:11:48.516 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:11:48.516 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:11:48.516 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:11:48.692 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:11:48.692 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:11:48.692 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:11:48.692 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:11:48.692 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 12, 2024-08-24T21:11:48.693 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 85074, 2024-08-24T21:11:48.693 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:11:48.693 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:11:48.693 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:11:48.693 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:11:48.693 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:11:48.693 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 7, 2024-08-24T21:11:48.693 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:11:48.693 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:11:48.693 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:11:48.693 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:11:48.693 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:11:48.693 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:11:48.694 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:11:48.694 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:11:48.694 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:11:48.694 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:11:48.694 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:11:48.694 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:11:48.694 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:11:48.694 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:11:48.694 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:11:48.694 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:11:48.694 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:11:48.694 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:11:48.695 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:11:48.695 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:11:48.695 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:11:48.695 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:11:48.695 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:11:48.695 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:11:48.695 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:11:48.695 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:11:48.695 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:11:48.696 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:11:48.696 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:48.696 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:48.696 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:11:48.696 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:11:48.696 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:11:48.696 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:11:48.696 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:11:48.696 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:11:48.696 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:11:48.696 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:11:48.696 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:11:48.696 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:11:48.697 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:11:48.697 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:11:48.697 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:11:48.697 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:11:48.697 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:11:48.697 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:11:48.697 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:11:48.697 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:11:48.697 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:11:48.697 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:11:48.697 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:11:48.697 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:11:48.697 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:11:48.698 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:11:48.698 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:11:48.698 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:11:48.698 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:11:48.698 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:11:48.698 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:11:48.698 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:11:48.698 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:48.698 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:11:48.698 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:48.698 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:11:48.698 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:11:48.699 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:11:48.699 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:11:48.699 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:48.699 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:11:48.699 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:11:48.699 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:48.699 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:48.699 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:48.699 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:11:48.699 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:11:48.700 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:48.700 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:48.700 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:48.700 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:48.700 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:11:48.700 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:11:48.700 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:11:48.700 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:11:48.700 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:11:48.700 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:48.700 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:48.700 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:11:48.701 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:11:48.701 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:11:48.701 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:11:48.701 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:48.701 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:11:48.701 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:11:48.701 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:48.701 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:48.701 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:48.701 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:11:48.701 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:11:48.701 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:48.701 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:48.702 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:48.702 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:48.702 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:11:48.702 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:11:48.702 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:11:48.702 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:11:48.702 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:11:48.702 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:48.702 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:48.702 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:11:48.702 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:11:48.702 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:11:48.702 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:11:48.703 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:48.703 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:11:48.703 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:11:48.703 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:48.703 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:48.703 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:48.703 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:11:48.703 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:11:48.703 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:11:48.703 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:48.703 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:48.703 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:48.703 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:11:48.704 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:11:48.704 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:11:48.704 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:11:48.704 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:11:48.704 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:48.704 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:48.704 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:48.704 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:11:48.704 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:11:48.705 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:48.705 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:11:48.705 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:11:48.705 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:11:48.705 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:48.705 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:11:48.705 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:11:48.705 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:48.705 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:11:48.705 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:11:48.705 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:11:48.705 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:48.705 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:11:48.705 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:11:48.706 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:48.706 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:11:48.706 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:11:48.706 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:11:48.706 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:48.706 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:11:48.706 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:11:48.706 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:11:48.706 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:11:48.706 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:11:48.706 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:11:48.706 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:11:48.706 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:11:48.707 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:11:48.707 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:11:48.707 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:11:48.708 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:11:48.708 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-08-24T21:11:48.708 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-08-24T21:11:48.708 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-08-24T21:11:48.708 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-08-24T21:11:48.708 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-08-24T21:11:48.709 INFO:teuthology.orchestra.run:waiting for 300 2024-08-24T21:11:48.729 INFO:tasks.ceph.mon.a:Stopped 2024-08-24T21:11:48.729 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-08-24T21:11:48.729 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:11:49.214 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":12,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":8,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:11:52.232 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:11:52.680 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":12,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:11:55.699 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:11:56.149 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":12,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:11:59.168 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:12:02.449 INFO:tasks.workunit.client.0.smithi179.stderr:Updating files: 66% (8578/12876) Updating files: 67% (8627/12876) Updating files: 68% (8756/12876) Updating files: 69% (8885/12876) Updating files: 70% (9014/12876) Updating files: 71% (9142/12876) Updating files: 72% (9271/12876) Updating files: 73% (9400/12876) Updating files: 74% (9529/12876) Updating files: 75% (9657/12876) Updating files: 76% (9786/12876) Updating files: 77% (9915/12876) Updating files: 78% (10044/12876) Updating files: 79% (10173/12876) Updating files: 80% (10301/12876) Updating files: 81% (10430/12876) Updating files: 82% (10559/12876) Updating files: 83% (10688/12876) Updating files: 84% (10816/12876) Updating files: 85% (10945/12876) Updating files: 86% (11074/12876) Updating files: 87% (11203/12876) Updating files: 88% (11331/12876) Updating files: 89% (11460/12876) Updating files: 90% (11589/12876) Updating files: 91% (11718/12876) Updating files: 92% (11846/12876) Updating files: 93% (11975/12876) Updating files: 94% (12104/12876) Updating files: 95% (12233/12876) Updating files: 96% (12361/12876) Updating files: 97% (12490/12876) Updating files: 98% (12619/12876) Updating files: 99% (12748/12876) Updating files: 100% (12876/12876) Updating files: 100% (12876/12876), done. 2024-08-24T21:12:02.873 INFO:tasks.workunit.client.0.smithi179.stderr:Note: switching to '797669399b32d2915e64eb6d4b1257ae3c50f80b'. 2024-08-24T21:12:02.873 INFO:tasks.workunit.client.0.smithi179.stderr: 2024-08-24T21:12:02.873 INFO:tasks.workunit.client.0.smithi179.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-08-24T21:12:02.873 INFO:tasks.workunit.client.0.smithi179.stderr:changes and commit them, and you can discard any commits you make in this 2024-08-24T21:12:02.874 INFO:tasks.workunit.client.0.smithi179.stderr:state without impacting any branches by switching back to a branch. 2024-08-24T21:12:02.874 INFO:tasks.workunit.client.0.smithi179.stderr: 2024-08-24T21:12:02.874 INFO:tasks.workunit.client.0.smithi179.stderr:If you want to create a new branch to retain commits you create, you may 2024-08-24T21:12:02.874 INFO:tasks.workunit.client.0.smithi179.stderr:do so (now or later) by using -c with the switch command. Example: 2024-08-24T21:12:02.874 INFO:tasks.workunit.client.0.smithi179.stderr: 2024-08-24T21:12:02.874 INFO:tasks.workunit.client.0.smithi179.stderr: git switch -c 2024-08-24T21:12:02.874 INFO:tasks.workunit.client.0.smithi179.stderr: 2024-08-24T21:12:02.874 INFO:tasks.workunit.client.0.smithi179.stderr:Or undo this operation with: 2024-08-24T21:12:02.874 INFO:tasks.workunit.client.0.smithi179.stderr: 2024-08-24T21:12:02.874 INFO:tasks.workunit.client.0.smithi179.stderr: git switch - 2024-08-24T21:12:02.874 INFO:tasks.workunit.client.0.smithi179.stderr: 2024-08-24T21:12:02.874 INFO:tasks.workunit.client.0.smithi179.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-08-24T21:12:02.875 INFO:tasks.workunit.client.0.smithi179.stderr: 2024-08-24T21:12:02.875 INFO:tasks.workunit.client.0.smithi179.stderr:HEAD is now at 797669399b3 Merge pull request #59257 from zdover23/wip-doc-2024-08-17-cephfs-mount-point 2024-08-24T21:12:02.878 DEBUG:teuthology.orchestra.run.smithi179:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-08-24T21:12:02.968 INFO:tasks.workunit.client.0.smithi179.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-08-24T21:12:02.973 INFO:tasks.workunit.client.0.smithi179.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-08-24T21:12:02.973 INFO:tasks.workunit.client.0.smithi179.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-08-24T21:12:03.467 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":14,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:12:03.485 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-08-24T21:12:03.485 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-08-24T21:12:03.486 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:12:03.663 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:12:03.663 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:12:03.663 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:12:03.663 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:12:03.664 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 14, 2024-08-24T21:12:03.664 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 22959, 2024-08-24T21:12:03.664 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:12:03.664 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:12:03.664 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:12:03.664 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:12:03.664 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:12:03.664 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:12:03.664 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:12:03.664 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:12:03.664 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:12:03.664 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:12:03.664 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:12:03.665 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:12:03.665 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:12:03.665 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:12:03.665 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:12:03.665 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:12:03.665 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:12:03.665 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:12:03.665 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:12:03.665 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:12:03.665 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:12:03.665 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:12:03.665 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:12:03.665 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:12:03.665 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:12:03.666 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:12:03.666 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:12:03.666 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:12:03.666 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:12:03.666 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:12:03.666 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:12:03.666 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:12:03.666 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:12:03.666 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:12:03.666 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:03.666 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:12:03.666 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:12:03.667 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:12:03.667 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:12:03.667 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:12:03.667 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:12:03.667 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:12:03.667 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:12:03.667 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:12:03.669 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:12:03.670 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:12:03.670 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:12:03.670 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:12:03.670 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:12:03.670 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:12:03.670 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:12:03.670 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:12:03.670 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:12:03.670 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:12:03.671 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:12:03.671 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:12:03.671 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:12:03.671 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:12:03.671 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:12:03.671 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:12:03.671 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:12:03.671 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:12:03.671 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:12:03.671 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:12:03.672 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:12:03.672 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:03.672 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:12:03.672 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:03.672 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:12:03.672 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:12:03.672 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:12:03.672 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:12:03.672 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:03.672 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:12:03.672 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:12:03.672 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:12:03.672 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:03.673 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:03.673 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:12:03.673 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:12:03.673 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:12:03.673 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:03.673 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:12:03.673 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:03.673 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:12:03.673 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:12:03.673 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:12:03.673 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:12:03.673 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:12:03.674 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:03.674 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:03.674 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:12:03.674 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:12:03.674 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:12:03.674 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:12:03.674 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:03.674 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:12:03.674 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:12:03.674 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:12:03.674 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:03.674 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:03.675 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:12:03.675 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:12:03.675 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:12:03.675 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:03.675 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:12:03.675 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:03.675 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:12:03.675 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:12:03.675 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:12:03.675 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:12:03.675 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:12:03.675 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:03.675 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:03.676 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:12:03.676 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:12:03.676 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:12:03.676 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:12:03.676 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:03.676 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:12:03.676 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:12:03.676 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:12:03.676 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:03.676 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:03.676 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:12:03.676 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:12:03.676 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:12:03.676 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:03.676 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:12:03.677 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:03.677 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:12:03.677 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:12:03.677 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:12:03.677 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:12:03.677 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:12:03.677 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:03.677 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:12:03.677 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:03.677 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:12:03.677 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:12:03.677 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:03.677 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:12:03.677 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:12:03.677 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:12:03.678 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:03.678 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:12:03.678 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:12:03.678 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:03.678 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:12:03.678 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:12:03.678 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:12:03.678 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:03.678 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:12:03.678 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:12:03.678 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:03.678 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:12:03.679 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:12:03.679 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:12:03.679 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:03.679 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:12:03.679 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:03.679 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:12:03.679 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:12:03.680 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:12:03.680 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-08-24T21:12:03.681 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:12:03.702 INFO:tasks.workunit.client.0.smithi179.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-08-24T21:12:03.811 INFO:tasks.workunit.client.0.smithi179.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-08-24T21:12:03.858 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:12:03.858 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:12:03.858 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:12:03.858 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:12:03.858 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 14, 2024-08-24T21:12:03.858 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 100241, 2024-08-24T21:12:03.858 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:12:03.858 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:12:03.859 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:12:03.859 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:12:03.859 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:12:03.859 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:12:03.859 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:12:03.859 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:12:03.859 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:12:03.859 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:12:03.859 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:12:03.859 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:12:03.859 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:12:03.859 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:12:03.859 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:12:03.860 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:12:03.860 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:12:03.860 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:12:03.860 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:12:03.860 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:12:03.860 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:12:03.860 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:12:03.860 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:12:03.860 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:12:03.860 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:12:03.860 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:12:03.860 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:12:03.860 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:12:03.860 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:12:03.861 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:12:03.861 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:12:03.861 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:12:03.861 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:12:03.861 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:12:03.861 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:03.861 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:12:03.861 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:12:03.861 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:12:03.861 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:12:03.861 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:12:03.861 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:12:03.861 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:12:03.861 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:12:03.862 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:12:03.862 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:12:03.862 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:12:03.862 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:12:03.862 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:12:03.862 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:12:03.862 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:12:03.862 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:12:03.862 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:12:03.863 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:12:03.863 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:12:03.863 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:12:03.863 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:12:03.863 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:12:03.863 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:12:03.863 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:12:03.863 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:12:03.863 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:12:03.863 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:12:03.863 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:12:03.863 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:12:03.863 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:12:03.864 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:03.864 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:12:03.864 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:03.864 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:12:03.864 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:12:03.864 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:12:03.864 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:12:03.864 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:03.864 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:12:03.864 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:12:03.864 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:12:03.864 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:03.864 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:03.865 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:12:03.865 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:12:03.865 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:12:03.865 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:03.865 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:12:03.865 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:03.865 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:12:03.865 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:12:03.865 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:12:03.865 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:12:03.865 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:12:03.865 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:03.865 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:03.865 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:12:03.866 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:12:03.866 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:12:03.866 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:12:03.866 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:03.866 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:12:03.866 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:12:03.866 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:12:03.866 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:03.866 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:03.866 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:12:03.867 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:12:03.867 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:12:03.867 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:03.867 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:12:03.867 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:03.867 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:12:03.867 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:12:03.867 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:12:03.867 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:12:03.867 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:12:03.867 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:03.867 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:03.867 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:12:03.868 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:12:03.868 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:12:03.868 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:12:03.868 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:03.868 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:12:03.868 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:12:03.868 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:12:03.868 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:03.868 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:03.868 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:12:03.868 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:12:03.868 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:12:03.868 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:03.868 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:12:03.868 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:03.869 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:12:03.869 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:12:03.869 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:12:03.869 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:12:03.869 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:12:03.869 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:03.869 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:12:03.869 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:03.869 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:12:03.869 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:12:03.869 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:03.869 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:12:03.869 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:12:03.870 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:12:03.870 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:03.870 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:12:03.870 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:12:03.870 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:03.870 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:12:03.870 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:12:03.870 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:12:03.870 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:03.870 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:12:03.870 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:12:03.870 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:03.870 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:12:03.871 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:12:03.871 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:12:03.871 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:03.871 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:12:03.871 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:12:03.871 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:03.871 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:12:03.871 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:12:03.871 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:12:03.871 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:03.871 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:12:03.871 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:03.871 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:12:03.872 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:12:03.874 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:12:03.874 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-08-24T21:12:03.876 INFO:tasks.workunit.client.0.smithi179.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-08-24T21:12:03.880 INFO:tasks.workunit.client.0.smithi179.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-08-24T21:12:03.880 INFO:tasks.workunit.client.0.smithi179.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-08-24T21:12:03.944 INFO:tasks.workunit.client.0.smithi179.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-08-24T21:12:03.951 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-08-24T21:12:03.951 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-08-24T21:12:03.986 INFO:tasks.workunit:Running workunits matching rbd/diff_continuous.sh on client.0... 2024-08-24T21:12:03.987 INFO:tasks.workunit:Running workunit rbd/diff_continuous.sh... 2024-08-24T21:12:03.987 DEBUG:teuthology.orchestra.run.smithi179:workunit test rbd/diff_continuous.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=797669399b32d2915e64eb6d4b1257ae3c50f80b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_DEVICE_TYPE=krbd adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/diff_continuous.sh 2024-08-24T21:12:04.072 INFO:tasks.workunit.client.0.smithi179.stderr:+ set -o pipefail 2024-08-24T21:12:04.072 INFO:tasks.workunit.client.0.smithi179.stderr:+ readonly DEVICE_TYPE=krbd 2024-08-24T21:12:04.072 INFO:tasks.workunit.client.0.smithi179.stderr:+ DEVICE_TYPE=krbd 2024-08-24T21:12:04.072 INFO:tasks.workunit.client.0.smithi179.stderr:++ uuidgen 2024-08-24T21:12:04.082 INFO:tasks.workunit.client.0.smithi179.stderr:+ BASE_UUID=ac6341a6-6d9d-4017-bb38-7eb07f2860fe 2024-08-24T21:12:04.082 INFO:tasks.workunit.client.0.smithi179.stderr:+ readonly BASE_UUID 2024-08-24T21:12:04.082 INFO:tasks.workunit.client.0.smithi179.stderr:+ readonly SIZE=2G 2024-08-24T21:12:04.082 INFO:tasks.workunit.client.0.smithi179.stderr:+ SIZE=2G 2024-08-24T21:12:04.082 INFO:tasks.workunit.client.0.smithi179.stderr:+ readonly SRC=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src 2024-08-24T21:12:04.082 INFO:tasks.workunit.client.0.smithi179.stderr:+ SRC=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src 2024-08-24T21:12:04.083 INFO:tasks.workunit.client.0.smithi179.stderr:+ readonly DST=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:12:04.083 INFO:tasks.workunit.client.0.smithi179.stderr:+ DST=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:12:04.083 INFO:tasks.workunit.client.0.smithi179.stderr:+ readonly MOUNT=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-mnt 2024-08-24T21:12:04.083 INFO:tasks.workunit.client.0.smithi179.stderr:+ MOUNT=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-mnt 2024-08-24T21:12:04.083 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd create -s 2G --stripe-unit 64K --stripe-count 8 --image-feature exclusive-lock,object-map,fast-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src 2024-08-24T21:12:04.178 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd create -s 2G --object-size 512K ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:12:04.248 INFO:tasks.workunit.client.0.smithi179.stderr:++ sudo rbd device map -t krbd ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src 2024-08-24T21:12:04.870 INFO:tasks.workunit.client.0.smithi179.stderr:+ dev=/dev/rbd0 2024-08-24T21:12:04.871 INFO:tasks.workunit.client.0.smithi179.stderr:+ sudo mkfs.ext4 /dev/rbd0 2024-08-24T21:12:04.909 INFO:tasks.workunit.client.0.smithi179.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-08-24T21:12:04.914 INFO:tasks.workunit.client.0.smithi179.stdout:Discarding device blocks: 0/524288 done 2024-08-24T21:12:04.914 INFO:tasks.workunit.client.0.smithi179.stdout:Creating filesystem with 524288 4k blocks and 131072 inodes 2024-08-24T21:12:04.914 INFO:tasks.workunit.client.0.smithi179.stdout:Filesystem UUID: 80af3e2e-87a6-4e6b-93a3-772cf4494882 2024-08-24T21:12:04.914 INFO:tasks.workunit.client.0.smithi179.stdout:Superblock backups stored on blocks: 2024-08-24T21:12:04.914 INFO:tasks.workunit.client.0.smithi179.stdout: 32768, 98304, 163840, 229376, 294912 2024-08-24T21:12:04.914 INFO:tasks.workunit.client.0.smithi179.stdout: 2024-08-24T21:12:04.914 INFO:tasks.workunit.client.0.smithi179.stdout:Allocating group tables: 0/16 done 2024-08-24T21:12:04.914 INFO:tasks.workunit.client.0.smithi179.stdout:Writing inode tables: 0/16 done 2024-08-24T21:12:04.915 INFO:tasks.workunit.client.0.smithi179.stdout:Creating journal (16384 blocks): done 2024-08-24T21:12:04.940 INFO:tasks.workunit.client.0.smithi179.stdout:Writing superblocks and filesystem accounting information: 0/16 done 2024-08-24T21:12:04.940 INFO:tasks.workunit.client.0.smithi179.stdout: 2024-08-24T21:12:04.943 INFO:tasks.workunit.client.0.smithi179.stderr:+ mkdir ac6341a6-6d9d-4017-bb38-7eb07f2860fe-mnt 2024-08-24T21:12:04.945 INFO:tasks.workunit.client.0.smithi179.stderr:+ sudo mount /dev/rbd0 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-mnt 2024-08-24T21:12:05.002 INFO:tasks.workunit.client.0.smithi179.stderr:++ whoami 2024-08-24T21:12:05.004 INFO:tasks.workunit.client.0.smithi179.stderr:+ sudo chown ubuntu ac6341a6-6d9d-4017-bb38-7eb07f2860fe-mnt 2024-08-24T21:12:05.027 INFO:tasks.workunit.client.0.smithi179.stderr:+ wget https://download.ceph.com/qa/linux-5.4.tar.gz 2024-08-24T21:12:05.059 INFO:tasks.workunit.client.0.smithi179.stderr:--2024-08-24 21:12:05-- https://download.ceph.com/qa/linux-5.4.tar.gz 2024-08-24T21:12:05.261 INFO:tasks.workunit.client.0.smithi179.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-08-24T21:12:05.282 INFO:tasks.workunit.client.0.smithi179.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:443... connected. 2024-08-24T21:12:05.413 INFO:tasks.workunit.client.0.smithi179.stderr:HTTP request sent, awaiting response... 200 OK 2024-08-24T21:12:05.413 INFO:tasks.workunit.client.0.smithi179.stderr:Length: 172616875 (165M) [application/octet-stream] 2024-08-24T21:12:05.413 INFO:tasks.workunit.client.0.smithi179.stderr:Saving to: ‘linux-5.4.tar.gz’ 2024-08-24T21:12:05.413 INFO:tasks.workunit.client.0.smithi179.stderr: 2024-08-24T21:12:05.434 INFO:tasks.workunit.client.0.smithi179.stderr: 0K .......... .......... .......... .......... .......... 0% 2.40M 69s 2024-08-24T21:12:05.456 INFO:tasks.workunit.client.0.smithi179.stderr: 50K .......... .......... .......... .......... .......... 0% 2.36M 69s 2024-08-24T21:12:05.456 INFO:tasks.workunit.client.0.smithi179.stderr: 100K .......... .......... .......... .......... .......... 0% 122M 47s 2024-08-24T21:12:05.479 INFO:tasks.workunit.client.0.smithi179.stderr: 150K .......... .......... .......... .......... .......... 0% 2.41M 52s 2024-08-24T21:12:05.479 INFO:tasks.workunit.client.0.smithi179.stderr: 200K .......... .......... .......... .......... .......... 0% 172M 42s 2024-08-24T21:12:05.479 INFO:tasks.workunit.client.0.smithi179.stderr: 250K .......... .......... .......... .......... .......... 0% 150M 35s 2024-08-24T21:12:05.479 INFO:tasks.workunit.client.0.smithi179.stderr: 300K .......... .......... .......... .......... .......... 0% 171M 30s 2024-08-24T21:12:05.479 INFO:tasks.workunit.client.0.smithi179.stderr: 350K .......... .......... .......... .......... .......... 0% 139M 26s 2024-08-24T21:12:05.503 INFO:tasks.workunit.client.0.smithi179.stderr: 400K .......... .......... .......... .......... .......... 0% 2.53M 31s 2024-08-24T21:12:05.503 INFO:tasks.workunit.client.0.smithi179.stderr: 450K .......... .......... .......... .......... .......... 0% 77.6M 28s 2024-08-24T21:12:05.503 INFO:tasks.workunit.client.0.smithi179.stderr: 500K .......... .......... .......... .......... .......... 0% 166M 25s 2024-08-24T21:12:05.503 INFO:tasks.workunit.client.0.smithi179.stderr: 550K .......... .......... .......... .......... .......... 0% 144M 23s 2024-08-24T21:12:05.503 INFO:tasks.workunit.client.0.smithi179.stderr: 600K .......... .......... .......... .......... .......... 0% 166M 22s 2024-08-24T21:12:05.504 INFO:tasks.workunit.client.0.smithi179.stderr: 650K .......... .......... .......... .......... .......... 0% 178M 20s 2024-08-24T21:12:05.504 INFO:tasks.workunit.client.0.smithi179.stderr: 700K .......... .......... .......... .......... .......... 0% 150M 19s 2024-08-24T21:12:05.504 INFO:tasks.workunit.client.0.smithi179.stderr: 750K .......... .......... .......... .......... .......... 0% 38.6M 18s 2024-08-24T21:12:05.525 INFO:tasks.workunit.client.0.smithi179.stderr: 800K .......... .......... .......... .......... .......... 0% 2.91M 20s 2024-08-24T21:12:05.525 INFO:tasks.workunit.client.0.smithi179.stderr: 850K .......... .......... .......... .......... .......... 0% 86.8M 19s 2024-08-24T21:12:05.526 INFO:tasks.workunit.client.0.smithi179.stderr: 900K .......... .......... .......... .......... .......... 0% 161M 18s 2024-08-24T21:12:05.526 INFO:tasks.workunit.client.0.smithi179.stderr: 950K .......... .......... .......... .......... .......... 0% 141M 17s 2024-08-24T21:12:05.526 INFO:tasks.workunit.client.0.smithi179.stderr: 1000K .......... .......... .......... .......... .......... 0% 157M 17s 2024-08-24T21:12:05.526 INFO:tasks.workunit.client.0.smithi179.stderr: 1050K .......... .......... .......... .......... .......... 0% 170M 16s 2024-08-24T21:12:05.526 INFO:tasks.workunit.client.0.smithi179.stderr: 1100K .......... .......... .......... .......... .......... 0% 148M 15s 2024-08-24T21:12:05.526 INFO:tasks.workunit.client.0.smithi179.stderr: 1150K .......... .......... .......... .......... .......... 0% 60.8M 15s 2024-08-24T21:12:05.526 INFO:tasks.workunit.client.0.smithi179.stderr: 1200K .......... .......... .......... .......... .......... 0% 37.4M 14s 2024-08-24T21:12:05.526 INFO:tasks.workunit.client.0.smithi179.stderr: 1250K .......... .......... .......... .......... .......... 0% 17.9M 14s 2024-08-24T21:12:05.526 INFO:tasks.workunit.client.0.smithi179.stderr: 1300K .......... .......... .......... .......... .......... 0% 23.0M 14s 2024-08-24T21:12:05.547 INFO:tasks.workunit.client.0.smithi179.stderr: 1350K .......... .......... .......... .......... .......... 0% 4.16M 15s 2024-08-24T21:12:05.547 INFO:tasks.workunit.client.0.smithi179.stderr: 1400K .......... .......... .......... .......... .......... 0% 137M 14s 2024-08-24T21:12:05.547 INFO:tasks.workunit.client.0.smithi179.stderr: 1450K .......... .......... .......... .......... .......... 0% 147M 14s 2024-08-24T21:12:05.547 INFO:tasks.workunit.client.0.smithi179.stderr: 1500K .......... .......... .......... .......... .......... 0% 157M 13s 2024-08-24T21:12:05.547 INFO:tasks.workunit.client.0.smithi179.stderr: 1550K .......... .......... .......... .......... .......... 0% 138M 13s 2024-08-24T21:12:05.547 INFO:tasks.workunit.client.0.smithi179.stderr: 1600K .......... .......... .......... .......... .......... 0% 161M 13s 2024-08-24T21:12:05.547 INFO:tasks.workunit.client.0.smithi179.stderr: 1650K .......... .......... .......... .......... .......... 1% 152M 12s 2024-08-24T21:12:05.547 INFO:tasks.workunit.client.0.smithi179.stderr: 1700K .......... .......... .......... .......... .......... 1% 84.0M 12s 2024-08-24T21:12:05.547 INFO:tasks.workunit.client.0.smithi179.stderr: 1750K .......... .......... .......... .......... .......... 1% 22.0M 12s 2024-08-24T21:12:05.547 INFO:tasks.workunit.client.0.smithi179.stderr: 1800K .......... .......... .......... .......... .......... 1% 26.6M 12s 2024-08-24T21:12:05.547 INFO:tasks.workunit.client.0.smithi179.stderr: 1850K .......... .......... .......... .......... .......... 1% 21.3M 12s 2024-08-24T21:12:05.563 INFO:tasks.workunit.client.0.smithi179.stderr: 1900K .......... .......... .......... .......... .......... 1% 4.25M 12s 2024-08-24T21:12:05.563 INFO:tasks.workunit.client.0.smithi179.stderr: 1950K .......... .......... .......... .......... .......... 1% 146M 12s 2024-08-24T21:12:05.563 INFO:tasks.workunit.client.0.smithi179.stderr: 2000K .......... .......... .......... .......... .......... 1% 116M 12s 2024-08-24T21:12:05.563 INFO:tasks.workunit.client.0.smithi179.stderr: 2050K .......... .......... .......... .......... .......... 1% 170M 11s 2024-08-24T21:12:05.563 INFO:tasks.workunit.client.0.smithi179.stderr: 2100K .......... .......... .......... .......... .......... 1% 176M 11s 2024-08-24T21:12:05.563 INFO:tasks.workunit.client.0.smithi179.stderr: 2150K .......... .......... .......... .......... .......... 1% 77.1M 11s 2024-08-24T21:12:05.563 INFO:tasks.workunit.client.0.smithi179.stderr: 2200K .......... .......... .......... .......... .......... 1% 43.8M 11s 2024-08-24T21:12:05.564 INFO:tasks.workunit.client.0.smithi179.stderr: 2250K .......... .......... .......... .......... .......... 1% 28.8M 11s 2024-08-24T21:12:05.564 INFO:tasks.workunit.client.0.smithi179.stderr: 2300K .......... .......... .......... .......... .......... 1% 25.1M 11s 2024-08-24T21:12:05.567 INFO:tasks.workunit.client.0.smithi179.stderr: 2350K .......... .......... .......... .......... .......... 1% 14.4M 11s 2024-08-24T21:12:05.569 INFO:tasks.workunit.client.0.smithi179.stderr: 2400K .......... .......... .......... .......... .......... 1% 23.0M 11s 2024-08-24T21:12:05.570 INFO:tasks.workunit.client.0.smithi179.stderr: 2450K .......... .......... .......... .......... .......... 1% 49.7M 10s 2024-08-24T21:12:05.585 INFO:tasks.workunit.client.0.smithi179.stderr: 2500K .......... .......... .......... .......... .......... 1% 6.41M 11s 2024-08-24T21:12:05.586 INFO:tasks.workunit.client.0.smithi179.stderr: 2550K .......... .......... .......... .......... .......... 1% 150M 11s 2024-08-24T21:12:05.586 INFO:tasks.workunit.client.0.smithi179.stderr: 2600K .......... .......... .......... .......... .......... 1% 179M 10s 2024-08-24T21:12:05.586 INFO:tasks.workunit.client.0.smithi179.stderr: 2650K .......... .......... .......... .......... .......... 1% 157M 10s 2024-08-24T21:12:05.586 INFO:tasks.workunit.client.0.smithi179.stderr: 2700K .......... .......... .......... .......... .......... 1% 156M 10s 2024-08-24T21:12:05.586 INFO:tasks.workunit.client.0.smithi179.stderr: 2750K .......... .......... .......... .......... .......... 1% 30.3M 10s 2024-08-24T21:12:05.586 INFO:tasks.workunit.client.0.smithi179.stderr: 2800K .......... .......... .......... .......... .......... 1% 22.7M 10s 2024-08-24T21:12:05.586 INFO:tasks.workunit.client.0.smithi179.stderr: 2850K .......... .......... .......... .......... .......... 1% 40.3M 10s 2024-08-24T21:12:05.586 INFO:tasks.workunit.client.0.smithi179.stderr: 2900K .......... .......... .......... .......... .......... 1% 24.0M 10s 2024-08-24T21:12:05.587 INFO:tasks.workunit.client.0.smithi179.stderr: 2950K .......... .......... .......... .......... .......... 1% 28.7M 10s 2024-08-24T21:12:05.589 INFO:tasks.workunit.client.0.smithi179.stderr: 3000K .......... .......... .......... .......... .......... 1% 23.5M 10s 2024-08-24T21:12:05.590 INFO:tasks.workunit.client.0.smithi179.stderr: 3050K .......... .......... .......... .......... .......... 1% 36.4M 9s 2024-08-24T21:12:05.605 INFO:tasks.workunit.client.0.smithi179.stderr: 3100K .......... .......... .......... .......... .......... 1% 6.72M 10s 2024-08-24T21:12:05.605 INFO:tasks.workunit.client.0.smithi179.stderr: 3150K .......... .......... .......... .......... .......... 1% 140M 10s 2024-08-24T21:12:05.605 INFO:tasks.workunit.client.0.smithi179.stderr: 3200K .......... .......... .......... .......... .......... 1% 154M 9s 2024-08-24T21:12:05.605 INFO:tasks.workunit.client.0.smithi179.stderr: 3250K .......... .......... .......... .......... .......... 1% 174M 9s 2024-08-24T21:12:05.605 INFO:tasks.workunit.client.0.smithi179.stderr: 3300K .......... .......... .......... .......... .......... 1% 151M 9s 2024-08-24T21:12:05.605 INFO:tasks.workunit.client.0.smithi179.stderr: 3350K .......... .......... .......... .......... .......... 2% 40.4M 9s 2024-08-24T21:12:05.605 INFO:tasks.workunit.client.0.smithi179.stderr: 3400K .......... .......... .......... .......... .......... 2% 24.0M 9s 2024-08-24T21:12:05.605 INFO:tasks.workunit.client.0.smithi179.stderr: 3450K .......... .......... .......... .......... .......... 2% 45.6M 9s 2024-08-24T21:12:05.607 INFO:tasks.workunit.client.0.smithi179.stderr: 3500K .......... .......... .......... .......... .......... 2% 22.5M 9s 2024-08-24T21:12:05.608 INFO:tasks.workunit.client.0.smithi179.stderr: 3550K .......... .......... .......... .......... .......... 2% 23.7M 9s 2024-08-24T21:12:05.609 INFO:tasks.workunit.client.0.smithi179.stderr: 3600K .......... .......... .......... .......... .......... 2% 35.4M 9s 2024-08-24T21:12:05.612 INFO:tasks.workunit.client.0.smithi179.stderr: 3650K .......... .......... .......... .......... .......... 2% 24.1M 9s 2024-08-24T21:12:05.626 INFO:tasks.workunit.client.0.smithi179.stderr: 3700K .......... .......... .......... .......... .......... 2% 6.89M 9s 2024-08-24T21:12:05.626 INFO:tasks.workunit.client.0.smithi179.stderr: 3750K .......... .......... .......... .......... .......... 2% 145M 9s 2024-08-24T21:12:05.626 INFO:tasks.workunit.client.0.smithi179.stderr: 3800K .......... .......... .......... .......... .......... 2% 173M 9s 2024-08-24T21:12:05.626 INFO:tasks.workunit.client.0.smithi179.stderr: 3850K .......... .......... .......... .......... .......... 2% 149M 9s 2024-08-24T21:12:05.626 INFO:tasks.workunit.client.0.smithi179.stderr: 3900K .......... .......... .......... .......... .......... 2% 163M 9s 2024-08-24T21:12:05.626 INFO:tasks.workunit.client.0.smithi179.stderr: 3950K .......... .......... .......... .......... .......... 2% 23.0M 9s 2024-08-24T21:12:05.626 INFO:tasks.workunit.client.0.smithi179.stderr: 4000K .......... .......... .......... .......... .......... 2% 60.4M 9s 2024-08-24T21:12:05.626 INFO:tasks.workunit.client.0.smithi179.stderr: 4050K .......... .......... .......... .......... .......... 2% 22.9M 8s 2024-08-24T21:12:05.626 INFO:tasks.workunit.client.0.smithi179.stderr: 4100K .......... .......... .......... .......... .......... 2% 34.7M 8s 2024-08-24T21:12:05.628 INFO:tasks.workunit.client.0.smithi179.stderr: 4150K .......... .......... .......... .......... .......... 2% 23.7M 8s 2024-08-24T21:12:05.630 INFO:tasks.workunit.client.0.smithi179.stderr: 4200K .......... .......... .......... .......... .......... 2% 21.4M 8s 2024-08-24T21:12:05.634 INFO:tasks.workunit.client.0.smithi179.stderr: 4250K .......... .......... .......... .......... .......... 2% 13.2M 8s 2024-08-24T21:12:05.636 INFO:tasks.workunit.client.0.smithi179.stderr: 4300K .......... .......... .......... .......... .......... 2% 29.9M 8s 2024-08-24T21:12:05.639 INFO:tasks.workunit.client.0.smithi179.stderr: 4350K .......... .......... .......... .......... .......... 2% 14.9M 8s 2024-08-24T21:12:05.642 INFO:tasks.workunit.client.0.smithi179.stderr: 4400K .......... .......... .......... .......... .......... 2% 19.6M 8s 2024-08-24T21:12:05.643 INFO:tasks.workunit.client.0.smithi179.stderr: 4450K .......... .......... .......... .......... .......... 2% 27.7M 8s 2024-08-24T21:12:05.644 INFO:tasks.workunit.client.0.smithi179.stderr: 4500K .......... .......... .......... .......... .......... 2% 40.4M 8s 2024-08-24T21:12:05.646 INFO:tasks.workunit.client.0.smithi179.stderr: 4550K .......... .......... .......... .......... .......... 2% 24.2M 8s 2024-08-24T21:12:05.647 INFO:tasks.workunit.client.0.smithi179.stderr: 4600K .......... .......... .......... .......... .......... 2% 44.9M 8s 2024-08-24T21:12:05.649 INFO:tasks.workunit.client.0.smithi179.stderr: 4650K .......... .......... .......... .......... .......... 2% 25.1M 8s 2024-08-24T21:12:05.650 INFO:tasks.workunit.client.0.smithi179.stderr: 4700K .......... .......... .......... .......... .......... 2% 42.4M 8s 2024-08-24T21:12:05.654 INFO:tasks.workunit.client.0.smithi179.stderr: 4750K .......... .......... .......... .......... .......... 2% 14.6M 8s 2024-08-24T21:12:05.655 INFO:tasks.workunit.client.0.smithi179.stderr: 4800K .......... .......... .......... .......... .......... 2% 73.2M 8s 2024-08-24T21:12:05.656 INFO:tasks.workunit.client.0.smithi179.stderr: 4850K .......... .......... .......... .......... .......... 2% 33.5M 8s 2024-08-24T21:12:05.659 INFO:tasks.workunit.client.0.smithi179.stderr: 4900K .......... .......... .......... .......... .......... 2% 24.7M 8s 2024-08-24T21:12:05.660 INFO:tasks.workunit.client.0.smithi179.stderr: 4950K .......... .......... .......... .......... .......... 2% 20.8M 8s 2024-08-24T21:12:05.661 INFO:tasks.workunit.client.0.smithi179.stderr: 5000K .......... .......... .......... .......... .......... 2% 53.2M 8s 2024-08-24T21:12:05.663 INFO:tasks.workunit.client.0.smithi179.stderr: 5050K .......... .......... .......... .......... .......... 3% 25.5M 8s 2024-08-24T21:12:05.664 INFO:tasks.workunit.client.0.smithi179.stderr: 5100K .......... .......... .......... .......... .......... 3% 39.3M 8s 2024-08-24T21:12:05.666 INFO:tasks.workunit.client.0.smithi179.stderr: 5150K .......... .......... .......... .......... .......... 3% 25.6M 8s 2024-08-24T21:12:05.670 INFO:tasks.workunit.client.0.smithi179.stderr: 5200K .......... .......... .......... .......... .......... 3% 21.4M 8s 2024-08-24T21:12:05.670 INFO:tasks.workunit.client.0.smithi179.stderr: 5250K .......... .......... .......... .......... .......... 3% 47.5M 8s 2024-08-24T21:12:05.671 INFO:tasks.workunit.client.0.smithi179.stderr: 5300K .......... .......... .......... .......... .......... 3% 24.1M 8s 2024-08-24T21:12:05.673 INFO:tasks.workunit.client.0.smithi179.stderr: 5350K .......... .......... .......... .......... .......... 3% 33.5M 8s 2024-08-24T21:12:05.676 INFO:tasks.workunit.client.0.smithi179.stderr: 5400K .......... .......... .......... .......... .......... 3% 23.2M 8s 2024-08-24T21:12:05.677 INFO:tasks.workunit.client.0.smithi179.stderr: 5450K .......... .......... .......... .......... .......... 3% 27.3M 8s 2024-08-24T21:12:05.678 INFO:tasks.workunit.client.0.smithi179.stderr: 5500K .......... .......... .......... .......... .......... 3% 44.3M 8s 2024-08-24T21:12:05.680 INFO:tasks.workunit.client.0.smithi179.stderr: 5550K .......... .......... .......... .......... .......... 3% 23.2M 8s 2024-08-24T21:12:05.682 INFO:tasks.workunit.client.0.smithi179.stderr: 5600K .......... .......... .......... .......... .......... 3% 28.1M 8s 2024-08-24T21:12:05.684 INFO:tasks.workunit.client.0.smithi179.stderr: 5650K .......... .......... .......... .......... .......... 3% 27.8M 8s 2024-08-24T21:12:05.686 INFO:tasks.workunit.client.0.smithi179.stderr: 5700K .......... .......... .......... .......... .......... 3% 26.5M 8s 2024-08-24T21:12:05.687 INFO:tasks.workunit.client.0.smithi179.stderr: 5750K .......... .......... .......... .......... .......... 3% 35.5M 8s 2024-08-24T21:12:05.689 INFO:tasks.workunit.client.0.smithi179.stderr: 5800K .......... .......... .......... .......... .......... 3% 27.0M 8s 2024-08-24T21:12:05.690 INFO:tasks.workunit.client.0.smithi179.stderr: 5850K .......... .......... .......... .......... .......... 3% 39.0M 8s 2024-08-24T21:12:05.692 INFO:tasks.workunit.client.0.smithi179.stderr: 5900K .......... .......... .......... .......... .......... 3% 24.2M 8s 2024-08-24T21:12:05.695 INFO:tasks.workunit.client.0.smithi179.stderr: 5950K .......... .......... .......... .......... .......... 3% 20.0M 8s 2024-08-24T21:12:05.696 INFO:tasks.workunit.client.0.smithi179.stderr: 6000K .......... .......... .......... .......... .......... 3% 28.9M 8s 2024-08-24T21:12:05.697 INFO:tasks.workunit.client.0.smithi179.stderr: 6050K .......... .......... .......... .......... .......... 3% 44.7M 8s 2024-08-24T21:12:05.699 INFO:tasks.workunit.client.0.smithi179.stderr: 6100K .......... .......... .......... .......... .......... 3% 24.4M 8s 2024-08-24T21:12:05.700 INFO:tasks.workunit.client.0.smithi179.stderr: 6150K .......... .......... .......... .......... .......... 3% 38.8M 8s 2024-08-24T21:12:05.703 INFO:tasks.workunit.client.0.smithi179.stderr: 6200K .......... .......... .......... .......... .......... 3% 23.6M 8s 2024-08-24T21:12:05.704 INFO:tasks.workunit.client.0.smithi179.stderr: 6250K .......... .......... .......... .......... .......... 3% 43.4M 7s 2024-08-24T21:12:05.706 INFO:tasks.workunit.client.0.smithi179.stderr: 6300K .......... .......... .......... .......... .......... 3% 23.6M 7s 2024-08-24T21:12:05.708 INFO:tasks.workunit.client.0.smithi179.stderr: 6350K .......... .......... .......... .......... .......... 3% 25.3M 7s 2024-08-24T21:12:05.709 INFO:tasks.workunit.client.0.smithi179.stderr: 6400K .......... .......... .......... .......... .......... 3% 39.7M 7s 2024-08-24T21:12:05.711 INFO:tasks.workunit.client.0.smithi179.stderr: 6450K .......... .......... .......... .......... .......... 3% 24.4M 7s 2024-08-24T21:12:05.713 INFO:tasks.workunit.client.0.smithi179.stderr: 6500K .......... .......... .......... .......... .......... 3% 25.0M 7s 2024-08-24T21:12:05.714 INFO:tasks.workunit.client.0.smithi179.stderr: 6550K .......... .......... .......... .......... .......... 3% 46.5M 7s 2024-08-24T21:12:05.716 INFO:tasks.workunit.client.0.smithi179.stderr: 6600K .......... .......... .......... .......... .......... 3% 33.0M 7s 2024-08-24T21:12:05.717 INFO:tasks.workunit.client.0.smithi179.stderr: 6650K .......... .......... .......... .......... .......... 3% 26.4M 7s 2024-08-24T21:12:05.719 INFO:tasks.workunit.client.0.smithi179.stderr: 6700K .......... .......... .......... .......... .......... 4% 24.3M 7s 2024-08-24T21:12:05.723 INFO:tasks.workunit.client.0.smithi179.stderr: 6750K .......... .......... .......... .......... .......... 4% 26.9M 7s 2024-08-24T21:12:05.723 INFO:tasks.workunit.client.0.smithi179.stderr: 6800K .......... .......... .......... .......... .......... 4% 30.0M 7s 2024-08-24T21:12:05.725 INFO:tasks.workunit.client.0.smithi179.stderr: 6850K .......... .......... .......... .......... .......... 4% 23.9M 7s 2024-08-24T21:12:05.727 INFO:tasks.workunit.client.0.smithi179.stderr: 6900K .......... .......... .......... .......... .......... 4% 32.0M 7s 2024-08-24T21:12:05.729 INFO:tasks.workunit.client.0.smithi179.stderr: 6950K .......... .......... .......... .......... .......... 4% 19.9M 7s 2024-08-24T21:12:05.730 INFO:tasks.workunit.client.0.smithi179.stderr: 7000K .......... .......... .......... .......... .......... 4% 56.0M 7s 2024-08-24T21:12:05.731 INFO:tasks.workunit.client.0.smithi179.stderr: 7050K .......... .......... .......... .......... .......... 4% 25.1M 7s 2024-08-24T21:12:05.734 INFO:tasks.workunit.client.0.smithi179.stderr: 7100K .......... .......... .......... .......... .......... 4% 27.4M 7s 2024-08-24T21:12:05.735 INFO:tasks.workunit.client.0.smithi179.stderr: 7150K .......... .......... .......... .......... .......... 4% 28.5M 7s 2024-08-24T21:12:05.737 INFO:tasks.workunit.client.0.smithi179.stderr: 7200K .......... .......... .......... .......... .......... 4% 23.7M 7s 2024-08-24T21:12:05.739 INFO:tasks.workunit.client.0.smithi179.stderr: 7250K .......... .......... .......... .......... .......... 4% 26.0M 7s 2024-08-24T21:12:05.740 INFO:tasks.workunit.client.0.smithi179.stderr: 7300K .......... .......... .......... .......... .......... 4% 48.5M 7s 2024-08-24T21:12:05.742 INFO:tasks.workunit.client.0.smithi179.stderr: 7350K .......... .......... .......... .......... .......... 4% 24.9M 7s 2024-08-24T21:12:05.743 INFO:tasks.workunit.client.0.smithi179.stderr: 7400K .......... .......... .......... .......... .......... 4% 36.8M 7s 2024-08-24T21:12:05.745 INFO:tasks.workunit.client.0.smithi179.stderr: 7450K .......... .......... .......... .......... .......... 4% 26.2M 7s 2024-08-24T21:12:05.747 INFO:tasks.workunit.client.0.smithi179.stderr: 7500K .......... .......... .......... .......... .......... 4% 36.0M 7s 2024-08-24T21:12:05.749 INFO:tasks.workunit.client.0.smithi179.stderr: 7550K .......... .......... .......... .......... .......... 4% 26.0M 7s 2024-08-24T21:12:05.750 INFO:tasks.workunit.client.0.smithi179.stderr: 7600K .......... .......... .......... .......... .......... 4% 27.9M 7s 2024-08-24T21:12:05.753 INFO:tasks.workunit.client.0.smithi179.stderr: 7650K .......... .......... .......... .......... .......... 4% 23.1M 7s 2024-08-24T21:12:05.755 INFO:tasks.workunit.client.0.smithi179.stderr: 7700K .......... .......... .......... .......... .......... 4% 25.5M 7s 2024-08-24T21:12:05.756 INFO:tasks.workunit.client.0.smithi179.stderr: 7750K .......... .......... .......... .......... .......... 4% 27.4M 7s 2024-08-24T21:12:05.757 INFO:tasks.workunit.client.0.smithi179.stderr: 7800K .......... .......... .......... .......... .......... 4% 50.2M 7s 2024-08-24T21:12:05.759 INFO:tasks.workunit.client.0.smithi179.stderr: 7850K .......... .......... .......... .......... .......... 4% 23.4M 7s 2024-08-24T21:12:05.761 INFO:tasks.workunit.client.0.smithi179.stderr: 7900K .......... .......... .......... .......... .......... 4% 38.5M 7s 2024-08-24T21:12:05.762 INFO:tasks.workunit.client.0.smithi179.stderr: 7950K .......... .......... .......... .......... .......... 4% 23.9M 7s 2024-08-24T21:12:05.764 INFO:tasks.workunit.client.0.smithi179.stderr: 8000K .......... .......... .......... .......... .......... 4% 24.3M 7s 2024-08-24T21:12:05.765 INFO:tasks.workunit.client.0.smithi179.stderr: 8050K .......... .......... .......... .......... .......... 4% 51.5M 7s 2024-08-24T21:12:05.767 INFO:tasks.workunit.client.0.smithi179.stderr: 8100K .......... .......... .......... .......... .......... 4% 24.0M 7s 2024-08-24T21:12:05.768 INFO:tasks.workunit.client.0.smithi179.stderr: 8150K .......... .......... .......... .......... .......... 4% 40.2M 7s 2024-08-24T21:12:05.771 INFO:tasks.workunit.client.0.smithi179.stderr: 8200K .......... .......... .......... .......... .......... 4% 22.4M 7s 2024-08-24T21:12:05.773 INFO:tasks.workunit.client.0.smithi179.stderr: 8250K .......... .......... .......... .......... .......... 4% 24.8M 7s 2024-08-24T21:12:05.774 INFO:tasks.workunit.client.0.smithi179.stderr: 8300K .......... .......... .......... .......... .......... 4% 39.8M 7s 2024-08-24T21:12:05.777 INFO:tasks.workunit.client.0.smithi179.stderr: 8350K .......... .......... .......... .......... .......... 4% 15.3M 7s 2024-08-24T21:12:05.780 INFO:tasks.workunit.client.0.smithi179.stderr: 8400K .......... .......... .......... .......... .......... 5% 17.6M 7s 2024-08-24T21:12:05.781 INFO:tasks.workunit.client.0.smithi179.stderr: 8450K .......... .......... .......... .......... .......... 5% 36.8M 7s 2024-08-24T21:12:05.783 INFO:tasks.workunit.client.0.smithi179.stderr: 8500K .......... .......... .......... .......... .......... 5% 26.3M 7s 2024-08-24T21:12:05.784 INFO:tasks.workunit.client.0.smithi179.stderr: 8550K .......... .......... .......... .......... .......... 5% 37.4M 7s 2024-08-24T21:12:05.786 INFO:tasks.workunit.client.0.smithi179.stderr: 8600K .......... .......... .......... .......... .......... 5% 26.8M 7s 2024-08-24T21:12:05.789 INFO:tasks.workunit.client.0.smithi179.stderr: 8650K .......... .......... .......... .......... .......... 5% 22.9M 7s 2024-08-24T21:12:05.791 INFO:tasks.workunit.client.0.smithi179.stderr: 8700K .......... .......... .......... .......... .......... 5% 22.1M 7s 2024-08-24T21:12:05.793 INFO:tasks.workunit.client.0.smithi179.stderr: 8750K .......... .......... .......... .......... .......... 5% 26.0M 7s 2024-08-24T21:12:05.795 INFO:tasks.workunit.client.0.smithi179.stderr: 8800K .......... .......... .......... .......... .......... 5% 20.6M 7s 2024-08-24T21:12:05.795 INFO:tasks.workunit.client.0.smithi179.stderr: 8850K .......... .......... .......... .......... .......... 5% 73.5M 7s 2024-08-24T21:12:05.798 INFO:tasks.workunit.client.0.smithi179.stderr: 8900K .......... .......... .......... .......... .......... 5% 25.5M 7s 2024-08-24T21:12:05.800 INFO:tasks.workunit.client.0.smithi179.stderr: 8950K .......... .......... .......... .......... .......... 5% 22.6M 7s 2024-08-24T21:12:05.801 INFO:tasks.workunit.client.0.smithi179.stderr: 9000K .......... .......... .......... .......... .......... 5% 35.0M 7s 2024-08-24T21:12:05.802 INFO:tasks.workunit.client.0.smithi179.stderr: 9050K .......... .......... .......... .......... .......... 5% 36.2M 7s 2024-08-24T21:12:05.804 INFO:tasks.workunit.client.0.smithi179.stderr: 9100K .......... .......... .......... .......... .......... 5% 24.3M 7s 2024-08-24T21:12:05.807 INFO:tasks.workunit.client.0.smithi179.stderr: 9150K .......... .......... .......... .......... .......... 5% 21.6M 7s 2024-08-24T21:12:05.808 INFO:tasks.workunit.client.0.smithi179.stderr: 9200K .......... .......... .......... .......... .......... 5% 42.2M 7s 2024-08-24T21:12:05.811 INFO:tasks.workunit.client.0.smithi179.stderr: 9250K .......... .......... .......... .......... .......... 5% 12.8M 7s 2024-08-24T21:12:05.814 INFO:tasks.workunit.client.0.smithi179.stderr: 9300K .......... .......... .......... .......... .......... 5% 19.0M 7s 2024-08-24T21:12:05.815 INFO:tasks.workunit.client.0.smithi179.stderr: 9350K .......... .......... .......... .......... .......... 5% 41.8M 7s 2024-08-24T21:12:05.817 INFO:tasks.workunit.client.0.smithi179.stderr: 9400K .......... .......... .......... .......... .......... 5% 30.6M 7s 2024-08-24T21:12:05.818 INFO:tasks.workunit.client.0.smithi179.stderr: 9450K .......... .......... .......... .......... .......... 5% 27.8M 7s 2024-08-24T21:12:05.820 INFO:tasks.workunit.client.0.smithi179.stderr: 9500K .......... .......... .......... .......... .......... 5% 24.8M 7s 2024-08-24T21:12:05.823 INFO:tasks.workunit.client.0.smithi179.stderr: 9550K .......... .......... .......... .......... .......... 5% 16.6M 7s 2024-08-24T21:12:05.826 INFO:tasks.workunit.client.0.smithi179.stderr: 9600K .......... .......... .......... .......... .......... 5% 18.3M 7s 2024-08-24T21:12:05.829 INFO:tasks.workunit.client.0.smithi179.stderr: 9650K .......... .......... .......... .......... .......... 5% 14.5M 7s 2024-08-24T21:12:05.831 INFO:tasks.workunit.client.0.smithi179.stderr: 9700K .......... .......... .......... .......... .......... 5% 31.3M 7s 2024-08-24T21:12:05.834 INFO:tasks.workunit.client.0.smithi179.stderr: 9750K .......... .......... .......... .......... .......... 5% 18.8M 7s 2024-08-24T21:12:05.836 INFO:tasks.workunit.client.0.smithi179.stderr: 9800K .......... .......... .......... .......... .......... 5% 22.8M 7s 2024-08-24T21:12:05.838 INFO:tasks.workunit.client.0.smithi179.stderr: 9850K .......... .......... .......... .......... .......... 5% 16.7M 7s 2024-08-24T21:12:05.840 INFO:tasks.workunit.client.0.smithi179.stderr: 9900K .......... .......... .......... .......... .......... 5% 45.0M 7s 2024-08-24T21:12:05.843 INFO:tasks.workunit.client.0.smithi179.stderr: 9950K .......... .......... .......... .......... .......... 5% 17.0M 7s 2024-08-24T21:12:05.844 INFO:tasks.workunit.client.0.smithi179.stderr: 10000K .......... .......... .......... .......... .......... 5% 51.6M 7s 2024-08-24T21:12:05.847 INFO:tasks.workunit.client.0.smithi179.stderr: 10050K .......... .......... .......... .......... .......... 5% 20.9M 7s 2024-08-24T21:12:05.847 INFO:tasks.workunit.client.0.smithi179.stderr: 10100K .......... .......... .......... .......... .......... 6% 49.4M 7s 2024-08-24T21:12:05.849 INFO:tasks.workunit.client.0.smithi179.stderr: 10150K .......... .......... .......... .......... .......... 6% 26.0M 7s 2024-08-24T21:12:05.851 INFO:tasks.workunit.client.0.smithi179.stderr: 10200K .......... .......... .......... .......... .......... 6% 31.0M 7s 2024-08-24T21:12:05.852 INFO:tasks.workunit.client.0.smithi179.stderr: 10250K .......... .......... .......... .......... .......... 6% 27.0M 7s 2024-08-24T21:12:05.853 INFO:tasks.workunit.client.0.smithi179.stderr: 10300K .......... .......... .......... .......... .......... 6% 41.6M 7s 2024-08-24T21:12:05.855 INFO:tasks.workunit.client.0.smithi179.stderr: 10350K .......... .......... .......... .......... .......... 6% 25.3M 7s 2024-08-24T21:12:05.857 INFO:tasks.workunit.client.0.smithi179.stderr: 10400K .......... .......... .......... .......... .......... 6% 23.3M 7s 2024-08-24T21:12:05.859 INFO:tasks.workunit.client.0.smithi179.stderr: 10450K .......... .......... .......... .......... .......... 6% 38.2M 7s 2024-08-24T21:12:05.861 INFO:tasks.workunit.client.0.smithi179.stderr: 10500K .......... .......... .......... .......... .......... 6% 23.1M 7s 2024-08-24T21:12:05.862 INFO:tasks.workunit.client.0.smithi179.stderr: 10550K .......... .......... .......... .......... .......... 6% 39.7M 7s 2024-08-24T21:12:05.864 INFO:tasks.workunit.client.0.smithi179.stderr: 10600K .......... .......... .......... .......... .......... 6% 28.3M 7s 2024-08-24T21:12:05.866 INFO:tasks.workunit.client.0.smithi179.stderr: 10650K .......... .......... .......... .......... .......... 6% 23.0M 7s 2024-08-24T21:12:05.867 INFO:tasks.workunit.client.0.smithi179.stderr: 10700K .......... .......... .......... .......... .......... 6% 43.9M 7s 2024-08-24T21:12:05.870 INFO:tasks.workunit.client.0.smithi179.stderr: 10750K .......... .......... .......... .......... .......... 6% 21.4M 7s 2024-08-24T21:12:05.871 INFO:tasks.workunit.client.0.smithi179.stderr: 10800K .......... .......... .......... .......... .......... 6% 26.8M 7s 2024-08-24T21:12:05.872 INFO:tasks.workunit.client.0.smithi179.stderr: 10850K .......... .......... .......... .......... .......... 6% 46.1M 7s 2024-08-24T21:12:05.874 INFO:tasks.workunit.client.0.smithi179.stderr: 10900K .......... .......... .......... .......... .......... 6% 24.4M 7s 2024-08-24T21:12:05.876 INFO:tasks.workunit.client.0.smithi179.stderr: 10950K .......... .......... .......... .......... .......... 6% 24.0M 7s 2024-08-24T21:12:05.877 INFO:tasks.workunit.client.0.smithi179.stderr: 11000K .......... .......... .......... .......... .......... 6% 46.9M 7s 2024-08-24T21:12:05.879 INFO:tasks.workunit.client.0.smithi179.stderr: 11050K .......... .......... .......... .......... .......... 6% 21.0M 7s 2024-08-24T21:12:05.881 INFO:tasks.workunit.client.0.smithi179.stderr: 11100K .......... .......... .......... .......... .......... 6% 56.4M 7s 2024-08-24T21:12:05.882 INFO:tasks.workunit.client.0.smithi179.stderr: 11150K .......... .......... .......... .......... .......... 6% 22.6M 7s 2024-08-24T21:12:05.885 INFO:tasks.workunit.client.0.smithi179.stderr: 11200K .......... .......... .......... .......... .......... 6% 25.3M 7s 2024-08-24T21:12:05.886 INFO:tasks.workunit.client.0.smithi179.stderr: 11250K .......... .......... .......... .......... .......... 6% 35.0M 7s 2024-08-24T21:12:05.888 INFO:tasks.workunit.client.0.smithi179.stderr: 11300K .......... .......... .......... .......... .......... 6% 23.0M 7s 2024-08-24T21:12:05.890 INFO:tasks.workunit.client.0.smithi179.stderr: 11350K .......... .......... .......... .......... .......... 6% 35.5M 7s 2024-08-24T21:12:05.891 INFO:tasks.workunit.client.0.smithi179.stderr: 11400K .......... .......... .......... .......... .......... 6% 29.4M 7s 2024-08-24T21:12:05.893 INFO:tasks.workunit.client.0.smithi179.stderr: 11450K .......... .......... .......... .......... .......... 6% 39.3M 7s 2024-08-24T21:12:05.894 INFO:tasks.workunit.client.0.smithi179.stderr: 11500K .......... .......... .......... .......... .......... 6% 24.1M 7s 2024-08-24T21:12:05.896 INFO:tasks.workunit.client.0.smithi179.stderr: 11550K .......... .......... .......... .......... .......... 6% 24.7M 7s 2024-08-24T21:12:05.898 INFO:tasks.workunit.client.0.smithi179.stderr: 11600K .......... .......... .......... .......... .......... 6% 25.8M 7s 2024-08-24T21:12:05.899 INFO:tasks.workunit.client.0.smithi179.stderr: 11650K .......... .......... .......... .......... .......... 6% 41.9M 7s 2024-08-24T21:12:05.902 INFO:tasks.workunit.client.0.smithi179.stderr: 11700K .......... .......... .......... .......... .......... 6% 19.5M 7s 2024-08-24T21:12:05.903 INFO:tasks.workunit.client.0.smithi179.stderr: 11750K .......... .......... .......... .......... .......... 7% 39.2M 7s 2024-08-24T21:12:05.905 INFO:tasks.workunit.client.0.smithi179.stderr: 11800K .......... .......... .......... .......... .......... 7% 24.6M 7s 2024-08-24T21:12:05.906 INFO:tasks.workunit.client.0.smithi179.stderr: 11850K .......... .......... .......... .......... .......... 7% 38.2M 6s 2024-08-24T21:12:05.908 INFO:tasks.workunit.client.0.smithi179.stderr: 11900K .......... .......... .......... .......... .......... 7% 26.2M 6s 2024-08-24T21:12:05.910 INFO:tasks.workunit.client.0.smithi179.stderr: 11950K .......... .......... .......... .......... .......... 7% 23.6M 6s 2024-08-24T21:12:05.912 INFO:tasks.workunit.client.0.smithi179.stderr: 12000K .......... .......... .......... .......... .......... 7% 32.3M 6s 2024-08-24T21:12:05.914 INFO:tasks.workunit.client.0.smithi179.stderr: 12050K .......... .......... .......... .......... .......... 7% 23.2M 6s 2024-08-24T21:12:05.915 INFO:tasks.workunit.client.0.smithi179.stderr: 12100K .......... .......... .......... .......... .......... 7% 44.5M 6s 2024-08-24T21:12:05.917 INFO:tasks.workunit.client.0.smithi179.stderr: 12150K .......... .......... .......... .......... .......... 7% 23.1M 6s 2024-08-24T21:12:05.919 INFO:tasks.workunit.client.0.smithi179.stderr: 12200K .......... .......... .......... .......... .......... 7% 31.4M 6s 2024-08-24T21:12:05.921 INFO:tasks.workunit.client.0.smithi179.stderr: 12250K .......... .......... .......... .......... .......... 7% 23.1M 6s 2024-08-24T21:12:05.922 INFO:tasks.workunit.client.0.smithi179.stderr: 12300K .......... .......... .......... .......... .......... 7% 28.8M 6s 2024-08-24T21:12:05.925 INFO:tasks.workunit.client.0.smithi179.stderr: 12350K .......... .......... .......... .......... .......... 7% 23.7M 6s 2024-08-24T21:12:05.926 INFO:tasks.workunit.client.0.smithi179.stderr: 12400K .......... .......... .......... .......... .......... 7% 39.9M 6s 2024-08-24T21:12:05.927 INFO:tasks.workunit.client.0.smithi179.stderr: 12450K .......... .......... .......... .......... .......... 7% 27.4M 6s 2024-08-24T21:12:05.932 INFO:tasks.workunit.client.0.smithi179.stderr: 12500K .......... .......... .......... .......... .......... 7% 28.3M 6s 2024-08-24T21:12:05.932 INFO:tasks.workunit.client.0.smithi179.stderr: 12550K .......... .......... .......... .......... .......... 7% 51.8M 6s 2024-08-24T21:12:05.932 INFO:tasks.workunit.client.0.smithi179.stderr: 12600K .......... .......... .......... .......... .......... 7% 34.0M 6s 2024-08-24T21:12:05.934 INFO:tasks.workunit.client.0.smithi179.stderr: 12650K .......... .......... .......... .......... .......... 7% 22.9M 6s 2024-08-24T21:12:05.935 INFO:tasks.workunit.client.0.smithi179.stderr: 12700K .......... .......... .......... .......... .......... 7% 32.0M 6s 2024-08-24T21:12:05.938 INFO:tasks.workunit.client.0.smithi179.stderr: 12750K .......... .......... .......... .......... .......... 7% 21.2M 6s 2024-08-24T21:12:05.940 INFO:tasks.workunit.client.0.smithi179.stderr: 12800K .......... .......... .......... .......... .......... 7% 24.8M 6s 2024-08-24T21:12:05.941 INFO:tasks.workunit.client.0.smithi179.stderr: 12850K .......... .......... .......... .......... .......... 7% 28.5M 6s 2024-08-24T21:12:05.942 INFO:tasks.workunit.client.0.smithi179.stderr: 12900K .......... .......... .......... .......... .......... 7% 52.8M 6s 2024-08-24T21:12:05.944 INFO:tasks.workunit.client.0.smithi179.stderr: 12950K .......... .......... .......... .......... .......... 7% 23.7M 6s 2024-08-24T21:12:05.945 INFO:tasks.workunit.client.0.smithi179.stderr: 13000K .......... .......... .......... .......... .......... 7% 41.9M 6s 2024-08-24T21:12:05.948 INFO:tasks.workunit.client.0.smithi179.stderr: 13050K .......... .......... .......... .......... .......... 7% 23.9M 6s 2024-08-24T21:12:05.949 INFO:tasks.workunit.client.0.smithi179.stderr: 13100K .......... .......... .......... .......... .......... 7% 48.7M 6s 2024-08-24T21:12:05.951 INFO:tasks.workunit.client.0.smithi179.stderr: 13150K .......... .......... .......... .......... .......... 7% 22.6M 6s 2024-08-24T21:12:05.953 INFO:tasks.workunit.client.0.smithi179.stderr: 13200K .......... .......... .......... .......... .......... 7% 25.7M 6s 2024-08-24T21:12:05.954 INFO:tasks.workunit.client.0.smithi179.stderr: 13250K .......... .......... .......... .......... .......... 7% 37.0M 6s 2024-08-24T21:12:05.957 INFO:tasks.workunit.client.0.smithi179.stderr: 13300K .......... .......... .......... .......... .......... 7% 18.2M 6s 2024-08-24T21:12:05.959 INFO:tasks.workunit.client.0.smithi179.stderr: 13350K .......... .......... .......... .......... .......... 7% 24.3M 6s 2024-08-24T21:12:05.959 INFO:tasks.workunit.client.0.smithi179.stderr: 13400K .......... .......... .......... .......... .......... 7% 65.3M 6s 2024-08-24T21:12:05.962 INFO:tasks.workunit.client.0.smithi179.stderr: 13450K .......... .......... .......... .......... .......... 8% 22.0M 6s 2024-08-24T21:12:05.963 INFO:tasks.workunit.client.0.smithi179.stderr: 13500K .......... .......... .......... .......... .......... 8% 41.7M 6s 2024-08-24T21:12:05.966 INFO:tasks.workunit.client.0.smithi179.stderr: 13550K .......... .......... .......... .......... .......... 8% 17.5M 6s 2024-08-24T21:12:05.967 INFO:tasks.workunit.client.0.smithi179.stderr: 13600K .......... .......... .......... .......... .......... 8% 28.4M 6s 2024-08-24T21:12:05.968 INFO:tasks.workunit.client.0.smithi179.stderr: 13650K .......... .......... .......... .......... .......... 8% 48.0M 6s 2024-08-24T21:12:05.971 INFO:tasks.workunit.client.0.smithi179.stderr: 13700K .......... .......... .......... .......... .......... 8% 19.4M 6s 2024-08-24T21:12:05.973 INFO:tasks.workunit.client.0.smithi179.stderr: 13750K .......... .......... .......... .......... .......... 8% 21.0M 6s 2024-08-24T21:12:05.974 INFO:tasks.workunit.client.0.smithi179.stderr: 13800K .......... .......... .......... .......... .......... 8% 40.4M 6s 2024-08-24T21:12:05.977 INFO:tasks.workunit.client.0.smithi179.stderr: 13850K .......... .......... .......... .......... .......... 8% 20.5M 6s 2024-08-24T21:12:05.978 INFO:tasks.workunit.client.0.smithi179.stderr: 13900K .......... .......... .......... .......... .......... 8% 62.8M 6s 2024-08-24T21:12:05.979 INFO:tasks.workunit.client.0.smithi179.stderr: 13950K .......... .......... .......... .......... .......... 8% 26.2M 6s 2024-08-24T21:12:05.982 INFO:tasks.workunit.client.0.smithi179.stderr: 14000K .......... .......... .......... .......... .......... 8% 22.5M 6s 2024-08-24T21:12:05.983 INFO:tasks.workunit.client.0.smithi179.stderr: 14050K .......... .......... .......... .......... .......... 8% 38.6M 6s 2024-08-24T21:12:05.985 INFO:tasks.workunit.client.0.smithi179.stderr: 14100K .......... .......... .......... .......... .......... 8% 23.4M 6s 2024-08-24T21:12:05.986 INFO:tasks.workunit.client.0.smithi179.stderr: 14150K .......... .......... .......... .......... .......... 8% 39.2M 6s 2024-08-24T21:12:05.988 INFO:tasks.workunit.client.0.smithi179.stderr: 14200K .......... .......... .......... .......... .......... 8% 28.4M 6s 2024-08-24T21:12:05.990 INFO:tasks.workunit.client.0.smithi179.stderr: 14250K .......... .......... .......... .......... .......... 8% 30.2M 6s 2024-08-24T21:12:05.991 INFO:tasks.workunit.client.0.smithi179.stderr: 14300K .......... .......... .......... .......... .......... 8% 29.3M 6s 2024-08-24T21:12:05.994 INFO:tasks.workunit.client.0.smithi179.stderr: 14350K .......... .......... .......... .......... .......... 8% 17.6M 6s 2024-08-24T21:12:05.995 INFO:tasks.workunit.client.0.smithi179.stderr: 14400K .......... .......... .......... .......... .......... 8% 37.2M 6s 2024-08-24T21:12:05.997 INFO:tasks.workunit.client.0.smithi179.stderr: 14450K .......... .......... .......... .......... .......... 8% 35.0M 6s 2024-08-24T21:12:05.998 INFO:tasks.workunit.client.0.smithi179.stderr: 14500K .......... .......... .......... .......... .......... 8% 29.0M 6s 2024-08-24T21:12:06.001 INFO:tasks.workunit.client.0.smithi179.stderr: 14550K .......... .......... .......... .......... .......... 8% 20.0M 6s 2024-08-24T21:12:06.003 INFO:tasks.workunit.client.0.smithi179.stderr: 14600K .......... .......... .......... .......... .......... 8% 24.3M 6s 2024-08-24T21:12:06.003 INFO:tasks.workunit.client.0.smithi179.stderr: 14650K .......... .......... .......... .......... .......... 8% 59.6M 6s 2024-08-24T21:12:06.006 INFO:tasks.workunit.client.0.smithi179.stderr: 14700K .......... .......... .......... .......... .......... 8% 22.0M 6s 2024-08-24T21:12:06.008 INFO:tasks.workunit.client.0.smithi179.stderr: 14750K .......... .......... .......... .......... .......... 8% 17.6M 6s 2024-08-24T21:12:06.010 INFO:tasks.workunit.client.0.smithi179.stderr: 14800K .......... .......... .......... .......... .......... 8% 38.9M 6s 2024-08-24T21:12:06.013 INFO:tasks.workunit.client.0.smithi179.stderr: 14850K .......... .......... .......... .......... .......... 8% 17.0M 6s 2024-08-24T21:12:06.015 INFO:tasks.workunit.client.0.smithi179.stderr: 14900K .......... .......... .......... .......... .......... 8% 24.5M 6s 2024-08-24T21:12:06.017 INFO:tasks.workunit.client.0.smithi179.stderr: 14950K .......... .......... .......... .......... .......... 8% 17.5M 6s 2024-08-24T21:12:06.019 INFO:tasks.workunit.client.0.smithi179.stderr: 15000K .......... .......... .......... .......... .......... 8% 41.5M 6s 2024-08-24T21:12:06.022 INFO:tasks.workunit.client.0.smithi179.stderr: 15050K .......... .......... .......... .......... .......... 8% 19.6M 6s 2024-08-24T21:12:06.024 INFO:tasks.workunit.client.0.smithi179.stderr: 15100K .......... .......... .......... .......... .......... 8% 18.7M 6s 2024-08-24T21:12:06.026 INFO:tasks.workunit.client.0.smithi179.stderr: 15150K .......... .......... .......... .......... .......... 9% 19.5M 6s 2024-08-24T21:12:06.027 INFO:tasks.workunit.client.0.smithi179.stderr: 15200K .......... .......... .......... .......... .......... 9% 49.8M 6s 2024-08-24T21:12:06.029 INFO:tasks.workunit.client.0.smithi179.stderr: 15250K .......... .......... .......... .......... .......... 9% 27.6M 6s 2024-08-24T21:12:06.031 INFO:tasks.workunit.client.0.smithi179.stderr: 15300K .......... .......... .......... .......... .......... 9% 28.0M 6s 2024-08-24T21:12:06.033 INFO:tasks.workunit.client.0.smithi179.stderr: 15350K .......... .......... .......... .......... .......... 9% 24.0M 6s 2024-08-24T21:12:06.034 INFO:tasks.workunit.client.0.smithi179.stderr: 15400K .......... .......... .......... .......... .......... 9% 40.7M 6s 2024-08-24T21:12:06.036 INFO:tasks.workunit.client.0.smithi179.stderr: 15450K .......... .......... .......... .......... .......... 9% 23.4M 6s 2024-08-24T21:12:06.038 INFO:tasks.workunit.client.0.smithi179.stderr: 15500K .......... .......... .......... .......... .......... 9% 30.1M 6s 2024-08-24T21:12:06.040 INFO:tasks.workunit.client.0.smithi179.stderr: 15550K .......... .......... .......... .......... .......... 9% 27.1M 6s 2024-08-24T21:12:06.042 INFO:tasks.workunit.client.0.smithi179.stderr: 15600K .......... .......... .......... .......... .......... 9% 24.1M 6s 2024-08-24T21:12:06.043 INFO:tasks.workunit.client.0.smithi179.stderr: 15650K .......... .......... .......... .......... .......... 9% 25.5M 6s 2024-08-24T21:12:06.044 INFO:tasks.workunit.client.0.smithi179.stderr: 15700K .......... .......... .......... .......... .......... 9% 44.4M 6s 2024-08-24T21:12:06.046 INFO:tasks.workunit.client.0.smithi179.stderr: 15750K .......... .......... .......... .......... .......... 9% 23.2M 6s 2024-08-24T21:12:06.048 INFO:tasks.workunit.client.0.smithi179.stderr: 15800K .......... .......... .......... .......... .......... 9% 43.7M 6s 2024-08-24T21:12:06.050 INFO:tasks.workunit.client.0.smithi179.stderr: 15850K .......... .......... .......... .......... .......... 9% 23.9M 6s 2024-08-24T21:12:06.051 INFO:tasks.workunit.client.0.smithi179.stderr: 15900K .......... .......... .......... .......... .......... 9% 43.8M 6s 2024-08-24T21:12:06.053 INFO:tasks.workunit.client.0.smithi179.stderr: 15950K .......... .......... .......... .......... .......... 9% 20.5M 6s 2024-08-24T21:12:06.056 INFO:tasks.workunit.client.0.smithi179.stderr: 16000K .......... .......... .......... .......... .......... 9% 19.0M 6s 2024-08-24T21:12:06.057 INFO:tasks.workunit.client.0.smithi179.stderr: 16050K .......... .......... .......... .......... .......... 9% 29.6M 6s 2024-08-24T21:12:06.060 INFO:tasks.workunit.client.0.smithi179.stderr: 16100K .......... .......... .......... .......... .......... 9% 20.8M 6s 2024-08-24T21:12:06.063 INFO:tasks.workunit.client.0.smithi179.stderr: 16150K .......... .......... .......... .......... .......... 9% 21.4M 6s 2024-08-24T21:12:06.063 INFO:tasks.workunit.client.0.smithi179.stderr: 16200K .......... .......... .......... .......... .......... 9% 56.2M 6s 2024-08-24T21:12:06.065 INFO:tasks.workunit.client.0.smithi179.stderr: 16250K .......... .......... .......... .......... .......... 9% 25.8M 6s 2024-08-24T21:12:06.066 INFO:tasks.workunit.client.0.smithi179.stderr: 16300K .......... .......... .......... .......... .......... 9% 42.8M 6s 2024-08-24T21:12:06.068 INFO:tasks.workunit.client.0.smithi179.stderr: 16350K .......... .......... .......... .......... .......... 9% 24.3M 6s 2024-08-24T21:12:06.070 INFO:tasks.workunit.client.0.smithi179.stderr: 16400K .......... .......... .......... .......... .......... 9% 24.0M 6s 2024-08-24T21:12:06.071 INFO:tasks.workunit.client.0.smithi179.stderr: 16450K .......... .......... .......... .......... .......... 9% 35.1M 6s 2024-08-24T21:12:06.073 INFO:tasks.workunit.client.0.smithi179.stderr: 16500K .......... .......... .......... .......... .......... 9% 27.3M 6s 2024-08-24T21:12:06.075 INFO:tasks.workunit.client.0.smithi179.stderr: 16550K .......... .......... .......... .......... .......... 9% 24.2M 6s 2024-08-24T21:12:06.079 INFO:tasks.workunit.client.0.smithi179.stderr: 16600K .......... .......... .......... .......... .......... 9% 23.6M 6s 2024-08-24T21:12:06.079 INFO:tasks.workunit.client.0.smithi179.stderr: 16650K .......... .......... .......... .......... .......... 9% 41.1M 6s 2024-08-24T21:12:06.080 INFO:tasks.workunit.client.0.smithi179.stderr: 16700K .......... .......... .......... .......... .......... 9% 43.4M 6s 2024-08-24T21:12:06.082 INFO:tasks.workunit.client.0.smithi179.stderr: 16750K .......... .......... .......... .......... .......... 9% 17.8M 6s 2024-08-24T21:12:06.085 INFO:tasks.workunit.client.0.smithi179.stderr: 16800K .......... .......... .......... .......... .......... 9% 25.9M 6s 2024-08-24T21:12:06.086 INFO:tasks.workunit.client.0.smithi179.stderr: 16850K .......... .......... .......... .......... .......... 10% 39.3M 6s 2024-08-24T21:12:06.088 INFO:tasks.workunit.client.0.smithi179.stderr: 16900K .......... .......... .......... .......... .......... 10% 16.5M 6s 2024-08-24T21:12:06.089 INFO:tasks.workunit.client.0.smithi179.stderr: 16950K .......... .......... .......... .......... .......... 10% 42.1M 6s 2024-08-24T21:12:06.092 INFO:tasks.workunit.client.0.smithi179.stderr: 17000K .......... .......... .......... .......... .......... 10% 24.4M 6s 2024-08-24T21:12:06.093 INFO:tasks.workunit.client.0.smithi179.stderr: 17050K .......... .......... .......... .......... .......... 10% 41.1M 6s 2024-08-24T21:12:06.095 INFO:tasks.workunit.client.0.smithi179.stderr: 17100K .......... .......... .......... .......... .......... 10% 22.0M 6s 2024-08-24T21:12:06.097 INFO:tasks.workunit.client.0.smithi179.stderr: 17150K .......... .......... .......... .......... .......... 10% 20.4M 6s 2024-08-24T21:12:06.102 INFO:tasks.workunit.client.0.smithi179.stderr: 17200K .......... .......... .......... .......... .......... 10% 13.5M 6s 2024-08-24T21:12:06.102 INFO:tasks.workunit.client.0.smithi179.stderr: 17250K .......... .......... .......... .......... .......... 10% 47.1M 6s 2024-08-24T21:12:06.104 INFO:tasks.workunit.client.0.smithi179.stderr: 17300K .......... .......... .......... .......... .......... 10% 25.8M 6s 2024-08-24T21:12:06.105 INFO:tasks.workunit.client.0.smithi179.stderr: 17350K .......... .......... .......... .......... .......... 10% 48.0M 6s 2024-08-24T21:12:06.108 INFO:tasks.workunit.client.0.smithi179.stderr: 17400K .......... .......... .......... .......... .......... 10% 19.4M 6s 2024-08-24T21:12:06.109 INFO:tasks.workunit.client.0.smithi179.stderr: 17450K .......... .......... .......... .......... .......... 10% 47.3M 6s 2024-08-24T21:12:06.111 INFO:tasks.workunit.client.0.smithi179.stderr: 17500K .......... .......... .......... .......... .......... 10% 23.5M 6s 2024-08-24T21:12:06.113 INFO:tasks.workunit.client.0.smithi179.stderr: 17550K .......... .......... .......... .......... .......... 10% 26.4M 6s 2024-08-24T21:12:06.115 INFO:tasks.workunit.client.0.smithi179.stderr: 17600K .......... .......... .......... .......... .......... 10% 31.8M 6s 2024-08-24T21:12:06.117 INFO:tasks.workunit.client.0.smithi179.stderr: 17650K .......... .......... .......... .......... .......... 10% 21.7M 6s 2024-08-24T21:12:06.117 INFO:tasks.workunit.client.0.smithi179.stderr: 17700K .......... .......... .......... .......... .......... 10% 126M 6s 2024-08-24T21:12:06.119 INFO:tasks.workunit.client.0.smithi179.stderr: 17750K .......... .......... .......... .......... .......... 10% 24.7M 6s 2024-08-24T21:12:06.120 INFO:tasks.workunit.client.0.smithi179.stderr: 17800K .......... .......... .......... .......... .......... 10% 32.1M 6s 2024-08-24T21:12:06.123 INFO:tasks.workunit.client.0.smithi179.stderr: 17850K .......... .......... .......... .......... .......... 10% 20.6M 6s 2024-08-24T21:12:06.124 INFO:tasks.workunit.client.0.smithi179.stderr: 17900K .......... .......... .......... .......... .......... 10% 24.2M 6s 2024-08-24T21:12:06.127 INFO:tasks.workunit.client.0.smithi179.stderr: 17950K .......... .......... .......... .......... .......... 10% 25.2M 6s 2024-08-24T21:12:06.128 INFO:tasks.workunit.client.0.smithi179.stderr: 18000K .......... .......... .......... .......... .......... 10% 45.2M 6s 2024-08-24T21:12:06.129 INFO:tasks.workunit.client.0.smithi179.stderr: 18050K .......... .......... .......... .......... .......... 10% 25.4M 6s 2024-08-24T21:12:06.132 INFO:tasks.workunit.client.0.smithi179.stderr: 18100K .......... .......... .......... .......... .......... 10% 22.4M 6s 2024-08-24T21:12:06.134 INFO:tasks.workunit.client.0.smithi179.stderr: 18150K .......... .......... .......... .......... .......... 10% 33.5M 6s 2024-08-24T21:12:06.134 INFO:tasks.workunit.client.0.smithi179.stderr: 18200K .......... .......... .......... .......... .......... 10% 58.2M 6s 2024-08-24T21:12:06.136 INFO:tasks.workunit.client.0.smithi179.stderr: 18250K .......... .......... .......... .......... .......... 10% 23.0M 6s 2024-08-24T21:12:06.138 INFO:tasks.workunit.client.0.smithi179.stderr: 18300K .......... .......... .......... .......... .......... 10% 30.1M 6s 2024-08-24T21:12:06.140 INFO:tasks.workunit.client.0.smithi179.stderr: 18350K .......... .......... .......... .......... .......... 10% 28.3M 6s 2024-08-24T21:12:06.141 INFO:tasks.workunit.client.0.smithi179.stderr: 18400K .......... .......... .......... .......... .......... 10% 26.5M 6s 2024-08-24T21:12:06.143 INFO:tasks.workunit.client.0.smithi179.stderr: 18450K .......... .......... .......... .......... .......... 10% 31.6M 6s 2024-08-24T21:12:06.144 INFO:tasks.workunit.client.0.smithi179.stderr: 18500K .......... .......... .......... .......... .......... 11% 34.6M 6s 2024-08-24T21:12:06.146 INFO:tasks.workunit.client.0.smithi179.stderr: 18550K .......... .......... .......... .......... .......... 11% 22.1M 6s 2024-08-24T21:12:06.148 INFO:tasks.workunit.client.0.smithi179.stderr: 18600K .......... .......... .......... .......... .......... 11% 41.2M 6s 2024-08-24T21:12:06.150 INFO:tasks.workunit.client.0.smithi179.stderr: 18650K .......... .......... .......... .......... .......... 11% 22.9M 6s 2024-08-24T21:12:06.151 INFO:tasks.workunit.client.0.smithi179.stderr: 18700K .......... .......... .......... .......... .......... 11% 41.7M 6s 2024-08-24T21:12:06.153 INFO:tasks.workunit.client.0.smithi179.stderr: 18750K .......... .......... .......... .......... .......... 11% 28.1M 6s 2024-08-24T21:12:06.155 INFO:tasks.workunit.client.0.smithi179.stderr: 18800K .......... .......... .......... .......... .......... 11% 22.9M 6s 2024-08-24T21:12:06.156 INFO:tasks.workunit.client.0.smithi179.stderr: 18850K .......... .......... .......... .......... .......... 11% 33.8M 6s 2024-08-24T21:12:06.158 INFO:tasks.workunit.client.0.smithi179.stderr: 18900K .......... .......... .......... .......... .......... 11% 26.1M 6s 2024-08-24T21:12:06.161 INFO:tasks.workunit.client.0.smithi179.stderr: 18950K .......... .......... .......... .......... .......... 11% 22.9M 6s 2024-08-24T21:12:06.161 INFO:tasks.workunit.client.0.smithi179.stderr: 19000K .......... .......... .......... .......... .......... 11% 52.1M 6s 2024-08-24T21:12:06.164 INFO:tasks.workunit.client.0.smithi179.stderr: 19050K .......... .......... .......... .......... .......... 11% 17.7M 6s 2024-08-24T21:12:06.165 INFO:tasks.workunit.client.0.smithi179.stderr: 19100K .......... .......... .......... .......... .......... 11% 48.0M 6s 2024-08-24T21:12:06.169 INFO:tasks.workunit.client.0.smithi179.stderr: 19150K .......... .......... .......... .......... .......... 11% 12.7M 6s 2024-08-24T21:12:06.172 INFO:tasks.workunit.client.0.smithi179.stderr: 19200K .......... .......... .......... .......... .......... 11% 15.3M 6s 2024-08-24T21:12:06.173 INFO:tasks.workunit.client.0.smithi179.stderr: 19250K .......... .......... .......... .......... .......... 11% 35.1M 6s 2024-08-24T21:12:06.176 INFO:tasks.workunit.client.0.smithi179.stderr: 19300K .......... .......... .......... .......... .......... 11% 17.8M 6s 2024-08-24T21:12:06.177 INFO:tasks.workunit.client.0.smithi179.stderr: 19350K .......... .......... .......... .......... .......... 11% 39.0M 6s 2024-08-24T21:12:06.180 INFO:tasks.workunit.client.0.smithi179.stderr: 19400K .......... .......... .......... .......... .......... 11% 19.8M 6s 2024-08-24T21:12:06.181 INFO:tasks.workunit.client.0.smithi179.stderr: 19450K .......... .......... .......... .......... .......... 11% 34.9M 6s 2024-08-24T21:12:06.182 INFO:tasks.workunit.client.0.smithi179.stderr: 19500K .......... .......... .......... .......... .......... 11% 28.6M 6s 2024-08-24T21:12:06.185 INFO:tasks.workunit.client.0.smithi179.stderr: 19550K .......... .......... .......... .......... .......... 11% 23.5M 6s 2024-08-24T21:12:06.187 INFO:tasks.workunit.client.0.smithi179.stderr: 19600K .......... .......... .......... .......... .......... 11% 23.0M 6s 2024-08-24T21:12:06.189 INFO:tasks.workunit.client.0.smithi179.stderr: 19650K .......... .......... .......... .......... .......... 11% 37.1M 6s 2024-08-24T21:12:06.190 INFO:tasks.workunit.client.0.smithi179.stderr: 19700K .......... .......... .......... .......... .......... 11% 25.8M 6s 2024-08-24T21:12:06.192 INFO:tasks.workunit.client.0.smithi179.stderr: 19750K .......... .......... .......... .......... .......... 11% 46.8M 6s 2024-08-24T21:12:06.193 INFO:tasks.workunit.client.0.smithi179.stderr: 19800K .......... .......... .......... .......... .......... 11% 25.5M 6s 2024-08-24T21:12:06.194 INFO:tasks.workunit.client.0.smithi179.stderr: 19850K .......... .......... .......... .......... .......... 11% 38.9M 6s 2024-08-24T21:12:06.197 INFO:tasks.workunit.client.0.smithi179.stderr: 19900K .......... .......... .......... .......... .......... 11% 22.6M 6s 2024-08-24T21:12:06.199 INFO:tasks.workunit.client.0.smithi179.stderr: 19950K .......... .......... .......... .......... .......... 11% 25.3M 6s 2024-08-24T21:12:06.200 INFO:tasks.workunit.client.0.smithi179.stderr: 20000K .......... .......... .......... .......... .......... 11% 45.5M 6s 2024-08-24T21:12:06.201 INFO:tasks.workunit.client.0.smithi179.stderr: 20050K .......... .......... .......... .......... .......... 11% 25.0M 6s 2024-08-24T21:12:06.204 INFO:tasks.workunit.client.0.smithi179.stderr: 20100K .......... .......... .......... .......... .......... 11% 29.4M 6s 2024-08-24T21:12:06.205 INFO:tasks.workunit.client.0.smithi179.stderr: 20150K .......... .......... .......... .......... .......... 11% 29.5M 6s 2024-08-24T21:12:06.208 INFO:tasks.workunit.client.0.smithi179.stderr: 20200K .......... .......... .......... .......... .......... 12% 21.5M 6s 2024-08-24T21:12:06.208 INFO:tasks.workunit.client.0.smithi179.stderr: 20250K .......... .......... .......... .......... .......... 12% 60.9M 6s 2024-08-24T21:12:06.210 INFO:tasks.workunit.client.0.smithi179.stderr: 20300K .......... .......... .......... .......... .......... 12% 24.2M 6s 2024-08-24T21:12:06.212 INFO:tasks.workunit.client.0.smithi179.stderr: 20350K .......... .......... .......... .......... .......... 12% 22.8M 6s 2024-08-24T21:12:06.214 INFO:tasks.workunit.client.0.smithi179.stderr: 20400K .......... .......... .......... .......... .......... 12% 35.1M 6s 2024-08-24T21:12:06.216 INFO:tasks.workunit.client.0.smithi179.stderr: 20450K .......... .......... .......... .......... .......... 12% 25.7M 6s 2024-08-24T21:12:06.217 INFO:tasks.workunit.client.0.smithi179.stderr: 20500K .......... .......... .......... .......... .......... 12% 51.0M 6s 2024-08-24T21:12:06.219 INFO:tasks.workunit.client.0.smithi179.stderr: 20550K .......... .......... .......... .......... .......... 12% 22.0M 6s 2024-08-24T21:12:06.220 INFO:tasks.workunit.client.0.smithi179.stderr: 20600K .......... .......... .......... .......... .......... 12% 42.0M 6s 2024-08-24T21:12:06.222 INFO:tasks.workunit.client.0.smithi179.stderr: 20650K .......... .......... .......... .......... .......... 12% 24.6M 6s 2024-08-24T21:12:06.224 INFO:tasks.workunit.client.0.smithi179.stderr: 20700K .......... .......... .......... .......... .......... 12% 20.8M 6s 2024-08-24T21:12:06.227 INFO:tasks.workunit.client.0.smithi179.stderr: 20750K .......... .......... .......... .......... .......... 12% 23.7M 6s 2024-08-24T21:12:06.227 INFO:tasks.workunit.client.0.smithi179.stderr: 20800K .......... .......... .......... .......... .......... 12% 49.8M 6s 2024-08-24T21:12:06.229 INFO:tasks.workunit.client.0.smithi179.stderr: 20850K .......... .......... .......... .......... .......... 12% 25.4M 6s 2024-08-24T21:12:06.230 INFO:tasks.workunit.client.0.smithi179.stderr: 20900K .......... .......... .......... .......... .......... 12% 34.5M 6s 2024-08-24T21:12:06.233 INFO:tasks.workunit.client.0.smithi179.stderr: 20950K .......... .......... .......... .......... .......... 12% 23.6M 6s 2024-08-24T21:12:06.234 INFO:tasks.workunit.client.0.smithi179.stderr: 21000K .......... .......... .......... .......... .......... 12% 50.4M 6s 2024-08-24T21:12:06.235 INFO:tasks.workunit.client.0.smithi179.stderr: 21050K .......... .......... .......... .......... .......... 12% 24.8M 6s 2024-08-24T21:12:06.237 INFO:tasks.workunit.client.0.smithi179.stderr: 21100K .......... .......... .......... .......... .......... 12% 39.8M 6s 2024-08-24T21:12:06.239 INFO:tasks.workunit.client.0.smithi179.stderr: 21150K .......... .......... .......... .......... .......... 12% 24.4M 6s 2024-08-24T21:12:06.242 INFO:tasks.workunit.client.0.smithi179.stderr: 21200K .......... .......... .......... .......... .......... 12% 19.5M 6s 2024-08-24T21:12:06.245 INFO:tasks.workunit.client.0.smithi179.stderr: 21250K .......... .......... .......... .......... .......... 12% 26.1M 6s 2024-08-24T21:12:06.245 INFO:tasks.workunit.client.0.smithi179.stderr: 21300K .......... .......... .......... .......... .......... 12% 48.1M 6s 2024-08-24T21:12:06.246 INFO:tasks.workunit.client.0.smithi179.stderr: 21350K .......... .......... .......... .......... .......... 12% 22.1M 6s 2024-08-24T21:12:06.247 INFO:tasks.workunit.client.0.smithi179.stderr: 21400K .......... .......... .......... .......... .......... 12% 48.6M 6s 2024-08-24T21:12:06.250 INFO:tasks.workunit.client.0.smithi179.stderr: 21450K .......... .......... .......... .......... .......... 12% 22.2M 6s 2024-08-24T21:12:06.252 INFO:tasks.workunit.client.0.smithi179.stderr: 21500K .......... .......... .......... .......... .......... 12% 44.6M 6s 2024-08-24T21:12:06.253 INFO:tasks.workunit.client.0.smithi179.stderr: 21550K .......... .......... .......... .......... .......... 12% 27.3M 6s 2024-08-24T21:12:06.255 INFO:tasks.workunit.client.0.smithi179.stderr: 21600K .......... .......... .......... .......... .......... 12% 24.1M 6s 2024-08-24T21:12:06.256 INFO:tasks.workunit.client.0.smithi179.stderr: 21650K .......... .......... .......... .......... .......... 12% 33.9M 6s 2024-08-24T21:12:06.258 INFO:tasks.workunit.client.0.smithi179.stderr: 21700K .......... .......... .......... .......... .......... 12% 21.5M 6s 2024-08-24T21:12:06.261 INFO:tasks.workunit.client.0.smithi179.stderr: 21750K .......... .......... .......... .......... .......... 12% 21.0M 6s 2024-08-24T21:12:06.261 INFO:tasks.workunit.client.0.smithi179.stderr: 21800K .......... .......... .......... .......... .......... 12% 38.0M 6s 2024-08-24T21:12:06.264 INFO:tasks.workunit.client.0.smithi179.stderr: 21850K .......... .......... .......... .......... .......... 12% 18.7M 6s 2024-08-24T21:12:06.265 INFO:tasks.workunit.client.0.smithi179.stderr: 21900K .......... .......... .......... .......... .......... 13% 38.0M 6s 2024-08-24T21:12:06.268 INFO:tasks.workunit.client.0.smithi179.stderr: 21950K .......... .......... .......... .......... .......... 13% 21.5M 6s 2024-08-24T21:12:06.270 INFO:tasks.workunit.client.0.smithi179.stderr: 22000K .......... .......... .......... .......... .......... 13% 21.2M 6s 2024-08-24T21:12:06.271 INFO:tasks.workunit.client.0.smithi179.stderr: 22050K .......... .......... .......... .......... .......... 13% 41.3M 6s 2024-08-24T21:12:06.273 INFO:tasks.workunit.client.0.smithi179.stderr: 22100K .......... .......... .......... .......... .......... 13% 27.3M 6s 2024-08-24T21:12:06.275 INFO:tasks.workunit.client.0.smithi179.stderr: 22150K .......... .......... .......... .......... .......... 13% 35.6M 6s 2024-08-24T21:12:06.276 INFO:tasks.workunit.client.0.smithi179.stderr: 22200K .......... .......... .......... .......... .......... 13% 24.0M 6s 2024-08-24T21:12:06.278 INFO:tasks.workunit.client.0.smithi179.stderr: 22250K .......... .......... .......... .......... .......... 13% 40.2M 6s 2024-08-24T21:12:06.279 INFO:tasks.workunit.client.0.smithi179.stderr: 22300K .......... .......... .......... .......... .......... 13% 27.8M 6s 2024-08-24T21:12:06.282 INFO:tasks.workunit.client.0.smithi179.stderr: 22350K .......... .......... .......... .......... .......... 13% 24.7M 6s 2024-08-24T21:12:06.284 INFO:tasks.workunit.client.0.smithi179.stderr: 22400K .......... .......... .......... .......... .......... 13% 32.7M 6s 2024-08-24T21:12:06.286 INFO:tasks.workunit.client.0.smithi179.stderr: 22450K .......... .......... .......... .......... .......... 13% 23.0M 6s 2024-08-24T21:12:06.288 INFO:tasks.workunit.client.0.smithi179.stderr: 22500K .......... .......... .......... .......... .......... 13% 25.9M 6s 2024-08-24T21:12:06.288 INFO:tasks.workunit.client.0.smithi179.stderr: 22550K .......... .......... .......... .......... .......... 13% 49.3M 6s 2024-08-24T21:12:06.290 INFO:tasks.workunit.client.0.smithi179.stderr: 22600K .......... .......... .......... .......... .......... 13% 23.2M 6s 2024-08-24T21:12:06.291 INFO:tasks.workunit.client.0.smithi179.stderr: 22650K .......... .......... .......... .......... .......... 13% 40.5M 6s 2024-08-24T21:12:06.294 INFO:tasks.workunit.client.0.smithi179.stderr: 22700K .......... .......... .......... .......... .......... 13% 24.2M 6s 2024-08-24T21:12:06.296 INFO:tasks.workunit.client.0.smithi179.stderr: 22750K .......... .......... .......... .......... .......... 13% 22.8M 6s 2024-08-24T21:12:06.297 INFO:tasks.workunit.client.0.smithi179.stderr: 22800K .......... .......... .......... .......... .......... 13% 41.0M 6s 2024-08-24T21:12:06.298 INFO:tasks.workunit.client.0.smithi179.stderr: 22850K .......... .......... .......... .......... .......... 13% 27.6M 6s 2024-08-24T21:12:06.300 INFO:tasks.workunit.client.0.smithi179.stderr: 22900K .......... .......... .......... .......... .......... 13% 23.6M 6s 2024-08-24T21:12:06.302 INFO:tasks.workunit.client.0.smithi179.stderr: 22950K .......... .......... .......... .......... .......... 13% 35.4M 6s 2024-08-24T21:12:06.305 INFO:tasks.workunit.client.0.smithi179.stderr: 23000K .......... .......... .......... .......... .......... 13% 23.4M 6s 2024-08-24T21:12:06.305 INFO:tasks.workunit.client.0.smithi179.stderr: 23050K .......... .......... .......... .......... .......... 13% 58.8M 6s 2024-08-24T21:12:06.307 INFO:tasks.workunit.client.0.smithi179.stderr: 23100K .......... .......... .......... .......... .......... 13% 25.4M 6s 2024-08-24T21:12:06.309 INFO:tasks.workunit.client.0.smithi179.stderr: 23150K .......... .......... .......... .......... .......... 13% 21.1M 6s 2024-08-24T21:12:06.311 INFO:tasks.workunit.client.0.smithi179.stderr: 23200K .......... .......... .......... .......... .......... 13% 33.6M 6s 2024-08-24T21:12:06.312 INFO:tasks.workunit.client.0.smithi179.stderr: 23250K .......... .......... .......... .......... .......... 13% 26.2M 6s 2024-08-24T21:12:06.314 INFO:tasks.workunit.client.0.smithi179.stderr: 23300K .......... .......... .......... .......... .......... 13% 38.7M 6s 2024-08-24T21:12:06.316 INFO:tasks.workunit.client.0.smithi179.stderr: 23350K .......... .......... .......... .......... .......... 13% 26.3M 6s 2024-08-24T21:12:06.319 INFO:tasks.workunit.client.0.smithi179.stderr: 23400K .......... .......... .......... .......... .......... 13% 25.1M 6s 2024-08-24T21:12:06.319 INFO:tasks.workunit.client.0.smithi179.stderr: 23450K .......... .......... .......... .......... .......... 13% 39.1M 6s 2024-08-24T21:12:06.320 INFO:tasks.workunit.client.0.smithi179.stderr: 23500K .......... .......... .......... .......... .......... 13% 32.8M 6s 2024-08-24T21:12:06.323 INFO:tasks.workunit.client.0.smithi179.stderr: 23550K .......... .......... .......... .......... .......... 14% 18.8M 6s 2024-08-24T21:12:06.324 INFO:tasks.workunit.client.0.smithi179.stderr: 23600K .......... .......... .......... .......... .......... 14% 44.4M 6s 2024-08-24T21:12:06.326 INFO:tasks.workunit.client.0.smithi179.stderr: 23650K .......... .......... .......... .......... .......... 14% 22.4M 6s 2024-08-24T21:12:06.332 INFO:tasks.workunit.client.0.smithi179.stderr: 23700K .......... .......... .......... .......... .......... 14% 14.6M 6s 2024-08-24T21:12:06.333 INFO:tasks.workunit.client.0.smithi179.stderr: 23750K .......... .......... .......... .......... .......... 14% 79.2M 6s 2024-08-24T21:12:06.333 INFO:tasks.workunit.client.0.smithi179.stderr: 23800K .......... .......... .......... .......... .......... 14% 64.8M 6s 2024-08-24T21:12:06.334 INFO:tasks.workunit.client.0.smithi179.stderr: 23850K .......... .......... .......... .......... .......... 14% 16.5M 6s 2024-08-24T21:12:06.335 INFO:tasks.workunit.client.0.smithi179.stderr: 23900K .......... .......... .......... .......... .......... 14% 43.4M 6s 2024-08-24T21:12:06.337 INFO:tasks.workunit.client.0.smithi179.stderr: 23950K .......... .......... .......... .......... .......... 14% 20.9M 6s 2024-08-24T21:12:06.339 INFO:tasks.workunit.client.0.smithi179.stderr: 24000K .......... .......... .......... .......... .......... 14% 24.1M 6s 2024-08-24T21:12:06.342 INFO:tasks.workunit.client.0.smithi179.stderr: 24050K .......... .......... .......... .......... .......... 14% 23.3M 6s 2024-08-24T21:12:06.342 INFO:tasks.workunit.client.0.smithi179.stderr: 24100K .......... .......... .......... .......... .......... 14% 58.3M 6s 2024-08-24T21:12:06.345 INFO:tasks.workunit.client.0.smithi179.stderr: 24150K .......... .......... .......... .......... .......... 14% 22.5M 6s 2024-08-24T21:12:06.346 INFO:tasks.workunit.client.0.smithi179.stderr: 24200K .......... .......... .......... .......... .......... 14% 36.4M 6s 2024-08-24T21:12:06.347 INFO:tasks.workunit.client.0.smithi179.stderr: 24250K .......... .......... .......... .......... .......... 14% 41.1M 6s 2024-08-24T21:12:06.349 INFO:tasks.workunit.client.0.smithi179.stderr: 24300K .......... .......... .......... .......... .......... 14% 27.9M 6s 2024-08-24T21:12:06.352 INFO:tasks.workunit.client.0.smithi179.stderr: 24350K .......... .......... .......... .......... .......... 14% 23.2M 6s 2024-08-24T21:12:06.353 INFO:tasks.workunit.client.0.smithi179.stderr: 24400K .......... .......... .......... .......... .......... 14% 23.6M 6s 2024-08-24T21:12:06.355 INFO:tasks.workunit.client.0.smithi179.stderr: 24450K .......... .......... .......... .......... .......... 14% 27.3M 6s 2024-08-24T21:12:06.358 INFO:tasks.workunit.client.0.smithi179.stderr: 24500K .......... .......... .......... .......... .......... 14% 14.8M 6s 2024-08-24T21:12:06.359 INFO:tasks.workunit.client.0.smithi179.stderr: 24550K .......... .......... .......... .......... .......... 14% 38.1M 6s 2024-08-24T21:12:06.361 INFO:tasks.workunit.client.0.smithi179.stderr: 24600K .......... .......... .......... .......... .......... 14% 20.1M 6s 2024-08-24T21:12:06.364 INFO:tasks.workunit.client.0.smithi179.stderr: 24650K .......... .......... .......... .......... .......... 14% 34.7M 6s 2024-08-24T21:12:06.365 INFO:tasks.workunit.client.0.smithi179.stderr: 24700K .......... .......... .......... .......... .......... 14% 24.3M 6s 2024-08-24T21:12:06.368 INFO:tasks.workunit.client.0.smithi179.stderr: 24750K .......... .......... .......... .......... .......... 14% 23.0M 6s 2024-08-24T21:12:06.370 INFO:tasks.workunit.client.0.smithi179.stderr: 24800K .......... .......... .......... .......... .......... 14% 17.4M 6s 2024-08-24T21:12:06.371 INFO:tasks.workunit.client.0.smithi179.stderr: 24850K .......... .......... .......... .......... .......... 14% 38.4M 6s 2024-08-24T21:12:06.374 INFO:tasks.workunit.client.0.smithi179.stderr: 24900K .......... .......... .......... .......... .......... 14% 16.2M 6s 2024-08-24T21:12:06.376 INFO:tasks.workunit.client.0.smithi179.stderr: 24950K .......... .......... .......... .......... .......... 14% 29.0M 6s 2024-08-24T21:12:06.378 INFO:tasks.workunit.client.0.smithi179.stderr: 25000K .......... .......... .......... .......... .......... 14% 23.0M 6s 2024-08-24T21:12:06.379 INFO:tasks.workunit.client.0.smithi179.stderr: 25050K .......... .......... .......... .......... .......... 14% 43.0M 6s 2024-08-24T21:12:06.383 INFO:tasks.workunit.client.0.smithi179.stderr: 25100K .......... .......... .......... .......... .......... 14% 12.3M 6s 2024-08-24T21:12:06.385 INFO:tasks.workunit.client.0.smithi179.stderr: 25150K .......... .......... .......... .......... .......... 14% 21.7M 6s 2024-08-24T21:12:06.388 INFO:tasks.workunit.client.0.smithi179.stderr: 25200K .......... .......... .......... .......... .......... 14% 25.1M 6s 2024-08-24T21:12:06.390 INFO:tasks.workunit.client.0.smithi179.stderr: 25250K .......... .......... .......... .......... .......... 15% 19.2M 6s 2024-08-24T21:12:06.393 INFO:tasks.workunit.client.0.smithi179.stderr: 25300K .......... .......... .......... .......... .......... 15% 17.6M 6s 2024-08-24T21:12:06.394 INFO:tasks.workunit.client.0.smithi179.stderr: 25350K .......... .......... .......... .......... .......... 15% 36.0M 6s 2024-08-24T21:12:06.396 INFO:tasks.workunit.client.0.smithi179.stderr: 25400K .......... .......... .......... .......... .......... 15% 27.7M 6s 2024-08-24T21:12:06.397 INFO:tasks.workunit.client.0.smithi179.stderr: 25450K .......... .......... .......... .......... .......... 15% 37.2M 6s 2024-08-24T21:12:06.398 INFO:tasks.workunit.client.0.smithi179.stderr: 25500K .......... .......... .......... .......... .......... 15% 30.7M 6s 2024-08-24T21:12:06.402 INFO:tasks.workunit.client.0.smithi179.stderr: 25550K .......... .......... .......... .......... .......... 15% 18.6M 6s 2024-08-24T21:12:06.403 INFO:tasks.workunit.client.0.smithi179.stderr: 25600K .......... .......... .......... .......... .......... 15% 48.4M 6s 2024-08-24T21:12:06.404 INFO:tasks.workunit.client.0.smithi179.stderr: 25650K .......... .......... .......... .......... .......... 15% 24.9M 6s 2024-08-24T21:12:06.406 INFO:tasks.workunit.client.0.smithi179.stderr: 25700K .......... .......... .......... .......... .......... 15% 23.1M 6s 2024-08-24T21:12:06.408 INFO:tasks.workunit.client.0.smithi179.stderr: 25750K .......... .......... .......... .......... .......... 15% 33.5M 6s 2024-08-24T21:12:06.411 INFO:tasks.workunit.client.0.smithi179.stderr: 25800K .......... .......... .......... .......... .......... 15% 23.6M 6s 2024-08-24T21:12:06.411 INFO:tasks.workunit.client.0.smithi179.stderr: 25850K .......... .......... .......... .......... .......... 15% 48.3M 5s 2024-08-24T21:12:06.413 INFO:tasks.workunit.client.0.smithi179.stderr: 25900K .......... .......... .......... .......... .......... 15% 25.0M 5s 2024-08-24T21:12:06.415 INFO:tasks.workunit.client.0.smithi179.stderr: 25950K .......... .......... .......... .......... .......... 15% 23.6M 5s 2024-08-24T21:12:06.417 INFO:tasks.workunit.client.0.smithi179.stderr: 26000K .......... .......... .......... .......... .......... 15% 38.5M 5s 2024-08-24T21:12:06.418 INFO:tasks.workunit.client.0.smithi179.stderr: 26050K .......... .......... .......... .......... .......... 15% 23.6M 5s 2024-08-24T21:12:06.419 INFO:tasks.workunit.client.0.smithi179.stderr: 26100K .......... .......... .......... .......... .......... 15% 40.4M 5s 2024-08-24T21:12:06.421 INFO:tasks.workunit.client.0.smithi179.stderr: 26150K .......... .......... .......... .......... .......... 15% 26.8M 5s 2024-08-24T21:12:06.423 INFO:tasks.workunit.client.0.smithi179.stderr: 26200K .......... .......... .......... .......... .......... 15% 34.2M 5s 2024-08-24T21:12:06.424 INFO:tasks.workunit.client.0.smithi179.stderr: 26250K .......... .......... .......... .......... .......... 15% 29.1M 5s 2024-08-24T21:12:06.427 INFO:tasks.workunit.client.0.smithi179.stderr: 26300K .......... .......... .......... .......... .......... 15% 21.7M 5s 2024-08-24T21:12:06.429 INFO:tasks.workunit.client.0.smithi179.stderr: 26350K .......... .......... .......... .......... .......... 15% 24.3M 5s 2024-08-24T21:12:06.430 INFO:tasks.workunit.client.0.smithi179.stderr: 26400K .......... .......... .......... .......... .......... 15% 53.4M 5s 2024-08-24T21:12:06.432 INFO:tasks.workunit.client.0.smithi179.stderr: 26450K .......... .......... .......... .......... .......... 15% 23.4M 5s 2024-08-24T21:12:06.434 INFO:tasks.workunit.client.0.smithi179.stderr: 26500K .......... .......... .......... .......... .......... 15% 30.8M 5s 2024-08-24T21:12:06.436 INFO:tasks.workunit.client.0.smithi179.stderr: 26550K .......... .......... .......... .......... .......... 15% 28.3M 5s 2024-08-24T21:12:06.436 INFO:tasks.workunit.client.0.smithi179.stderr: 26600K .......... .......... .......... .......... .......... 15% 51.6M 5s 2024-08-24T21:12:06.438 INFO:tasks.workunit.client.0.smithi179.stderr: 26650K .......... .......... .......... .......... .......... 15% 22.6M 5s 2024-08-24T21:12:06.439 INFO:tasks.workunit.client.0.smithi179.stderr: 26700K .......... .......... .......... .......... .......... 15% 36.6M 5s 2024-08-24T21:12:06.441 INFO:tasks.workunit.client.0.smithi179.stderr: 26750K .......... .......... .......... .......... .......... 15% 22.3M 5s 2024-08-24T21:12:06.443 INFO:tasks.workunit.client.0.smithi179.stderr: 26800K .......... .......... .......... .......... .......... 15% 32.6M 5s 2024-08-24T21:12:06.447 INFO:tasks.workunit.client.0.smithi179.stderr: 26850K .......... .......... .......... .......... .......... 15% 17.9M 5s 2024-08-24T21:12:06.447 INFO:tasks.workunit.client.0.smithi179.stderr: 26900K .......... .......... .......... .......... .......... 15% 47.1M 5s 2024-08-24T21:12:06.449 INFO:tasks.workunit.client.0.smithi179.stderr: 26950K .......... .......... .......... .......... .......... 16% 24.7M 5s 2024-08-24T21:12:06.450 INFO:tasks.workunit.client.0.smithi179.stderr: 27000K .......... .......... .......... .......... .......... 16% 43.8M 5s 2024-08-24T21:12:06.452 INFO:tasks.workunit.client.0.smithi179.stderr: 27050K .......... .......... .......... .......... .......... 16% 23.8M 5s 2024-08-24T21:12:06.453 INFO:tasks.workunit.client.0.smithi179.stderr: 27100K .......... .......... .......... .......... .......... 16% 44.0M 5s 2024-08-24T21:12:06.455 INFO:tasks.workunit.client.0.smithi179.stderr: 27150K .......... .......... .......... .......... .......... 16% 23.1M 5s 2024-08-24T21:12:06.457 INFO:tasks.workunit.client.0.smithi179.stderr: 27200K .......... .......... .......... .......... .......... 16% 24.4M 5s 2024-08-24T21:12:06.458 INFO:tasks.workunit.client.0.smithi179.stderr: 27250K .......... .......... .......... .......... .......... 16% 37.0M 5s 2024-08-24T21:12:06.461 INFO:tasks.workunit.client.0.smithi179.stderr: 27300K .......... .......... .......... .......... .......... 16% 23.5M 5s 2024-08-24T21:12:06.461 INFO:tasks.workunit.client.0.smithi179.stderr: 27350K .......... .......... .......... .......... .......... 16% 46.1M 5s 2024-08-24T21:12:06.463 INFO:tasks.workunit.client.0.smithi179.stderr: 27400K .......... .......... .......... .......... .......... 16% 21.4M 5s 2024-08-24T21:12:06.466 INFO:tasks.workunit.client.0.smithi179.stderr: 27450K .......... .......... .......... .......... .......... 16% 22.0M 5s 2024-08-24T21:12:06.467 INFO:tasks.workunit.client.0.smithi179.stderr: 27500K .......... .......... .......... .......... .......... 16% 42.3M 5s 2024-08-24T21:12:06.469 INFO:tasks.workunit.client.0.smithi179.stderr: 27550K .......... .......... .......... .......... .......... 16% 25.3M 5s 2024-08-24T21:12:06.471 INFO:tasks.workunit.client.0.smithi179.stderr: 27600K .......... .......... .......... .......... .......... 16% 25.2M 5s 2024-08-24T21:12:06.474 INFO:tasks.workunit.client.0.smithi179.stderr: 27650K .......... .......... .......... .......... .......... 16% 28.5M 5s 2024-08-24T21:12:06.475 INFO:tasks.workunit.client.0.smithi179.stderr: 27700K .......... .......... .......... .......... .......... 16% 31.2M 5s 2024-08-24T21:12:06.475 INFO:tasks.workunit.client.0.smithi179.stderr: 27750K .......... .......... .......... .......... .......... 16% 42.5M 5s 2024-08-24T21:12:06.478 INFO:tasks.workunit.client.0.smithi179.stderr: 27800K .......... .......... .......... .......... .......... 16% 22.9M 5s 2024-08-24T21:12:06.479 INFO:tasks.workunit.client.0.smithi179.stderr: 27850K .......... .......... .......... .......... .......... 16% 43.1M 5s 2024-08-24T21:12:06.481 INFO:tasks.workunit.client.0.smithi179.stderr: 27900K .......... .......... .......... .......... .......... 16% 25.2M 5s 2024-08-24T21:12:06.483 INFO:tasks.workunit.client.0.smithi179.stderr: 27950K .......... .......... .......... .......... .......... 16% 23.4M 5s 2024-08-24T21:12:06.486 INFO:tasks.workunit.client.0.smithi179.stderr: 28000K .......... .......... .......... .......... .......... 16% 23.0M 5s 2024-08-24T21:12:06.486 INFO:tasks.workunit.client.0.smithi179.stderr: 28050K .......... .......... .......... .......... .......... 16% 47.3M 5s 2024-08-24T21:12:06.488 INFO:tasks.workunit.client.0.smithi179.stderr: 28100K .......... .......... .......... .......... .......... 16% 24.9M 5s 2024-08-24T21:12:06.489 INFO:tasks.workunit.client.0.smithi179.stderr: 28150K .......... .......... .......... .......... .......... 16% 39.2M 5s 2024-08-24T21:12:06.492 INFO:tasks.workunit.client.0.smithi179.stderr: 28200K .......... .......... .......... .......... .......... 16% 22.5M 5s 2024-08-24T21:12:06.492 INFO:tasks.workunit.client.0.smithi179.stderr: 28250K .......... .......... .......... .......... .......... 16% 50.7M 5s 2024-08-24T21:12:06.494 INFO:tasks.workunit.client.0.smithi179.stderr: 28300K .......... .......... .......... .......... .......... 16% 23.7M 5s 2024-08-24T21:12:06.497 INFO:tasks.workunit.client.0.smithi179.stderr: 28350K .......... .......... .......... .......... .......... 16% 22.6M 5s 2024-08-24T21:12:06.498 INFO:tasks.workunit.client.0.smithi179.stderr: 28400K .......... .......... .......... .......... .......... 16% 53.6M 5s 2024-08-24T21:12:06.500 INFO:tasks.workunit.client.0.smithi179.stderr: 28450K .......... .......... .......... .......... .......... 16% 24.7M 5s 2024-08-24T21:12:06.501 INFO:tasks.workunit.client.0.smithi179.stderr: 28500K .......... .......... .......... .......... .......... 16% 36.6M 5s 2024-08-24T21:12:06.503 INFO:tasks.workunit.client.0.smithi179.stderr: 28550K .......... .......... .......... .......... .......... 16% 20.7M 5s 2024-08-24T21:12:06.505 INFO:tasks.workunit.client.0.smithi179.stderr: 28600K .......... .......... .......... .......... .......... 16% 21.5M 5s 2024-08-24T21:12:06.506 INFO:tasks.workunit.client.0.smithi179.stderr: 28650K .......... .......... .......... .......... .......... 17% 52.1M 5s 2024-08-24T21:12:06.508 INFO:tasks.workunit.client.0.smithi179.stderr: 28700K .......... .......... .......... .......... .......... 17% 24.6M 5s 2024-08-24T21:12:06.511 INFO:tasks.workunit.client.0.smithi179.stderr: 28750K .......... .......... .......... .......... .......... 17% 22.6M 5s 2024-08-24T21:12:06.513 INFO:tasks.workunit.client.0.smithi179.stderr: 28800K .......... .......... .......... .......... .......... 17% 30.3M 5s 2024-08-24T21:12:06.514 INFO:tasks.workunit.client.0.smithi179.stderr: 28850K .......... .......... .......... .......... .......... 17% 28.3M 5s 2024-08-24T21:12:06.515 INFO:tasks.workunit.client.0.smithi179.stderr: 28900K .......... .......... .......... .......... .......... 17% 45.8M 5s 2024-08-24T21:12:06.518 INFO:tasks.workunit.client.0.smithi179.stderr: 28950K .......... .......... .......... .......... .......... 17% 15.9M 5s 2024-08-24T21:12:06.519 INFO:tasks.workunit.client.0.smithi179.stderr: 29000K .......... .......... .......... .......... .......... 17% 37.0M 5s 2024-08-24T21:12:06.522 INFO:tasks.workunit.client.0.smithi179.stderr: 29050K .......... .......... .......... .......... .......... 17% 18.6M 5s 2024-08-24T21:12:06.525 INFO:tasks.workunit.client.0.smithi179.stderr: 29100K .......... .......... .......... .......... .......... 17% 17.6M 5s 2024-08-24T21:12:06.528 INFO:tasks.workunit.client.0.smithi179.stderr: 29150K .......... .......... .......... .......... .......... 17% 24.3M 5s 2024-08-24T21:12:06.528 INFO:tasks.workunit.client.0.smithi179.stderr: 29200K .......... .......... .......... .......... .......... 17% 47.9M 5s 2024-08-24T21:12:06.530 INFO:tasks.workunit.client.0.smithi179.stderr: 29250K .......... .......... .......... .......... .......... 17% 25.7M 5s 2024-08-24T21:12:06.531 INFO:tasks.workunit.client.0.smithi179.stderr: 29300K .......... .......... .......... .......... .......... 17% 36.6M 5s 2024-08-24T21:12:06.533 INFO:tasks.workunit.client.0.smithi179.stderr: 29350K .......... .......... .......... .......... .......... 17% 24.3M 5s 2024-08-24T21:12:06.534 INFO:tasks.workunit.client.0.smithi179.stderr: 29400K .......... .......... .......... .......... .......... 17% 49.5M 5s 2024-08-24T21:12:06.536 INFO:tasks.workunit.client.0.smithi179.stderr: 29450K .......... .......... .......... .......... .......... 17% 24.1M 5s 2024-08-24T21:12:06.537 INFO:tasks.workunit.client.0.smithi179.stderr: 29500K .......... .......... .......... .......... .......... 17% 37.1M 5s 2024-08-24T21:12:06.539 INFO:tasks.workunit.client.0.smithi179.stderr: 29550K .......... .......... .......... .......... .......... 17% 24.7M 5s 2024-08-24T21:12:06.541 INFO:tasks.workunit.client.0.smithi179.stderr: 29600K .......... .......... .......... .......... .......... 17% 24.4M 5s 2024-08-24T21:12:06.542 INFO:tasks.workunit.client.0.smithi179.stderr: 29650K .......... .......... .......... .......... .......... 17% 47.9M 5s 2024-08-24T21:12:06.544 INFO:tasks.workunit.client.0.smithi179.stderr: 29700K .......... .......... .......... .......... .......... 17% 24.5M 5s 2024-08-24T21:12:06.547 INFO:tasks.workunit.client.0.smithi179.stderr: 29750K .......... .......... .......... .......... .......... 17% 23.0M 5s 2024-08-24T21:12:06.548 INFO:tasks.workunit.client.0.smithi179.stderr: 29800K .......... .......... .......... .......... .......... 17% 27.1M 5s 2024-08-24T21:12:06.551 INFO:tasks.workunit.client.0.smithi179.stderr: 29850K .......... .......... .......... .......... .......... 17% 21.5M 5s 2024-08-24T21:12:06.552 INFO:tasks.workunit.client.0.smithi179.stderr: 29900K .......... .......... .......... .......... .......... 17% 55.4M 5s 2024-08-24T21:12:06.554 INFO:tasks.workunit.client.0.smithi179.stderr: 29950K .......... .......... .......... .......... .......... 17% 19.1M 5s 2024-08-24T21:12:06.556 INFO:tasks.workunit.client.0.smithi179.stderr: 30000K .......... .......... .......... .......... .......... 17% 23.2M 5s 2024-08-24T21:12:06.557 INFO:tasks.workunit.client.0.smithi179.stderr: 30050K .......... .......... .......... .......... .......... 17% 39.6M 5s 2024-08-24T21:12:06.559 INFO:tasks.workunit.client.0.smithi179.stderr: 30100K .......... .......... .......... .......... .......... 17% 23.6M 5s 2024-08-24T21:12:06.560 INFO:tasks.workunit.client.0.smithi179.stderr: 30150K .......... .......... .......... .......... .......... 17% 39.7M 5s 2024-08-24T21:12:06.562 INFO:tasks.workunit.client.0.smithi179.stderr: 30200K .......... .......... .......... .......... .......... 17% 26.0M 5s 2024-08-24T21:12:06.564 INFO:tasks.workunit.client.0.smithi179.stderr: 30250K .......... .......... .......... .......... .......... 17% 24.4M 5s 2024-08-24T21:12:06.567 INFO:tasks.workunit.client.0.smithi179.stderr: 30300K .......... .......... .......... .......... .......... 18% 21.4M 5s 2024-08-24T21:12:06.570 INFO:tasks.workunit.client.0.smithi179.stderr: 30350K .......... .......... .......... .......... .......... 18% 21.8M 5s 2024-08-24T21:12:06.571 INFO:tasks.workunit.client.0.smithi179.stderr: 30400K .......... .......... .......... .......... .......... 18% 26.8M 5s 2024-08-24T21:12:06.572 INFO:tasks.workunit.client.0.smithi179.stderr: 30450K .......... .......... .......... .......... .......... 18% 42.5M 5s 2024-08-24T21:12:06.574 INFO:tasks.workunit.client.0.smithi179.stderr: 30500K .......... .......... .......... .......... .......... 18% 25.3M 5s 2024-08-24T21:12:06.575 INFO:tasks.workunit.client.0.smithi179.stderr: 30550K .......... .......... .......... .......... .......... 18% 37.3M 5s 2024-08-24T21:12:06.578 INFO:tasks.workunit.client.0.smithi179.stderr: 30600K .......... .......... .......... .......... .......... 18% 19.2M 5s 2024-08-24T21:12:06.579 INFO:tasks.workunit.client.0.smithi179.stderr: 30650K .......... .......... .......... .......... .......... 18% 44.3M 5s 2024-08-24T21:12:06.581 INFO:tasks.workunit.client.0.smithi179.stderr: 30700K .......... .......... .......... .......... .......... 18% 21.5M 5s 2024-08-24T21:12:06.584 INFO:tasks.workunit.client.0.smithi179.stderr: 30750K .......... .......... .......... .......... .......... 18% 19.1M 5s 2024-08-24T21:12:06.585 INFO:tasks.workunit.client.0.smithi179.stderr: 30800K .......... .......... .......... .......... .......... 18% 38.1M 5s 2024-08-24T21:12:06.588 INFO:tasks.workunit.client.0.smithi179.stderr: 30850K .......... .......... .......... .......... .......... 18% 20.4M 5s 2024-08-24T21:12:06.589 INFO:tasks.workunit.client.0.smithi179.stderr: 30900K .......... .......... .......... .......... .......... 18% 28.6M 5s 2024-08-24T21:12:06.590 INFO:tasks.workunit.client.0.smithi179.stderr: 30950K .......... .......... .......... .......... .......... 18% 38.8M 5s 2024-08-24T21:12:06.593 INFO:tasks.workunit.client.0.smithi179.stderr: 31000K .......... .......... .......... .......... .......... 18% 20.4M 5s 2024-08-24T21:12:06.594 INFO:tasks.workunit.client.0.smithi179.stderr: 31050K .......... .......... .......... .......... .......... 18% 41.6M 5s 2024-08-24T21:12:06.596 INFO:tasks.workunit.client.0.smithi179.stderr: 31100K .......... .......... .......... .......... .......... 18% 24.4M 5s 2024-08-24T21:12:06.599 INFO:tasks.workunit.client.0.smithi179.stderr: 31150K .......... .......... .......... .......... .......... 18% 18.4M 5s 2024-08-24T21:12:06.600 INFO:tasks.workunit.client.0.smithi179.stderr: 31200K .......... .......... .......... .......... .......... 18% 45.2M 5s 2024-08-24T21:12:06.602 INFO:tasks.workunit.client.0.smithi179.stderr: 31250K .......... .......... .......... .......... .......... 18% 26.2M 5s 2024-08-24T21:12:06.603 INFO:tasks.workunit.client.0.smithi179.stderr: 31300K .......... .......... .......... .......... .......... 18% 37.6M 5s 2024-08-24T21:12:06.605 INFO:tasks.workunit.client.0.smithi179.stderr: 31350K .......... .......... .......... .......... .......... 18% 22.9M 5s 2024-08-24T21:12:06.608 INFO:tasks.workunit.client.0.smithi179.stderr: 31400K .......... .......... .......... .......... .......... 18% 21.9M 5s 2024-08-24T21:12:06.608 INFO:tasks.workunit.client.0.smithi179.stderr: 31450K .......... .......... .......... .......... .......... 18% 80.6M 5s 2024-08-24T21:12:06.610 INFO:tasks.workunit.client.0.smithi179.stderr: 31500K .......... .......... .......... .......... .......... 18% 28.5M 5s 2024-08-24T21:12:06.612 INFO:tasks.workunit.client.0.smithi179.stderr: 31550K .......... .......... .......... .......... .......... 18% 22.1M 5s 2024-08-24T21:12:06.614 INFO:tasks.workunit.client.0.smithi179.stderr: 31600K .......... .......... .......... .......... .......... 18% 22.5M 5s 2024-08-24T21:12:06.616 INFO:tasks.workunit.client.0.smithi179.stderr: 31650K .......... .......... .......... .......... .......... 18% 22.5M 5s 2024-08-24T21:12:06.617 INFO:tasks.workunit.client.0.smithi179.stderr: 31700K .......... .......... .......... .......... .......... 18% 34.1M 5s 2024-08-24T21:12:06.619 INFO:tasks.workunit.client.0.smithi179.stderr: 31750K .......... .......... .......... .......... .......... 18% 21.7M 5s 2024-08-24T21:12:06.621 INFO:tasks.workunit.client.0.smithi179.stderr: 31800K .......... .......... .......... .......... .......... 18% 30.9M 5s 2024-08-24T21:12:06.624 INFO:tasks.workunit.client.0.smithi179.stderr: 31850K .......... .......... .......... .......... .......... 18% 22.8M 5s 2024-08-24T21:12:06.624 INFO:tasks.workunit.client.0.smithi179.stderr: 31900K .......... .......... .......... .......... .......... 18% 56.9M 5s 2024-08-24T21:12:06.628 INFO:tasks.workunit.client.0.smithi179.stderr: 31950K .......... .......... .......... .......... .......... 18% 15.2M 5s 2024-08-24T21:12:06.628 INFO:tasks.workunit.client.0.smithi179.stderr: 32000K .......... .......... .......... .......... .......... 19% 49.8M 5s 2024-08-24T21:12:06.630 INFO:tasks.workunit.client.0.smithi179.stderr: 32050K .......... .......... .......... .......... .......... 19% 24.5M 5s 2024-08-24T21:12:06.632 INFO:tasks.workunit.client.0.smithi179.stderr: 32100K .......... .......... .......... .......... .......... 19% 35.8M 5s 2024-08-24T21:12:06.635 INFO:tasks.workunit.client.0.smithi179.stderr: 32150K .......... .......... .......... .......... .......... 19% 19.6M 5s 2024-08-24T21:12:06.635 INFO:tasks.workunit.client.0.smithi179.stderr: 32200K .......... .......... .......... .......... .......... 19% 69.1M 5s 2024-08-24T21:12:06.637 INFO:tasks.workunit.client.0.smithi179.stderr: 32250K .......... .......... .......... .......... .......... 19% 21.7M 5s 2024-08-24T21:12:06.639 INFO:tasks.workunit.client.0.smithi179.stderr: 32300K .......... .......... .......... .......... .......... 19% 32.9M 5s 2024-08-24T21:12:06.640 INFO:tasks.workunit.client.0.smithi179.stderr: 32350K .......... .......... .......... .......... .......... 19% 27.3M 5s 2024-08-24T21:12:06.644 INFO:tasks.workunit.client.0.smithi179.stderr: 32400K .......... .......... .......... .......... .......... 19% 21.5M 5s 2024-08-24T21:12:06.644 INFO:tasks.workunit.client.0.smithi179.stderr: 32450K .......... .......... .......... .......... .......... 19% 52.1M 5s 2024-08-24T21:12:06.646 INFO:tasks.workunit.client.0.smithi179.stderr: 32500K .......... .......... .......... .......... .......... 19% 22.3M 5s 2024-08-24T21:12:06.648 INFO:tasks.workunit.client.0.smithi179.stderr: 32550K .......... .......... .......... .......... .......... 19% 32.1M 5s 2024-08-24T21:12:06.650 INFO:tasks.workunit.client.0.smithi179.stderr: 32600K .......... .......... .......... .......... .......... 19% 18.2M 5s 2024-08-24T21:12:06.652 INFO:tasks.workunit.client.0.smithi179.stderr: 32650K .......... .......... .......... .......... .......... 19% 26.7M 5s 2024-08-24T21:12:06.653 INFO:tasks.workunit.client.0.smithi179.stderr: 32700K .......... .......... .......... .......... .......... 19% 31.5M 5s 2024-08-24T21:12:06.656 INFO:tasks.workunit.client.0.smithi179.stderr: 32750K .......... .......... .......... .......... .......... 19% 25.0M 5s 2024-08-24T21:12:06.659 INFO:tasks.workunit.client.0.smithi179.stderr: 32800K .......... .......... .......... .......... .......... 19% 18.7M 5s 2024-08-24T21:12:06.659 INFO:tasks.workunit.client.0.smithi179.stderr: 32850K .......... .......... .......... .......... .......... 19% 45.7M 5s 2024-08-24T21:12:06.662 INFO:tasks.workunit.client.0.smithi179.stderr: 32900K .......... .......... .......... .......... .......... 19% 15.9M 5s 2024-08-24T21:12:06.664 INFO:tasks.workunit.client.0.smithi179.stderr: 32950K .......... .......... .......... .......... .......... 19% 31.4M 5s 2024-08-24T21:12:06.666 INFO:tasks.workunit.client.0.smithi179.stderr: 33000K .......... .......... .......... .......... .......... 19% 27.7M 5s 2024-08-24T21:12:06.667 INFO:tasks.workunit.client.0.smithi179.stderr: 33050K .......... .......... .......... .......... .......... 19% 34.3M 5s 2024-08-24T21:12:06.670 INFO:tasks.workunit.client.0.smithi179.stderr: 33100K .......... .......... .......... .......... .......... 19% 19.3M 5s 2024-08-24T21:12:06.671 INFO:tasks.workunit.client.0.smithi179.stderr: 33150K .......... .......... .......... .......... .......... 19% 26.7M 5s 2024-08-24T21:12:06.673 INFO:tasks.workunit.client.0.smithi179.stderr: 33200K .......... .......... .......... .......... .......... 19% 24.3M 5s 2024-08-24T21:12:06.675 INFO:tasks.workunit.client.0.smithi179.stderr: 33250K .......... .......... .......... .......... .......... 19% 41.2M 5s 2024-08-24T21:12:06.676 INFO:tasks.workunit.client.0.smithi179.stderr: 33300K .......... .......... .......... .......... .......... 19% 28.2M 5s 2024-08-24T21:12:06.678 INFO:tasks.workunit.client.0.smithi179.stderr: 33350K .......... .......... .......... .......... .......... 19% 33.1M 5s 2024-08-24T21:12:06.679 INFO:tasks.workunit.client.0.smithi179.stderr: 33400K .......... .......... .......... .......... .......... 19% 27.7M 5s 2024-08-24T21:12:06.681 INFO:tasks.workunit.client.0.smithi179.stderr: 33450K .......... .......... .......... .......... .......... 19% 42.6M 5s 2024-08-24T21:12:06.683 INFO:tasks.workunit.client.0.smithi179.stderr: 33500K .......... .......... .......... .......... .......... 19% 22.2M 5s 2024-08-24T21:12:06.686 INFO:tasks.workunit.client.0.smithi179.stderr: 33550K .......... .......... .......... .......... .......... 19% 23.1M 5s 2024-08-24T21:12:06.686 INFO:tasks.workunit.client.0.smithi179.stderr: 33600K .......... .......... .......... .......... .......... 19% 50.0M 5s 2024-08-24T21:12:06.689 INFO:tasks.workunit.client.0.smithi179.stderr: 33650K .......... .......... .......... .......... .......... 19% 23.0M 5s 2024-08-24T21:12:06.691 INFO:tasks.workunit.client.0.smithi179.stderr: 33700K .......... .......... .......... .......... .......... 20% 24.3M 5s 2024-08-24T21:12:06.691 INFO:tasks.workunit.client.0.smithi179.stderr: 33750K .......... .......... .......... .......... .......... 20% 43.3M 5s 2024-08-24T21:12:06.693 INFO:tasks.workunit.client.0.smithi179.stderr: 33800K .......... .......... .......... .......... .......... 20% 24.3M 5s 2024-08-24T21:12:06.694 INFO:tasks.workunit.client.0.smithi179.stderr: 33850K .......... .......... .......... .......... .......... 20% 40.6M 5s 2024-08-24T21:12:06.696 INFO:tasks.workunit.client.0.smithi179.stderr: 33900K .......... .......... .......... .......... .......... 20% 24.7M 5s 2024-08-24T21:12:06.698 INFO:tasks.workunit.client.0.smithi179.stderr: 33950K .......... .......... .......... .......... .......... 20% 24.0M 5s 2024-08-24T21:12:06.699 INFO:tasks.workunit.client.0.smithi179.stderr: 34000K .......... .......... .......... .......... .......... 20% 43.5M 5s 2024-08-24T21:12:06.702 INFO:tasks.workunit.client.0.smithi179.stderr: 34050K .......... .......... .......... .......... .......... 20% 25.4M 5s 2024-08-24T21:12:06.703 INFO:tasks.workunit.client.0.smithi179.stderr: 34100K .......... .......... .......... .......... .......... 20% 37.9M 5s 2024-08-24T21:12:06.705 INFO:tasks.workunit.client.0.smithi179.stderr: 34150K .......... .......... .......... .......... .......... 20% 21.7M 5s 2024-08-24T21:12:06.708 INFO:tasks.workunit.client.0.smithi179.stderr: 34200K .......... .......... .......... .......... .......... 20% 23.4M 5s 2024-08-24T21:12:06.708 INFO:tasks.workunit.client.0.smithi179.stderr: 34250K .......... .......... .......... .......... .......... 20% 64.7M 5s 2024-08-24T21:12:06.710 INFO:tasks.workunit.client.0.smithi179.stderr: 34300K .......... .......... .......... .......... .......... 20% 23.9M 5s 2024-08-24T21:12:06.712 INFO:tasks.workunit.client.0.smithi179.stderr: 34350K .......... .......... .......... .......... .......... 20% 23.9M 5s 2024-08-24T21:12:06.713 INFO:tasks.workunit.client.0.smithi179.stderr: 34400K .......... .......... .......... .......... .......... 20% 37.1M 5s 2024-08-24T21:12:06.716 INFO:tasks.workunit.client.0.smithi179.stderr: 34450K .......... .......... .......... .......... .......... 20% 22.8M 5s 2024-08-24T21:12:06.716 INFO:tasks.workunit.client.0.smithi179.stderr: 34500K .......... .......... .......... .......... .......... 20% 51.7M 5s 2024-08-24T21:12:06.718 INFO:tasks.workunit.client.0.smithi179.stderr: 34550K .......... .......... .......... .......... .......... 20% 23.2M 5s 2024-08-24T21:12:06.719 INFO:tasks.workunit.client.0.smithi179.stderr: 34600K .......... .......... .......... .......... .......... 20% 39.3M 5s 2024-08-24T21:12:06.722 INFO:tasks.workunit.client.0.smithi179.stderr: 34650K .......... .......... .......... .......... .......... 20% 21.6M 5s 2024-08-24T21:12:06.723 INFO:tasks.workunit.client.0.smithi179.stderr: 34700K .......... .......... .......... .......... .......... 20% 49.7M 5s 2024-08-24T21:12:06.727 INFO:tasks.workunit.client.0.smithi179.stderr: 34750K .......... .......... .......... .......... .......... 20% 14.9M 5s 2024-08-24T21:12:06.727 INFO:tasks.workunit.client.0.smithi179.stderr: 34800K .......... .......... .......... .......... .......... 20% 56.6M 5s 2024-08-24T21:12:06.729 INFO:tasks.workunit.client.0.smithi179.stderr: 34850K .......... .......... .......... .......... .......... 20% 22.8M 5s 2024-08-24T21:12:06.733 INFO:tasks.workunit.client.0.smithi179.stderr: 34900K .......... .......... .......... .......... .......... 20% 12.1M 5s 2024-08-24T21:12:06.735 INFO:tasks.workunit.client.0.smithi179.stderr: 34950K .......... .......... .......... .......... .......... 20% 23.6M 5s 2024-08-24T21:12:06.737 INFO:tasks.workunit.client.0.smithi179.stderr: 35000K .......... .......... .......... .......... .......... 20% 21.4M 5s 2024-08-24T21:12:06.740 INFO:tasks.workunit.client.0.smithi179.stderr: 35050K .......... .......... .......... .......... .......... 20% 21.2M 5s 2024-08-24T21:12:06.741 INFO:tasks.workunit.client.0.smithi179.stderr: 35100K .......... .......... .......... .......... .......... 20% 42.1M 5s 2024-08-24T21:12:06.743 INFO:tasks.workunit.client.0.smithi179.stderr: 35150K .......... .......... .......... .......... .......... 20% 19.9M 5s 2024-08-24T21:12:06.745 INFO:tasks.workunit.client.0.smithi179.stderr: 35200K .......... .......... .......... .......... .......... 20% 25.1M 5s 2024-08-24T21:12:06.746 INFO:tasks.workunit.client.0.smithi179.stderr: 35250K .......... .......... .......... .......... .......... 20% 44.5M 5s 2024-08-24T21:12:06.749 INFO:tasks.workunit.client.0.smithi179.stderr: 35300K .......... .......... .......... .......... .......... 20% 23.3M 5s 2024-08-24T21:12:06.750 INFO:tasks.workunit.client.0.smithi179.stderr: 35350K .......... .......... .......... .......... .......... 21% 41.8M 5s 2024-08-24T21:12:06.752 INFO:tasks.workunit.client.0.smithi179.stderr: 35400K .......... .......... .......... .......... .......... 21% 23.5M 5s 2024-08-24T21:12:06.753 INFO:tasks.workunit.client.0.smithi179.stderr: 35450K .......... .......... .......... .......... .......... 21% 35.2M 5s 2024-08-24T21:12:06.755 INFO:tasks.workunit.client.0.smithi179.stderr: 35500K .......... .......... .......... .......... .......... 21% 33.4M 5s 2024-08-24T21:12:06.757 INFO:tasks.workunit.client.0.smithi179.stderr: 35550K .......... .......... .......... .......... .......... 21% 21.4M 5s 2024-08-24T21:12:06.759 INFO:tasks.workunit.client.0.smithi179.stderr: 35600K .......... .......... .......... .......... .......... 21% 24.2M 5s 2024-08-24T21:12:06.760 INFO:tasks.workunit.client.0.smithi179.stderr: 35650K .......... .......... .......... .......... .......... 21% 41.4M 5s 2024-08-24T21:12:06.762 INFO:tasks.workunit.client.0.smithi179.stderr: 35700K .......... .......... .......... .......... .......... 21% 23.7M 5s 2024-08-24T21:12:06.763 INFO:tasks.workunit.client.0.smithi179.stderr: 35750K .......... .......... .......... .......... .......... 21% 45.8M 5s 2024-08-24T21:12:06.765 INFO:tasks.workunit.client.0.smithi179.stderr: 35800K .......... .......... .......... .......... .......... 21% 25.5M 5s 2024-08-24T21:12:06.767 INFO:tasks.workunit.client.0.smithi179.stderr: 35850K .......... .......... .......... .......... .......... 21% 33.5M 5s 2024-08-24T21:12:06.769 INFO:tasks.workunit.client.0.smithi179.stderr: 35900K .......... .......... .......... .......... .......... 21% 24.1M 5s 2024-08-24T21:12:06.771 INFO:tasks.workunit.client.0.smithi179.stderr: 35950K .......... .......... .......... .......... .......... 21% 25.2M 5s 2024-08-24T21:12:06.773 INFO:tasks.workunit.client.0.smithi179.stderr: 36000K .......... .......... .......... .......... .......... 21% 24.1M 5s 2024-08-24T21:12:06.774 INFO:tasks.workunit.client.0.smithi179.stderr: 36050K .......... .......... .......... .......... .......... 21% 45.5M 5s 2024-08-24T21:12:06.776 INFO:tasks.workunit.client.0.smithi179.stderr: 36100K .......... .......... .......... .......... .......... 21% 24.2M 5s 2024-08-24T21:12:06.777 INFO:tasks.workunit.client.0.smithi179.stderr: 36150K .......... .......... .......... .......... .......... 21% 39.2M 5s 2024-08-24T21:12:06.780 INFO:tasks.workunit.client.0.smithi179.stderr: 36200K .......... .......... .......... .......... .......... 21% 22.4M 5s 2024-08-24T21:12:06.780 INFO:tasks.workunit.client.0.smithi179.stderr: 36250K .......... .......... .......... .......... .......... 21% 53.0M 5s 2024-08-24T21:12:06.782 INFO:tasks.workunit.client.0.smithi179.stderr: 36300K .......... .......... .......... .......... .......... 21% 23.5M 5s 2024-08-24T21:12:06.784 INFO:tasks.workunit.client.0.smithi179.stderr: 36350K .......... .......... .......... .......... .......... 21% 24.5M 5s 2024-08-24T21:12:06.786 INFO:tasks.workunit.client.0.smithi179.stderr: 36400K .......... .......... .......... .......... .......... 21% 35.1M 5s 2024-08-24T21:12:06.788 INFO:tasks.workunit.client.0.smithi179.stderr: 36450K .......... .......... .......... .......... .......... 21% 21.9M 5s 2024-08-24T21:12:06.790 INFO:tasks.workunit.client.0.smithi179.stderr: 36500K .......... .......... .......... .......... .......... 21% 22.3M 5s 2024-08-24T21:12:06.791 INFO:tasks.workunit.client.0.smithi179.stderr: 36550K .......... .......... .......... .......... .......... 21% 37.5M 5s 2024-08-24T21:12:06.975 INFO:tasks.workunit.client.0.smithi179.stderr: 36600K .......... .......... .......... .......... .......... 21% 599K 5s 2024-08-24T21:12:06.975 INFO:tasks.workunit.client.0.smithi179.stderr: 36650K .......... .......... .......... .......... .......... 21% 167M 5s 2024-08-24T21:12:06.975 INFO:tasks.workunit.client.0.smithi179.stderr: 36700K .......... .......... .......... .......... .......... 21% 40.1M 5s 2024-08-24T21:12:06.975 INFO:tasks.workunit.client.0.smithi179.stderr: 36750K .......... .......... .......... .......... .......... 21% 144M 5s 2024-08-24T21:12:06.976 INFO:tasks.workunit.client.0.smithi179.stderr: 36800K .......... .......... .......... .......... .......... 21% 152M 5s 2024-08-24T21:12:06.976 INFO:tasks.workunit.client.0.smithi179.stderr: 36850K .......... .......... .......... .......... .......... 21% 166M 5s 2024-08-24T21:12:06.976 INFO:tasks.workunit.client.0.smithi179.stderr: 36900K .......... .......... .......... .......... .......... 21% 160M 5s 2024-08-24T21:12:06.976 INFO:tasks.workunit.client.0.smithi179.stderr: 36950K .......... .......... .......... .......... .......... 21% 155M 5s 2024-08-24T21:12:06.976 INFO:tasks.workunit.client.0.smithi179.stderr: 37000K .......... .......... .......... .......... .......... 21% 151M 5s 2024-08-24T21:12:06.976 INFO:tasks.workunit.client.0.smithi179.stderr: 37050K .......... .......... .......... .......... .......... 22% 170M 5s 2024-08-24T21:12:06.976 INFO:tasks.workunit.client.0.smithi179.stderr: 37100K .......... .......... .......... .......... .......... 22% 174M 5s 2024-08-24T21:12:06.976 INFO:tasks.workunit.client.0.smithi179.stderr: 37150K .......... .......... .......... .......... .......... 22% 154M 5s 2024-08-24T21:12:06.976 INFO:tasks.workunit.client.0.smithi179.stderr: 37200K .......... .......... .......... .......... .......... 22% 154M 5s 2024-08-24T21:12:06.976 INFO:tasks.workunit.client.0.smithi179.stderr: 37250K .......... .......... .......... .......... .......... 22% 163M 5s 2024-08-24T21:12:06.977 INFO:tasks.workunit.client.0.smithi179.stderr: 37300K .......... .......... .......... .......... .......... 22% 176M 5s 2024-08-24T21:12:06.977 INFO:tasks.workunit.client.0.smithi179.stderr: 37350K .......... .......... .......... .......... .......... 22% 141M 5s 2024-08-24T21:12:06.977 INFO:tasks.workunit.client.0.smithi179.stderr: 37400K .......... .......... .......... .......... .......... 22% 173M 5s 2024-08-24T21:12:06.977 INFO:tasks.workunit.client.0.smithi179.stderr: 37450K .......... .......... .......... .......... .......... 22% 156M 5s 2024-08-24T21:12:06.977 INFO:tasks.workunit.client.0.smithi179.stderr: 37500K .......... .......... .......... .......... .......... 22% 168M 5s 2024-08-24T21:12:06.977 INFO:tasks.workunit.client.0.smithi179.stderr: 37550K .......... .......... .......... .......... .......... 22% 143M 5s 2024-08-24T21:12:06.977 INFO:tasks.workunit.client.0.smithi179.stderr: 37600K .......... .......... .......... .......... .......... 22% 146M 5s 2024-08-24T21:12:06.977 INFO:tasks.workunit.client.0.smithi179.stderr: 37650K .......... .......... .......... .......... .......... 22% 126M 5s 2024-08-24T21:12:06.977 INFO:tasks.workunit.client.0.smithi179.stderr: 37700K .......... .......... .......... .......... .......... 22% 157M 5s 2024-08-24T21:12:06.977 INFO:tasks.workunit.client.0.smithi179.stderr: 37750K .......... .......... .......... .......... .......... 22% 153M 5s 2024-08-24T21:12:06.977 INFO:tasks.workunit.client.0.smithi179.stderr: 37800K .......... .......... .......... .......... .......... 22% 154M 5s 2024-08-24T21:12:06.978 INFO:tasks.workunit.client.0.smithi179.stderr: 37850K .......... .......... .......... .......... .......... 22% 173M 5s 2024-08-24T21:12:06.978 INFO:tasks.workunit.client.0.smithi179.stderr: 37900K .......... .......... .......... .......... .......... 22% 124M 5s 2024-08-24T21:12:06.978 INFO:tasks.workunit.client.0.smithi179.stderr: 37950K .......... .......... .......... .......... .......... 22% 129M 5s 2024-08-24T21:12:06.978 INFO:tasks.workunit.client.0.smithi179.stderr: 38000K .......... .......... .......... .......... .......... 22% 166M 5s 2024-08-24T21:12:06.978 INFO:tasks.workunit.client.0.smithi179.stderr: 38050K .......... .......... .......... .......... .......... 22% 172M 5s 2024-08-24T21:12:06.978 INFO:tasks.workunit.client.0.smithi179.stderr: 38100K .......... .......... .......... .......... .......... 22% 178M 5s 2024-08-24T21:12:06.978 INFO:tasks.workunit.client.0.smithi179.stderr: 38150K .......... .......... .......... .......... .......... 22% 121M 5s 2024-08-24T21:12:06.978 INFO:tasks.workunit.client.0.smithi179.stderr: 38200K .......... .......... .......... .......... .......... 22% 152M 5s 2024-08-24T21:12:06.978 INFO:tasks.workunit.client.0.smithi179.stderr: 38250K .......... .......... .......... .......... .......... 22% 145M 5s 2024-08-24T21:12:06.978 INFO:tasks.workunit.client.0.smithi179.stderr: 38300K .......... .......... .......... .......... .......... 22% 149M 5s 2024-08-24T21:12:06.978 INFO:tasks.workunit.client.0.smithi179.stderr: 38350K .......... .......... .......... .......... .......... 22% 149M 5s 2024-08-24T21:12:06.978 INFO:tasks.workunit.client.0.smithi179.stderr: 38400K .......... .......... .......... .......... .......... 22% 140M 5s 2024-08-24T21:12:06.978 INFO:tasks.workunit.client.0.smithi179.stderr: 38450K .......... .......... .......... .......... .......... 22% 169M 5s 2024-08-24T21:12:06.979 INFO:tasks.workunit.client.0.smithi179.stderr: 38500K .......... .......... .......... .......... .......... 22% 161M 5s 2024-08-24T21:12:06.979 INFO:tasks.workunit.client.0.smithi179.stderr: 38550K .......... .......... .......... .......... .......... 22% 138M 5s 2024-08-24T21:12:06.979 INFO:tasks.workunit.client.0.smithi179.stderr: 38600K .......... .......... .......... .......... .......... 22% 171M 5s 2024-08-24T21:12:06.979 INFO:tasks.workunit.client.0.smithi179.stderr: 38650K .......... .......... .......... .......... .......... 22% 158M 5s 2024-08-24T21:12:06.979 INFO:tasks.workunit.client.0.smithi179.stderr: 38700K .......... .......... .......... .......... .......... 22% 177M 5s 2024-08-24T21:12:06.979 INFO:tasks.workunit.client.0.smithi179.stderr: 38750K .......... .......... .......... .......... .......... 23% 139M 5s 2024-08-24T21:12:06.979 INFO:tasks.workunit.client.0.smithi179.stderr: 38800K .......... .......... .......... .......... .......... 23% 153M 5s 2024-08-24T21:12:06.979 INFO:tasks.workunit.client.0.smithi179.stderr: 38850K .......... .......... .......... .......... .......... 23% 170M 5s 2024-08-24T21:12:06.979 INFO:tasks.workunit.client.0.smithi179.stderr: 38900K .......... .......... .......... .......... .......... 23% 163M 5s 2024-08-24T21:12:06.979 INFO:tasks.workunit.client.0.smithi179.stderr: 38950K .......... .......... .......... .......... .......... 23% 146M 5s 2024-08-24T21:12:06.979 INFO:tasks.workunit.client.0.smithi179.stderr: 39000K .......... .......... .......... .......... .......... 23% 177M 5s 2024-08-24T21:12:06.979 INFO:tasks.workunit.client.0.smithi179.stderr: 39050K .......... .......... .......... .......... .......... 23% 142M 5s 2024-08-24T21:12:06.980 INFO:tasks.workunit.client.0.smithi179.stderr: 39100K .......... .......... .......... .......... .......... 23% 164M 5s 2024-08-24T21:12:06.980 INFO:tasks.workunit.client.0.smithi179.stderr: 39150K .......... .......... .......... .......... .......... 23% 135M 5s 2024-08-24T21:12:06.980 INFO:tasks.workunit.client.0.smithi179.stderr: 39200K .......... .......... .......... .......... .......... 23% 163M 5s 2024-08-24T21:12:06.980 INFO:tasks.workunit.client.0.smithi179.stderr: 39250K .......... .......... .......... .......... .......... 23% 168M 5s 2024-08-24T21:12:06.980 INFO:tasks.workunit.client.0.smithi179.stderr: 39300K .......... .......... .......... .......... .......... 23% 166M 5s 2024-08-24T21:12:06.980 INFO:tasks.workunit.client.0.smithi179.stderr: 39350K .......... .......... .......... .......... .......... 23% 160M 5s 2024-08-24T21:12:06.980 INFO:tasks.workunit.client.0.smithi179.stderr: 39400K .......... .......... .......... .......... .......... 23% 155M 5s 2024-08-24T21:12:06.980 INFO:tasks.workunit.client.0.smithi179.stderr: 39450K .......... .......... .......... .......... .......... 23% 166M 5s 2024-08-24T21:12:06.980 INFO:tasks.workunit.client.0.smithi179.stderr: 39500K .......... .......... .......... .......... .......... 23% 44.1M 5s 2024-08-24T21:12:06.980 INFO:tasks.workunit.client.0.smithi179.stderr: 39550K .......... .......... .......... .......... .......... 23% 4.64M 5s 2024-08-24T21:12:06.980 INFO:tasks.workunit.client.0.smithi179.stderr: 39600K .......... .......... .......... .......... .......... 23% 29.8M 5s 2024-08-24T21:12:06.980 INFO:tasks.workunit.client.0.smithi179.stderr: 39650K .......... .......... .......... .......... .......... 23% 30.7M 5s 2024-08-24T21:12:06.980 INFO:tasks.workunit.client.0.smithi179.stderr: 39700K .......... .......... .......... .......... .......... 23% 29.6M 5s 2024-08-24T21:12:06.980 INFO:tasks.workunit.client.0.smithi179.stderr: 39750K .......... .......... .......... .......... .......... 23% 30.3M 5s 2024-08-24T21:12:06.981 INFO:tasks.workunit.client.0.smithi179.stderr: 39800K .......... .......... .......... .......... .......... 23% 25.9M 5s 2024-08-24T21:12:06.981 INFO:tasks.workunit.client.0.smithi179.stderr: 39850K .......... .......... .......... .......... .......... 23% 33.8M 5s 2024-08-24T21:12:06.981 INFO:tasks.workunit.client.0.smithi179.stderr: 39900K .......... .......... .......... .......... .......... 23% 26.3M 5s 2024-08-24T21:12:06.981 INFO:tasks.workunit.client.0.smithi179.stderr: 39950K .......... .......... .......... .......... .......... 23% 27.1M 5s 2024-08-24T21:12:06.981 INFO:tasks.workunit.client.0.smithi179.stderr: 40000K .......... .......... .......... .......... .......... 23% 28.8M 5s 2024-08-24T21:12:06.981 INFO:tasks.workunit.client.0.smithi179.stderr: 40050K .......... .......... .......... .......... .......... 23% 30.9M 5s 2024-08-24T21:12:06.981 INFO:tasks.workunit.client.0.smithi179.stderr: 40100K .......... .......... .......... .......... .......... 23% 30.0M 5s 2024-08-24T21:12:06.981 INFO:tasks.workunit.client.0.smithi179.stderr: 40150K .......... .......... .......... .......... .......... 23% 28.8M 5s 2024-08-24T21:12:06.981 INFO:tasks.workunit.client.0.smithi179.stderr: 40200K .......... .......... .......... .......... .......... 23% 33.2M 5s 2024-08-24T21:12:06.981 INFO:tasks.workunit.client.0.smithi179.stderr: 40250K .......... .......... .......... .......... .......... 23% 29.5M 5s 2024-08-24T21:12:06.981 INFO:tasks.workunit.client.0.smithi179.stderr: 40300K .......... .......... .......... .......... .......... 23% 29.8M 5s 2024-08-24T21:12:06.981 INFO:tasks.workunit.client.0.smithi179.stderr: 40350K .......... .......... .......... .......... .......... 23% 14.9M 5s 2024-08-24T21:12:06.981 INFO:tasks.workunit.client.0.smithi179.stderr: 40400K .......... .......... .......... .......... .......... 23% 38.6M 5s 2024-08-24T21:12:06.982 INFO:tasks.workunit.client.0.smithi179.stderr: 40450K .......... .......... .......... .......... .......... 24% 30.0M 5s 2024-08-24T21:12:06.982 INFO:tasks.workunit.client.0.smithi179.stderr: 40500K .......... .......... .......... .......... .......... 24% 24.8M 5s 2024-08-24T21:12:06.982 INFO:tasks.workunit.client.0.smithi179.stderr: 40550K .......... .......... .......... .......... .......... 24% 28.9M 5s 2024-08-24T21:12:06.982 INFO:tasks.workunit.client.0.smithi179.stderr: 40600K .......... .......... .......... .......... .......... 24% 34.5M 5s 2024-08-24T21:12:06.982 INFO:tasks.workunit.client.0.smithi179.stderr: 40650K .......... .......... .......... .......... .......... 24% 26.0M 5s 2024-08-24T21:12:06.982 INFO:tasks.workunit.client.0.smithi179.stderr: 40700K .......... .......... .......... .......... .......... 24% 38.0M 5s 2024-08-24T21:12:06.982 INFO:tasks.workunit.client.0.smithi179.stderr: 40750K .......... .......... .......... .......... .......... 24% 21.2M 5s 2024-08-24T21:12:06.982 INFO:tasks.workunit.client.0.smithi179.stderr: 40800K .......... .......... .......... .......... .......... 24% 35.8M 5s 2024-08-24T21:12:06.982 INFO:tasks.workunit.client.0.smithi179.stderr: 40850K .......... .......... .......... .......... .......... 24% 35.1M 5s 2024-08-24T21:12:06.982 INFO:tasks.workunit.client.0.smithi179.stderr: 40900K .......... .......... .......... .......... .......... 24% 28.9M 5s 2024-08-24T21:12:06.982 INFO:tasks.workunit.client.0.smithi179.stderr: 40950K .......... .......... .......... .......... .......... 24% 19.0M 5s 2024-08-24T21:12:06.982 INFO:tasks.workunit.client.0.smithi179.stderr: 41000K .......... .......... .......... .......... .......... 24% 32.1M 5s 2024-08-24T21:12:06.982 INFO:tasks.workunit.client.0.smithi179.stderr: 41050K .......... .......... .......... .......... .......... 24% 24.2M 5s 2024-08-24T21:12:06.983 INFO:tasks.workunit.client.0.smithi179.stderr: 41100K .......... .......... .......... .......... .......... 24% 58.3M 5s 2024-08-24T21:12:06.983 INFO:tasks.workunit.client.0.smithi179.stderr: 41150K .......... .......... .......... .......... .......... 24% 24.4M 5s 2024-08-24T21:12:06.983 INFO:tasks.workunit.client.0.smithi179.stderr: 41200K .......... .......... .......... .......... .......... 24% 23.5M 5s 2024-08-24T21:12:06.983 INFO:tasks.workunit.client.0.smithi179.stderr: 41250K .......... .......... .......... .......... .......... 24% 47.2M 5s 2024-08-24T21:12:06.983 INFO:tasks.workunit.client.0.smithi179.stderr: 41300K .......... .......... .......... .......... .......... 24% 22.3M 5s 2024-08-24T21:12:06.983 INFO:tasks.workunit.client.0.smithi179.stderr: 41350K .......... .......... .......... .......... .......... 24% 51.5M 5s 2024-08-24T21:12:06.983 INFO:tasks.workunit.client.0.smithi179.stderr: 41400K .......... .......... .......... .......... .......... 24% 23.9M 5s 2024-08-24T21:12:06.983 INFO:tasks.workunit.client.0.smithi179.stderr: 41450K .......... .......... .......... .......... .......... 24% 32.4M 5s 2024-08-24T21:12:06.983 INFO:tasks.workunit.client.0.smithi179.stderr: 41500K .......... .......... .......... .......... .......... 24% 26.0M 5s 2024-08-24T21:12:06.983 INFO:tasks.workunit.client.0.smithi179.stderr: 41550K .......... .......... .......... .......... .......... 24% 24.9M 5s 2024-08-24T21:12:06.993 INFO:tasks.workunit.client.0.smithi179.stderr: 41600K .......... .......... .......... .......... .......... 24% 24.2M 5s 2024-08-24T21:12:06.993 INFO:tasks.workunit.client.0.smithi179.stderr: 41650K .......... .......... .......... .......... .......... 24% 48.9M 5s 2024-08-24T21:12:06.993 INFO:tasks.workunit.client.0.smithi179.stderr: 41700K .......... .......... .......... .......... .......... 24% 26.5M 5s 2024-08-24T21:12:06.993 INFO:tasks.workunit.client.0.smithi179.stderr: 41750K .......... .......... .......... .......... .......... 24% 34.5M 5s 2024-08-24T21:12:06.994 INFO:tasks.workunit.client.0.smithi179.stderr: 41800K .......... .......... .......... .......... .......... 24% 24.1M 5s 2024-08-24T21:12:06.994 INFO:tasks.workunit.client.0.smithi179.stderr: 41850K .......... .......... .......... .......... .......... 24% 42.1M 5s 2024-08-24T21:12:06.994 INFO:tasks.workunit.client.0.smithi179.stderr: 41900K .......... .......... .......... .......... .......... 24% 28.9M 5s 2024-08-24T21:12:06.994 INFO:tasks.workunit.client.0.smithi179.stderr: 41950K .......... .......... .......... .......... .......... 24% 21.7M 5s 2024-08-24T21:12:06.994 INFO:tasks.workunit.client.0.smithi179.stderr: 42000K .......... .......... .......... .......... .......... 24% 25.6M 5s 2024-08-24T21:12:06.994 INFO:tasks.workunit.client.0.smithi179.stderr: 42050K .......... .......... .......... .......... .......... 24% 33.4M 5s 2024-08-24T21:12:06.994 INFO:tasks.workunit.client.0.smithi179.stderr: 42100K .......... .......... .......... .......... .......... 25% 19.9M 5s 2024-08-24T21:12:06.996 INFO:tasks.workunit.client.0.smithi179.stderr: 42150K .......... .......... .......... .......... .......... 25% 35.9M 5s 2024-08-24T21:12:06.997 INFO:tasks.workunit.client.0.smithi179.stderr: 42200K .......... .......... .......... .......... .......... 25% 23.7M 5s 2024-08-24T21:12:06.998 INFO:tasks.workunit.client.0.smithi179.stderr: 42250K .......... .......... .......... .......... .......... 25% 38.3M 5s 2024-08-24T21:12:06.999 INFO:tasks.workunit.client.0.smithi179.stderr: 42300K .......... .......... .......... .......... .......... 25% 30.0M 5s 2024-08-24T21:12:07.002 INFO:tasks.workunit.client.0.smithi179.stderr: 42350K .......... .......... .......... .......... .......... 25% 21.0M 5s 2024-08-24T21:12:07.003 INFO:tasks.workunit.client.0.smithi179.stderr: 42400K .......... .......... .......... .......... .......... 25% 41.2M 5s 2024-08-24T21:12:07.006 INFO:tasks.workunit.client.0.smithi179.stderr: 42450K .......... .......... .......... .......... .......... 25% 23.5M 5s 2024-08-24T21:12:07.007 INFO:tasks.workunit.client.0.smithi179.stderr: 42500K .......... .......... .......... .......... .......... 25% 26.3M 5s 2024-08-24T21:12:07.009 INFO:tasks.workunit.client.0.smithi179.stderr: 42550K .......... .......... .......... .......... .......... 25% 34.3M 5s 2024-08-24T21:12:07.010 INFO:tasks.workunit.client.0.smithi179.stderr: 42600K .......... .......... .......... .......... .......... 25% 22.9M 5s 2024-08-24T21:12:07.012 INFO:tasks.workunit.client.0.smithi179.stderr: 42650K .......... .......... .......... .......... .......... 25% 52.4M 5s 2024-08-24T21:12:07.013 INFO:tasks.workunit.client.0.smithi179.stderr: 42700K .......... .......... .......... .......... .......... 25% 24.0M 5s 2024-08-24T21:12:07.016 INFO:tasks.workunit.client.0.smithi179.stderr: 42750K .......... .......... .......... .......... .......... 25% 23.5M 5s 2024-08-24T21:12:07.017 INFO:tasks.workunit.client.0.smithi179.stderr: 42800K .......... .......... .......... .......... .......... 25% 38.2M 5s 2024-08-24T21:12:07.021 INFO:tasks.workunit.client.0.smithi179.stderr: 42850K .......... .......... .......... .......... .......... 25% 21.4M 5s 2024-08-24T21:12:07.021 INFO:tasks.workunit.client.0.smithi179.stderr: 42900K .......... .......... .......... .......... .......... 25% 79.7M 5s 2024-08-24T21:12:07.022 INFO:tasks.workunit.client.0.smithi179.stderr: 42950K .......... .......... .......... .......... .......... 25% 23.6M 5s 2024-08-24T21:12:07.023 INFO:tasks.workunit.client.0.smithi179.stderr: 43000K .......... .......... .......... .......... .......... 25% 32.3M 5s 2024-08-24T21:12:07.025 INFO:tasks.workunit.client.0.smithi179.stderr: 43050K .......... .......... .......... .......... .......... 25% 28.2M 5s 2024-08-24T21:12:07.028 INFO:tasks.workunit.client.0.smithi179.stderr: 43100K .......... .......... .......... .......... .......... 25% 20.9M 5s 2024-08-24T21:12:07.029 INFO:tasks.workunit.client.0.smithi179.stderr: 43150K .......... .......... .......... .......... .......... 25% 23.2M 5s 2024-08-24T21:12:07.030 INFO:tasks.workunit.client.0.smithi179.stderr: 43200K .......... .......... .......... .......... .......... 25% 51.8M 5s 2024-08-24T21:12:07.033 INFO:tasks.workunit.client.0.smithi179.stderr: 43250K .......... .......... .......... .......... .......... 25% 17.7M 5s 2024-08-24T21:12:07.034 INFO:tasks.workunit.client.0.smithi179.stderr: 43300K .......... .......... .......... .......... .......... 25% 40.8M 5s 2024-08-24T21:12:07.036 INFO:tasks.workunit.client.0.smithi179.stderr: 43350K .......... .......... .......... .......... .......... 25% 21.9M 5s 2024-08-24T21:12:07.038 INFO:tasks.workunit.client.0.smithi179.stderr: 43400K .......... .......... .......... .......... .......... 25% 26.7M 5s 2024-08-24T21:12:07.040 INFO:tasks.workunit.client.0.smithi179.stderr: 43450K .......... .......... .......... .......... .......... 25% 23.0M 5s 2024-08-24T21:12:07.042 INFO:tasks.workunit.client.0.smithi179.stderr: 43500K .......... .......... .......... .......... .......... 25% 38.9M 5s 2024-08-24T21:12:07.045 INFO:tasks.workunit.client.0.smithi179.stderr: 43550K .......... .......... .......... .......... .......... 25% 16.2M 5s 2024-08-24T21:12:07.046 INFO:tasks.workunit.client.0.smithi179.stderr: 43600K .......... .......... .......... .......... .......... 25% 40.3M 5s 2024-08-24T21:12:07.048 INFO:tasks.workunit.client.0.smithi179.stderr: 43650K .......... .......... .......... .......... .......... 25% 23.8M 5s 2024-08-24T21:12:07.049 INFO:tasks.workunit.client.0.smithi179.stderr: 43700K .......... .......... .......... .......... .......... 25% 35.1M 5s 2024-08-24T21:12:07.051 INFO:tasks.workunit.client.0.smithi179.stderr: 43750K .......... .......... .......... .......... .......... 25% 24.4M 5s 2024-08-24T21:12:07.053 INFO:tasks.workunit.client.0.smithi179.stderr: 43800K .......... .......... .......... .......... .......... 26% 38.3M 5s 2024-08-24T21:12:07.055 INFO:tasks.workunit.client.0.smithi179.stderr: 43850K .......... .......... .......... .......... .......... 26% 20.4M 5s 2024-08-24T21:12:07.056 INFO:tasks.workunit.client.0.smithi179.stderr: 43900K .......... .......... .......... .......... .......... 26% 52.4M 5s 2024-08-24T21:12:07.058 INFO:tasks.workunit.client.0.smithi179.stderr: 43950K .......... .......... .......... .......... .......... 26% 21.4M 5s 2024-08-24T21:12:07.060 INFO:tasks.workunit.client.0.smithi179.stderr: 44000K .......... .......... .......... .......... .......... 26% 23.9M 5s 2024-08-24T21:12:07.061 INFO:tasks.workunit.client.0.smithi179.stderr: 44050K .......... .......... .......... .......... .......... 26% 46.0M 5s 2024-08-24T21:12:07.063 INFO:tasks.workunit.client.0.smithi179.stderr: 44100K .......... .......... .......... .......... .......... 26% 23.3M 5s 2024-08-24T21:12:07.064 INFO:tasks.workunit.client.0.smithi179.stderr: 44150K .......... .......... .......... .......... .......... 26% 41.0M 5s 2024-08-24T21:12:07.066 INFO:tasks.workunit.client.0.smithi179.stderr: 44200K .......... .......... .......... .......... .......... 26% 24.2M 5s 2024-08-24T21:12:07.068 INFO:tasks.workunit.client.0.smithi179.stderr: 44250K .......... .......... .......... .......... .......... 26% 37.4M 5s 2024-08-24T21:12:07.070 INFO:tasks.workunit.client.0.smithi179.stderr: 44300K .......... .......... .......... .......... .......... 26% 23.7M 5s 2024-08-24T21:12:07.072 INFO:tasks.workunit.client.0.smithi179.stderr: 44350K .......... .......... .......... .......... .......... 26% 25.3M 5s 2024-08-24T21:12:07.074 INFO:tasks.workunit.client.0.smithi179.stderr: 44400K .......... .......... .......... .......... .......... 26% 25.9M 5s 2024-08-24T21:12:07.075 INFO:tasks.workunit.client.0.smithi179.stderr: 44450K .......... .......... .......... .......... .......... 26% 32.0M 5s 2024-08-24T21:12:07.077 INFO:tasks.workunit.client.0.smithi179.stderr: 44500K .......... .......... .......... .......... .......... 26% 27.2M 5s 2024-08-24T21:12:07.078 INFO:tasks.workunit.client.0.smithi179.stderr: 44550K .......... .......... .......... .......... .......... 26% 38.8M 5s 2024-08-24T21:12:07.080 INFO:tasks.workunit.client.0.smithi179.stderr: 44600K .......... .......... .......... .......... .......... 26% 24.5M 5s 2024-08-24T21:12:07.082 INFO:tasks.workunit.client.0.smithi179.stderr: 44650K .......... .......... .......... .......... .......... 26% 27.5M 5s 2024-08-24T21:12:07.084 INFO:tasks.workunit.client.0.smithi179.stderr: 44700K .......... .......... .......... .......... .......... 26% 24.9M 5s 2024-08-24T21:12:07.086 INFO:tasks.workunit.client.0.smithi179.stderr: 44750K .......... .......... .......... .......... .......... 26% 19.1M 5s 2024-08-24T21:12:07.089 INFO:tasks.workunit.client.0.smithi179.stderr: 44800K .......... .......... .......... .......... .......... 26% 34.4M 5s 2024-08-24T21:12:07.090 INFO:tasks.workunit.client.0.smithi179.stderr: 44850K .......... .......... .......... .......... .......... 26% 23.6M 5s 2024-08-24T21:12:07.092 INFO:tasks.workunit.client.0.smithi179.stderr: 44900K .......... .......... .......... .......... .......... 26% 25.8M 5s 2024-08-24T21:12:07.093 INFO:tasks.workunit.client.0.smithi179.stderr: 44950K .......... .......... .......... .......... .......... 26% 39.3M 5s 2024-08-24T21:12:07.095 INFO:tasks.workunit.client.0.smithi179.stderr: 45000K .......... .......... .......... .......... .......... 26% 25.6M 5s 2024-08-24T21:12:07.096 INFO:tasks.workunit.client.0.smithi179.stderr: 45050K .......... .......... .......... .......... .......... 26% 42.8M 5s 2024-08-24T21:12:07.099 INFO:tasks.workunit.client.0.smithi179.stderr: 45100K .......... .......... .......... .......... .......... 26% 16.6M 5s 2024-08-24T21:12:07.101 INFO:tasks.workunit.client.0.smithi179.stderr: 45150K .......... .......... .......... .......... .......... 26% 39.5M 5s 2024-08-24T21:12:07.102 INFO:tasks.workunit.client.0.smithi179.stderr: 45200K .......... .......... .......... .......... .......... 26% 35.0M 5s 2024-08-24T21:12:07.105 INFO:tasks.workunit.client.0.smithi179.stderr: 45250K .......... .......... .......... .......... .......... 26% 20.5M 5s 2024-08-24T21:12:07.107 INFO:tasks.workunit.client.0.smithi179.stderr: 45300K .......... .......... .......... .......... .......... 26% 25.3M 5s 2024-08-24T21:12:07.108 INFO:tasks.workunit.client.0.smithi179.stderr: 45350K .......... .......... .......... .......... .......... 26% 33.3M 5s 2024-08-24T21:12:07.110 INFO:tasks.workunit.client.0.smithi179.stderr: 45400K .......... .......... .......... .......... .......... 26% 22.8M 5s 2024-08-24T21:12:07.111 INFO:tasks.workunit.client.0.smithi179.stderr: 45450K .......... .......... .......... .......... .......... 26% 37.3M 5s 2024-08-24T21:12:07.114 INFO:tasks.workunit.client.0.smithi179.stderr: 45500K .......... .......... .......... .......... .......... 27% 18.7M 5s 2024-08-24T21:12:07.116 INFO:tasks.workunit.client.0.smithi179.stderr: 45550K .......... .......... .......... .......... .......... 27% 18.9M 5s 2024-08-24T21:12:07.117 INFO:tasks.workunit.client.0.smithi179.stderr: 45600K .......... .......... .......... .......... .......... 27% 47.4M 5s 2024-08-24T21:12:07.120 INFO:tasks.workunit.client.0.smithi179.stderr: 45650K .......... .......... .......... .......... .......... 27% 17.6M 5s 2024-08-24T21:12:07.121 INFO:tasks.workunit.client.0.smithi179.stderr: 45700K .......... .......... .......... .......... .......... 27% 44.0M 5s 2024-08-24T21:12:07.123 INFO:tasks.workunit.client.0.smithi179.stderr: 45750K .......... .......... .......... .......... .......... 27% 21.8M 5s 2024-08-24T21:12:07.125 INFO:tasks.workunit.client.0.smithi179.stderr: 45800K .......... .......... .......... .......... .......... 27% 36.1M 5s 2024-08-24T21:12:07.127 INFO:tasks.workunit.client.0.smithi179.stderr: 45850K .......... .......... .......... .......... .......... 27% 23.9M 5s 2024-08-24T21:12:07.130 INFO:tasks.workunit.client.0.smithi179.stderr: 45900K .......... .......... .......... .......... .......... 27% 23.9M 5s 2024-08-24T21:12:07.131 INFO:tasks.workunit.client.0.smithi179.stderr: 45950K .......... .......... .......... .......... .......... 27% 21.2M 5s 2024-08-24T21:12:07.132 INFO:tasks.workunit.client.0.smithi179.stderr: 46000K .......... .......... .......... .......... .......... 27% 47.8M 5s 2024-08-24T21:12:07.134 INFO:tasks.workunit.client.0.smithi179.stderr: 46050K .......... .......... .......... .......... .......... 27% 28.0M 5s 2024-08-24T21:12:07.135 INFO:tasks.workunit.client.0.smithi179.stderr: 46100K .......... .......... .......... .......... .......... 27% 34.9M 5s 2024-08-24T21:12:07.138 INFO:tasks.workunit.client.0.smithi179.stderr: 46150K .......... .......... .......... .......... .......... 27% 23.0M 5s 2024-08-24T21:12:07.138 INFO:tasks.workunit.client.0.smithi179.stderr: 46200K .......... .......... .......... .......... .......... 27% 43.5M 5s 2024-08-24T21:12:07.141 INFO:tasks.workunit.client.0.smithi179.stderr: 46250K .......... .......... .......... .......... .......... 27% 24.7M 5s 2024-08-24T21:12:07.143 INFO:tasks.workunit.client.0.smithi179.stderr: 46300K .......... .......... .......... .......... .......... 27% 32.0M 5s 2024-08-24T21:12:07.144 INFO:tasks.workunit.client.0.smithi179.stderr: 46350K .......... .......... .......... .......... .......... 27% 25.4M 5s 2024-08-24T21:12:07.146 INFO:tasks.workunit.client.0.smithi179.stderr: 46400K .......... .......... .......... .......... .......... 27% 24.3M 5s 2024-08-24T21:12:07.147 INFO:tasks.workunit.client.0.smithi179.stderr: 46450K .......... .......... .......... .......... .......... 27% 43.5M 5s 2024-08-24T21:12:07.149 INFO:tasks.workunit.client.0.smithi179.stderr: 46500K .......... .......... .......... .......... .......... 27% 24.6M 5s 2024-08-24T21:12:07.152 INFO:tasks.workunit.client.0.smithi179.stderr: 46550K .......... .......... .......... .......... .......... 27% 21.6M 5s 2024-08-24T21:12:07.153 INFO:tasks.workunit.client.0.smithi179.stderr: 46600K .......... .......... .......... .......... .......... 27% 28.5M 5s 2024-08-24T21:12:07.156 INFO:tasks.workunit.client.0.smithi179.stderr: 46650K .......... .......... .......... .......... .......... 27% 20.5M 5s 2024-08-24T21:12:07.157 INFO:tasks.workunit.client.0.smithi179.stderr: 46700K .......... .......... .......... .......... .......... 27% 38.4M 5s 2024-08-24T21:12:07.159 INFO:tasks.workunit.client.0.smithi179.stderr: 46750K .......... .......... .......... .......... .......... 27% 20.8M 5s 2024-08-24T21:12:07.161 INFO:tasks.workunit.client.0.smithi179.stderr: 46800K .......... .......... .......... .......... .......... 27% 22.2M 5s 2024-08-24T21:12:07.162 INFO:tasks.workunit.client.0.smithi179.stderr: 46850K .......... .......... .......... .......... .......... 27% 39.6M 5s 2024-08-24T21:12:07.165 INFO:tasks.workunit.client.0.smithi179.stderr: 46900K .......... .......... .......... .......... .......... 27% 25.3M 5s 2024-08-24T21:12:07.166 INFO:tasks.workunit.client.0.smithi179.stderr: 46950K .......... .......... .......... .......... .......... 27% 32.7M 5s 2024-08-24T21:12:07.168 INFO:tasks.workunit.client.0.smithi179.stderr: 47000K .......... .......... .......... .......... .......... 27% 25.9M 5s 2024-08-24T21:12:07.169 INFO:tasks.workunit.client.0.smithi179.stderr: 47050K .......... .......... .......... .......... .......... 27% 40.6M 5s 2024-08-24T21:12:07.171 INFO:tasks.workunit.client.0.smithi179.stderr: 47100K .......... .......... .......... .......... .......... 27% 22.8M 5s 2024-08-24T21:12:07.173 INFO:tasks.workunit.client.0.smithi179.stderr: 47150K .......... .......... .......... .......... .......... 28% 23.3M 5s 2024-08-24T21:12:07.176 INFO:tasks.workunit.client.0.smithi179.stderr: 47200K .......... .......... .......... .......... .......... 28% 23.1M 5s 2024-08-24T21:12:07.177 INFO:tasks.workunit.client.0.smithi179.stderr: 47250K .......... .......... .......... .......... .......... 28% 36.7M 5s 2024-08-24T21:12:07.179 INFO:tasks.workunit.client.0.smithi179.stderr: 47300K .......... .......... .......... .......... .......... 28% 23.0M 5s 2024-08-24T21:12:07.180 INFO:tasks.workunit.client.0.smithi179.stderr: 47350K .......... .......... .......... .......... .......... 28% 39.3M 5s 2024-08-24T21:12:07.182 INFO:tasks.workunit.client.0.smithi179.stderr: 47400K .......... .......... .......... .......... .......... 28% 24.3M 5s 2024-08-24T21:12:07.183 INFO:tasks.workunit.client.0.smithi179.stderr: 47450K .......... .......... .......... .......... .......... 28% 43.9M 5s 2024-08-24T21:12:07.187 INFO:tasks.workunit.client.0.smithi179.stderr: 47500K .......... .......... .......... .......... .......... 28% 15.3M 5s 2024-08-24T21:12:07.188 INFO:tasks.workunit.client.0.smithi179.stderr: 47550K .......... .......... .......... .......... .......... 28% 25.6M 5s 2024-08-24T21:12:07.190 INFO:tasks.workunit.client.0.smithi179.stderr: 47600K .......... .......... .......... .......... .......... 28% 43.0M 5s 2024-08-24T21:12:07.192 INFO:tasks.workunit.client.0.smithi179.stderr: 47650K .......... .......... .......... .......... .......... 28% 22.1M 5s 2024-08-24T21:12:07.194 INFO:tasks.workunit.client.0.smithi179.stderr: 47700K .......... .......... .......... .......... .......... 28% 20.1M 5s 2024-08-24T21:12:07.195 INFO:tasks.workunit.client.0.smithi179.stderr: 47750K .......... .......... .......... .......... .......... 28% 42.9M 5s 2024-08-24T21:12:07.198 INFO:tasks.workunit.client.0.smithi179.stderr: 47800K .......... .......... .......... .......... .......... 28% 17.2M 5s 2024-08-24T21:12:07.200 INFO:tasks.workunit.client.0.smithi179.stderr: 47850K .......... .......... .......... .......... .......... 28% 40.1M 5s 2024-08-24T21:12:07.203 INFO:tasks.workunit.client.0.smithi179.stderr: 47900K .......... .......... .......... .......... .......... 28% 18.7M 5s 2024-08-24T21:12:07.204 INFO:tasks.workunit.client.0.smithi179.stderr: 47950K .......... .......... .......... .......... .......... 28% 26.9M 4s 2024-08-24T21:12:07.205 INFO:tasks.workunit.client.0.smithi179.stderr: 48000K .......... .......... .......... .......... .......... 28% 34.2M 4s 2024-08-24T21:12:07.207 INFO:tasks.workunit.client.0.smithi179.stderr: 48050K .......... .......... .......... .......... .......... 28% 25.5M 4s 2024-08-24T21:12:07.208 INFO:tasks.workunit.client.0.smithi179.stderr: 48100K .......... .......... .......... .......... .......... 28% 34.9M 4s 2024-08-24T21:12:07.211 INFO:tasks.workunit.client.0.smithi179.stderr: 48150K .......... .......... .......... .......... .......... 28% 23.2M 4s 2024-08-24T21:12:07.212 INFO:tasks.workunit.client.0.smithi179.stderr: 48200K .......... .......... .......... .......... .......... 28% 40.3M 4s 2024-08-24T21:12:07.214 INFO:tasks.workunit.client.0.smithi179.stderr: 48250K .......... .......... .......... .......... .......... 28% 30.7M 4s 2024-08-24T21:12:07.216 INFO:tasks.workunit.client.0.smithi179.stderr: 48300K .......... .......... .......... .......... .......... 28% 22.6M 4s 2024-08-24T21:12:07.218 INFO:tasks.workunit.client.0.smithi179.stderr: 48350K .......... .......... .......... .......... .......... 28% 22.5M 4s 2024-08-24T21:12:07.220 INFO:tasks.workunit.client.0.smithi179.stderr: 48400K .......... .......... .......... .......... .......... 28% 29.7M 4s 2024-08-24T21:12:07.221 INFO:tasks.workunit.client.0.smithi179.stderr: 48450K .......... .......... .......... .......... .......... 28% 32.7M 4s 2024-08-24T21:12:07.223 INFO:tasks.workunit.client.0.smithi179.stderr: 48500K .......... .......... .......... .......... .......... 28% 37.0M 4s 2024-08-24T21:12:07.224 INFO:tasks.workunit.client.0.smithi179.stderr: 48550K .......... .......... .......... .......... .......... 28% 32.2M 4s 2024-08-24T21:12:07.225 INFO:tasks.workunit.client.0.smithi179.stderr: 48600K .......... .......... .......... .......... .......... 28% 32.6M 4s 2024-08-24T21:12:07.227 INFO:tasks.workunit.client.0.smithi179.stderr: 48650K .......... .......... .......... .......... .......... 28% 36.5M 4s 2024-08-24T21:12:07.228 INFO:tasks.workunit.client.0.smithi179.stderr: 48700K .......... .......... .......... .......... .......... 28% 27.7M 4s 2024-08-24T21:12:07.231 INFO:tasks.workunit.client.0.smithi179.stderr: 48750K .......... .......... .......... .......... .......... 28% 20.6M 4s 2024-08-24T21:12:07.232 INFO:tasks.workunit.client.0.smithi179.stderr: 48800K .......... .......... .......... .......... .......... 28% 29.1M 4s 2024-08-24T21:12:07.237 INFO:tasks.workunit.client.0.smithi179.stderr: 48850K .......... .......... .......... .......... .......... 29% 23.4M 4s 2024-08-24T21:12:07.237 INFO:tasks.workunit.client.0.smithi179.stderr: 48900K .......... .......... .......... .......... .......... 29% 35.7M 4s 2024-08-24T21:12:07.237 INFO:tasks.workunit.client.0.smithi179.stderr: 48950K .......... .......... .......... .......... .......... 29% 42.6M 4s 2024-08-24T21:12:07.239 INFO:tasks.workunit.client.0.smithi179.stderr: 49000K .......... .......... .......... .......... .......... 29% 27.1M 4s 2024-08-24T21:12:07.241 INFO:tasks.workunit.client.0.smithi179.stderr: 49050K .......... .......... .......... .......... .......... 29% 25.4M 4s 2024-08-24T21:12:07.242 INFO:tasks.workunit.client.0.smithi179.stderr: 49100K .......... .......... .......... .......... .......... 29% 35.2M 4s 2024-08-24T21:12:07.245 INFO:tasks.workunit.client.0.smithi179.stderr: 49150K .......... .......... .......... .......... .......... 29% 18.3M 4s 2024-08-24T21:12:07.247 INFO:tasks.workunit.client.0.smithi179.stderr: 49200K .......... .......... .......... .......... .......... 29% 35.9M 4s 2024-08-24T21:12:07.247 INFO:tasks.workunit.client.0.smithi179.stderr: 49250K .......... .......... .......... .......... .......... 29% 49.7M 4s 2024-08-24T21:12:07.249 INFO:tasks.workunit.client.0.smithi179.stderr: 49300K .......... .......... .......... .......... .......... 29% 23.3M 4s 2024-08-24T21:12:07.251 INFO:tasks.workunit.client.0.smithi179.stderr: 49350K .......... .......... .......... .......... .......... 29% 26.1M 4s 2024-08-24T21:12:07.253 INFO:tasks.workunit.client.0.smithi179.stderr: 49400K .......... .......... .......... .......... .......... 29% 28.0M 4s 2024-08-24T21:12:07.255 INFO:tasks.workunit.client.0.smithi179.stderr: 49450K .......... .......... .......... .......... .......... 29% 24.3M 4s 2024-08-24T21:12:07.256 INFO:tasks.workunit.client.0.smithi179.stderr: 49500K .......... .......... .......... .......... .......... 29% 46.0M 4s 2024-08-24T21:12:07.258 INFO:tasks.workunit.client.0.smithi179.stderr: 49550K .......... .......... .......... .......... .......... 29% 21.5M 4s 2024-08-24T21:12:07.260 INFO:tasks.workunit.client.0.smithi179.stderr: 49600K .......... .......... .......... .......... .......... 29% 23.8M 4s 2024-08-24T21:12:07.262 INFO:tasks.workunit.client.0.smithi179.stderr: 49650K .......... .......... .......... .......... .......... 29% 39.0M 4s 2024-08-24T21:12:07.265 INFO:tasks.workunit.client.0.smithi179.stderr: 49700K .......... .......... .......... .......... .......... 29% 15.7M 4s 2024-08-24T21:12:07.266 INFO:tasks.workunit.client.0.smithi179.stderr: 49750K .......... .......... .......... .......... .......... 29% 26.3M 4s 2024-08-24T21:12:07.269 INFO:tasks.workunit.client.0.smithi179.stderr: 49800K .......... .......... .......... .......... .......... 29% 17.3M 4s 2024-08-24T21:12:07.270 INFO:tasks.workunit.client.0.smithi179.stderr: 49850K .......... .......... .......... .......... .......... 29% 48.3M 4s 2024-08-24T21:12:07.273 INFO:tasks.workunit.client.0.smithi179.stderr: 49900K .......... .......... .......... .......... .......... 29% 18.9M 4s 2024-08-24T21:12:07.276 INFO:tasks.workunit.client.0.smithi179.stderr: 49950K .......... .......... .......... .......... .......... 29% 17.3M 4s 2024-08-24T21:12:07.279 INFO:tasks.workunit.client.0.smithi179.stderr: 50000K .......... .......... .......... .......... .......... 29% 15.5M 4s 2024-08-24T21:12:07.280 INFO:tasks.workunit.client.0.smithi179.stderr: 50050K .......... .......... .......... .......... .......... 29% 41.2M 4s 2024-08-24T21:12:07.283 INFO:tasks.workunit.client.0.smithi179.stderr: 50100K .......... .......... .......... .......... .......... 29% 18.2M 4s 2024-08-24T21:12:07.285 INFO:tasks.workunit.client.0.smithi179.stderr: 50150K .......... .......... .......... .......... .......... 29% 39.5M 4s 2024-08-24T21:12:07.286 INFO:tasks.workunit.client.0.smithi179.stderr: 50200K .......... .......... .......... .......... .......... 29% 21.1M 4s 2024-08-24T21:12:07.287 INFO:tasks.workunit.client.0.smithi179.stderr: 50250K .......... .......... .......... .......... .......... 29% 45.4M 4s 2024-08-24T21:12:07.290 INFO:tasks.workunit.client.0.smithi179.stderr: 50300K .......... .......... .......... .......... .......... 29% 22.1M 4s 2024-08-24T21:12:07.291 INFO:tasks.workunit.client.0.smithi179.stderr: 50350K .......... .......... .......... .......... .......... 29% 26.2M 4s 2024-08-24T21:12:07.292 INFO:tasks.workunit.client.0.smithi179.stderr: 50400K .......... .......... .......... .......... .......... 29% 34.9M 4s 2024-08-24T21:12:07.295 INFO:tasks.workunit.client.0.smithi179.stderr: 50450K .......... .......... .......... .......... .......... 29% 26.4M 4s 2024-08-24T21:12:07.297 INFO:tasks.workunit.client.0.smithi179.stderr: 50500K .......... .......... .......... .......... .......... 29% 23.7M 4s 2024-08-24T21:12:07.298 INFO:tasks.workunit.client.0.smithi179.stderr: 50550K .......... .......... .......... .......... .......... 30% 39.4M 4s 2024-08-24T21:12:07.301 INFO:tasks.workunit.client.0.smithi179.stderr: 50600K .......... .......... .......... .......... .......... 30% 23.5M 4s 2024-08-24T21:12:07.301 INFO:tasks.workunit.client.0.smithi179.stderr: 50650K .......... .......... .......... .......... .......... 30% 62.0M 4s 2024-08-24T21:12:07.303 INFO:tasks.workunit.client.0.smithi179.stderr: 50700K .......... .......... .......... .......... .......... 30% 21.1M 4s 2024-08-24T21:12:07.305 INFO:tasks.workunit.client.0.smithi179.stderr: 50750K .......... .......... .......... .......... .......... 30% 25.3M 4s 2024-08-24T21:12:07.306 INFO:tasks.workunit.client.0.smithi179.stderr: 50800K .......... .......... .......... .......... .......... 30% 43.4M 4s 2024-08-24T21:12:07.308 INFO:tasks.workunit.client.0.smithi179.stderr: 50850K .......... .......... .......... .......... .......... 30% 25.8M 4s 2024-08-24T21:12:07.309 INFO:tasks.workunit.client.0.smithi179.stderr: 50900K .......... .......... .......... .......... .......... 30% 36.7M 4s 2024-08-24T21:12:07.311 INFO:tasks.workunit.client.0.smithi179.stderr: 50950K .......... .......... .......... .......... .......... 30% 25.6M 4s 2024-08-24T21:12:07.313 INFO:tasks.workunit.client.0.smithi179.stderr: 51000K .......... .......... .......... .......... .......... 30% 24.0M 4s 2024-08-24T21:12:07.314 INFO:tasks.workunit.client.0.smithi179.stderr: 51050K .......... .......... .......... .......... .......... 30% 40.8M 4s 2024-08-24T21:12:07.317 INFO:tasks.workunit.client.0.smithi179.stderr: 51100K .......... .......... .......... .......... .......... 30% 23.5M 4s 2024-08-24T21:12:07.319 INFO:tasks.workunit.client.0.smithi179.stderr: 51150K .......... .......... .......... .......... .......... 30% 24.3M 4s 2024-08-24T21:12:07.320 INFO:tasks.workunit.client.0.smithi179.stderr: 51200K .......... .......... .......... .......... .......... 30% 40.0M 4s 2024-08-24T21:12:07.322 INFO:tasks.workunit.client.0.smithi179.stderr: 51250K .......... .......... .......... .......... .......... 30% 24.2M 4s 2024-08-24T21:12:07.323 INFO:tasks.workunit.client.0.smithi179.stderr: 51300K .......... .......... .......... .......... .......... 30% 38.2M 4s 2024-08-24T21:12:07.325 INFO:tasks.workunit.client.0.smithi179.stderr: 51350K .......... .......... .......... .......... .......... 30% 23.8M 4s 2024-08-24T21:12:07.333 INFO:tasks.workunit.client.0.smithi179.stderr: 51400K .......... .......... .......... .......... .......... 30% 11.3M 4s 2024-08-24T21:12:07.333 INFO:tasks.workunit.client.0.smithi179.stderr: 51450K .......... .......... .......... .......... .......... 30% 60.6M 4s 2024-08-24T21:12:07.333 INFO:tasks.workunit.client.0.smithi179.stderr: 51500K .......... .......... .......... .......... .......... 30% 124M 4s 2024-08-24T21:12:07.333 INFO:tasks.workunit.client.0.smithi179.stderr: 51550K .......... .......... .......... .......... .......... 30% 28.7M 4s 2024-08-24T21:12:07.335 INFO:tasks.workunit.client.0.smithi179.stderr: 51600K .......... .......... .......... .......... .......... 30% 32.1M 4s 2024-08-24T21:12:07.336 INFO:tasks.workunit.client.0.smithi179.stderr: 51650K .......... .......... .......... .......... .......... 30% 29.6M 4s 2024-08-24T21:12:07.337 INFO:tasks.workunit.client.0.smithi179.stderr: 51700K .......... .......... .......... .......... .......... 30% 43.2M 4s 2024-08-24T21:12:07.339 INFO:tasks.workunit.client.0.smithi179.stderr: 51750K .......... .......... .......... .......... .......... 30% 21.3M 4s 2024-08-24T21:12:07.340 INFO:tasks.workunit.client.0.smithi179.stderr: 51800K .......... .......... .......... .......... .......... 30% 37.7M 4s 2024-08-24T21:12:07.342 INFO:tasks.workunit.client.0.smithi179.stderr: 51850K .......... .......... .......... .......... .......... 30% 25.9M 4s 2024-08-24T21:12:07.343 INFO:tasks.workunit.client.0.smithi179.stderr: 51900K .......... .......... .......... .......... .......... 30% 46.1M 4s 2024-08-24T21:12:07.345 INFO:tasks.workunit.client.0.smithi179.stderr: 51950K .......... .......... .......... .......... .......... 30% 23.6M 4s 2024-08-24T21:12:07.347 INFO:tasks.workunit.client.0.smithi179.stderr: 52000K .......... .......... .......... .......... .......... 30% 25.1M 4s 2024-08-24T21:12:07.348 INFO:tasks.workunit.client.0.smithi179.stderr: 52050K .......... .......... .......... .......... .......... 30% 40.9M 4s 2024-08-24T21:12:07.350 INFO:tasks.workunit.client.0.smithi179.stderr: 52100K .......... .......... .......... .......... .......... 30% 24.3M 4s 2024-08-24T21:12:07.353 INFO:tasks.workunit.client.0.smithi179.stderr: 52150K .......... .......... .......... .......... .......... 30% 21.7M 4s 2024-08-24T21:12:07.355 INFO:tasks.workunit.client.0.smithi179.stderr: 52200K .......... .......... .......... .......... .......... 30% 32.0M 4s 2024-08-24T21:12:07.356 INFO:tasks.workunit.client.0.smithi179.stderr: 52250K .......... .......... .......... .......... .......... 31% 39.4M 4s 2024-08-24T21:12:07.357 INFO:tasks.workunit.client.0.smithi179.stderr: 52300K .......... .......... .......... .......... .......... 31% 29.0M 4s 2024-08-24T21:12:07.360 INFO:tasks.workunit.client.0.smithi179.stderr: 52350K .......... .......... .......... .......... .......... 31% 21.0M 4s 2024-08-24T21:12:07.362 INFO:tasks.workunit.client.0.smithi179.stderr: 52400K .......... .......... .......... .......... .......... 31% 26.0M 4s 2024-08-24T21:12:07.363 INFO:tasks.workunit.client.0.smithi179.stderr: 52450K .......... .......... .......... .......... .......... 31% 27.6M 4s 2024-08-24T21:12:07.365 INFO:tasks.workunit.client.0.smithi179.stderr: 52500K .......... .......... .......... .......... .......... 31% 25.5M 4s 2024-08-24T21:12:07.367 INFO:tasks.workunit.client.0.smithi179.stderr: 52550K .......... .......... .......... .......... .......... 31% 31.0M 4s 2024-08-24T21:12:07.369 INFO:tasks.workunit.client.0.smithi179.stderr: 52600K .......... .......... .......... .......... .......... 31% 24.3M 4s 2024-08-24T21:12:07.370 INFO:tasks.workunit.client.0.smithi179.stderr: 52650K .......... .......... .......... .......... .......... 31% 37.0M 4s 2024-08-24T21:12:07.372 INFO:tasks.workunit.client.0.smithi179.stderr: 52700K .......... .......... .......... .......... .......... 31% 24.3M 4s 2024-08-24T21:12:07.375 INFO:tasks.workunit.client.0.smithi179.stderr: 52750K .......... .......... .......... .......... .......... 31% 19.8M 4s 2024-08-24T21:12:07.376 INFO:tasks.workunit.client.0.smithi179.stderr: 52800K .......... .......... .......... .......... .......... 31% 31.1M 4s 2024-08-24T21:12:07.377 INFO:tasks.workunit.client.0.smithi179.stderr: 52850K .......... .......... .......... .......... .......... 31% 42.6M 4s 2024-08-24T21:12:07.380 INFO:tasks.workunit.client.0.smithi179.stderr: 52900K .......... .......... .......... .......... .......... 31% 24.5M 4s 2024-08-24T21:12:07.381 INFO:tasks.workunit.client.0.smithi179.stderr: 52950K .......... .......... .......... .......... .......... 31% 40.6M 4s 2024-08-24T21:12:07.383 INFO:tasks.workunit.client.0.smithi179.stderr: 53000K .......... .......... .......... .......... .......... 31% 22.4M 4s 2024-08-24T21:12:07.385 INFO:tasks.workunit.client.0.smithi179.stderr: 53050K .......... .......... .......... .......... .......... 31% 36.9M 4s 2024-08-24T21:12:07.386 INFO:tasks.workunit.client.0.smithi179.stderr: 53100K .......... .......... .......... .......... .......... 31% 29.3M 4s 2024-08-24T21:12:07.388 INFO:tasks.workunit.client.0.smithi179.stderr: 53150K .......... .......... .......... .......... .......... 31% 22.2M 4s 2024-08-24T21:12:07.389 INFO:tasks.workunit.client.0.smithi179.stderr: 53200K .......... .......... .......... .......... .......... 31% 40.2M 4s 2024-08-24T21:12:07.391 INFO:tasks.workunit.client.0.smithi179.stderr: 53250K .......... .......... .......... .......... .......... 31% 26.4M 4s 2024-08-24T21:12:07.394 INFO:tasks.workunit.client.0.smithi179.stderr: 53300K .......... .......... .......... .......... .......... 31% 21.4M 4s 2024-08-24T21:12:07.394 INFO:tasks.workunit.client.0.smithi179.stderr: 53350K .......... .......... .......... .......... .......... 31% 53.4M 4s 2024-08-24T21:12:07.396 INFO:tasks.workunit.client.0.smithi179.stderr: 53400K .......... .......... .......... .......... .......... 31% 23.0M 4s 2024-08-24T21:12:07.398 INFO:tasks.workunit.client.0.smithi179.stderr: 53450K .......... .......... .......... .......... .......... 31% 27.0M 4s 2024-08-24T21:12:07.399 INFO:tasks.workunit.client.0.smithi179.stderr: 53500K .......... .......... .......... .......... .......... 31% 35.4M 4s 2024-08-24T21:12:07.402 INFO:tasks.workunit.client.0.smithi179.stderr: 53550K .......... .......... .......... .......... .......... 31% 23.2M 4s 2024-08-24T21:12:07.403 INFO:tasks.workunit.client.0.smithi179.stderr: 53600K .......... .......... .......... .......... .......... 31% 50.1M 4s 2024-08-24T21:12:07.404 INFO:tasks.workunit.client.0.smithi179.stderr: 53650K .......... .......... .......... .......... .......... 31% 23.7M 4s 2024-08-24T21:12:07.407 INFO:tasks.workunit.client.0.smithi179.stderr: 53700K .......... .......... .......... .......... .......... 31% 27.2M 4s 2024-08-24T21:12:07.408 INFO:tasks.workunit.client.0.smithi179.stderr: 53750K .......... .......... .......... .......... .......... 31% 29.7M 4s 2024-08-24T21:12:07.409 INFO:tasks.workunit.client.0.smithi179.stderr: 53800K .......... .......... .......... .......... .......... 31% 51.7M 4s 2024-08-24T21:12:07.411 INFO:tasks.workunit.client.0.smithi179.stderr: 53850K .......... .......... .......... .......... .......... 31% 25.2M 4s 2024-08-24T21:12:07.413 INFO:tasks.workunit.client.0.smithi179.stderr: 53900K .......... .......... .......... .......... .......... 32% 23.4M 4s 2024-08-24T21:12:07.415 INFO:tasks.workunit.client.0.smithi179.stderr: 53950K .......... .......... .......... .......... .......... 32% 25.3M 4s 2024-08-24T21:12:07.416 INFO:tasks.workunit.client.0.smithi179.stderr: 54000K .......... .......... .......... .......... .......... 32% 35.1M 4s 2024-08-24T21:12:07.418 INFO:tasks.workunit.client.0.smithi179.stderr: 54050K .......... .......... .......... .......... .......... 32% 24.8M 4s 2024-08-24T21:12:07.419 INFO:tasks.workunit.client.0.smithi179.stderr: 54100K .......... .......... .......... .......... .......... 32% 45.9M 4s 2024-08-24T21:12:07.422 INFO:tasks.workunit.client.0.smithi179.stderr: 54150K .......... .......... .......... .......... .......... 32% 20.4M 4s 2024-08-24T21:12:07.423 INFO:tasks.workunit.client.0.smithi179.stderr: 54200K .......... .......... .......... .......... .......... 32% 37.2M 4s 2024-08-24T21:12:07.425 INFO:tasks.workunit.client.0.smithi179.stderr: 54250K .......... .......... .......... .......... .......... 32% 19.7M 4s 2024-08-24T21:12:07.426 INFO:tasks.workunit.client.0.smithi179.stderr: 54300K .......... .......... .......... .......... .......... 32% 47.6M 4s 2024-08-24T21:12:07.429 INFO:tasks.workunit.client.0.smithi179.stderr: 54350K .......... .......... .......... .......... .......... 32% 21.0M 4s 2024-08-24T21:12:07.430 INFO:tasks.workunit.client.0.smithi179.stderr: 54400K .......... .......... .......... .......... .......... 32% 24.2M 4s 2024-08-24T21:12:07.434 INFO:tasks.workunit.client.0.smithi179.stderr: 54450K .......... .......... .......... .......... .......... 32% 16.2M 4s 2024-08-24T21:12:07.436 INFO:tasks.workunit.client.0.smithi179.stderr: 54500K .......... .......... .......... .......... .......... 32% 22.4M 4s 2024-08-24T21:12:07.440 INFO:tasks.workunit.client.0.smithi179.stderr: 54550K .......... .......... .......... .......... .......... 32% 17.0M 4s 2024-08-24T21:12:07.440 INFO:tasks.workunit.client.0.smithi179.stderr: 54600K .......... .......... .......... .......... .......... 32% 70.5M 4s 2024-08-24T21:12:07.445 INFO:tasks.workunit.client.0.smithi179.stderr: 54650K .......... .......... .......... .......... .......... 32% 8.70M 4s 2024-08-24T21:12:07.446 INFO:tasks.workunit.client.0.smithi179.stderr: 54700K .......... .......... .......... .......... .......... 32% 41.1M 4s 2024-08-24T21:12:07.451 INFO:tasks.workunit.client.0.smithi179.stderr: 54750K .......... .......... .......... .......... .......... 32% 9.67M 4s 2024-08-24T21:12:07.453 INFO:tasks.workunit.client.0.smithi179.stderr: 54800K .......... .......... .......... .......... .......... 32% 25.9M 4s 2024-08-24T21:12:07.454 INFO:tasks.workunit.client.0.smithi179.stderr: 54850K .......... .......... .......... .......... .......... 32% 47.1M 4s 2024-08-24T21:12:07.456 INFO:tasks.workunit.client.0.smithi179.stderr: 54900K .......... .......... .......... .......... .......... 32% 24.9M 4s 2024-08-24T21:12:07.458 INFO:tasks.workunit.client.0.smithi179.stderr: 54950K .......... .......... .......... .......... .......... 32% 38.0M 4s 2024-08-24T21:12:07.460 INFO:tasks.workunit.client.0.smithi179.stderr: 55000K .......... .......... .......... .......... .......... 32% 20.5M 4s 2024-08-24T21:12:07.462 INFO:tasks.workunit.client.0.smithi179.stderr: 55050K .......... .......... .......... .......... .......... 32% 26.8M 4s 2024-08-24T21:12:07.463 INFO:tasks.workunit.client.0.smithi179.stderr: 55100K .......... .......... .......... .......... .......... 32% 49.6M 4s 2024-08-24T21:12:07.465 INFO:tasks.workunit.client.0.smithi179.stderr: 55150K .......... .......... .......... .......... .......... 32% 26.0M 4s 2024-08-24T21:12:07.467 INFO:tasks.workunit.client.0.smithi179.stderr: 55200K .......... .......... .......... .......... .......... 32% 22.3M 4s 2024-08-24T21:12:07.468 INFO:tasks.workunit.client.0.smithi179.stderr: 55250K .......... .......... .......... .......... .......... 32% 40.1M 4s 2024-08-24T21:12:07.470 INFO:tasks.workunit.client.0.smithi179.stderr: 55300K .......... .......... .......... .......... .......... 32% 24.4M 4s 2024-08-24T21:12:07.471 INFO:tasks.workunit.client.0.smithi179.stderr: 55350K .......... .......... .......... .......... .......... 32% 48.0M 4s 2024-08-24T21:12:07.473 INFO:tasks.workunit.client.0.smithi179.stderr: 55400K .......... .......... .......... .......... .......... 32% 24.1M 4s 2024-08-24T21:12:07.475 INFO:tasks.workunit.client.0.smithi179.stderr: 55450K .......... .......... .......... .......... .......... 32% 33.9M 4s 2024-08-24T21:12:07.477 INFO:tasks.workunit.client.0.smithi179.stderr: 55500K .......... .......... .......... .......... .......... 32% 23.5M 4s 2024-08-24T21:12:07.480 INFO:tasks.workunit.client.0.smithi179.stderr: 55550K .......... .......... .......... .......... .......... 32% 17.1M 4s 2024-08-24T21:12:07.481 INFO:tasks.workunit.client.0.smithi179.stderr: 55600K .......... .......... .......... .......... .......... 33% 27.5M 4s 2024-08-24T21:12:07.482 INFO:tasks.workunit.client.0.smithi179.stderr: 55650K .......... .......... .......... .......... .......... 33% 51.1M 4s 2024-08-24T21:12:07.484 INFO:tasks.workunit.client.0.smithi179.stderr: 55700K .......... .......... .......... .......... .......... 33% 23.5M 4s 2024-08-24T21:12:07.486 INFO:tasks.workunit.client.0.smithi179.stderr: 55750K .......... .......... .......... .......... .......... 33% 39.3M 4s 2024-08-24T21:12:07.488 INFO:tasks.workunit.client.0.smithi179.stderr: 55800K .......... .......... .......... .......... .......... 33% 22.4M 4s 2024-08-24T21:12:07.489 INFO:tasks.workunit.client.0.smithi179.stderr: 55850K .......... .......... .......... .......... .......... 33% 50.9M 4s 2024-08-24T21:12:07.491 INFO:tasks.workunit.client.0.smithi179.stderr: 55900K .......... .......... .......... .......... .......... 33% 25.9M 4s 2024-08-24T21:12:07.493 INFO:tasks.workunit.client.0.smithi179.stderr: 55950K .......... .......... .......... .......... .......... 33% 20.7M 4s 2024-08-24T21:12:07.495 INFO:tasks.workunit.client.0.smithi179.stderr: 56000K .......... .......... .......... .......... .......... 33% 33.9M 4s 2024-08-24T21:12:07.497 INFO:tasks.workunit.client.0.smithi179.stderr: 56050K .......... .......... .......... .......... .......... 33% 21.7M 4s 2024-08-24T21:12:07.498 INFO:tasks.workunit.client.0.smithi179.stderr: 56100K .......... .......... .......... .......... .......... 33% 27.8M 4s 2024-08-24T21:12:07.499 INFO:tasks.workunit.client.0.smithi179.stderr: 56150K .......... .......... .......... .......... .......... 33% 49.4M 4s 2024-08-24T21:12:07.501 INFO:tasks.workunit.client.0.smithi179.stderr: 56200K .......... .......... .......... .......... .......... 33% 36.0M 4s 2024-08-24T21:12:07.503 INFO:tasks.workunit.client.0.smithi179.stderr: 56250K .......... .......... .......... .......... .......... 33% 23.2M 4s 2024-08-24T21:12:07.504 INFO:tasks.workunit.client.0.smithi179.stderr: 56300K .......... .......... .......... .......... .......... 33% 50.7M 4s 2024-08-24T21:12:07.506 INFO:tasks.workunit.client.0.smithi179.stderr: 56350K .......... .......... .......... .......... .......... 33% 23.0M 4s 2024-08-24T21:12:07.508 INFO:tasks.workunit.client.0.smithi179.stderr: 56400K .......... .......... .......... .......... .......... 33% 23.7M 4s 2024-08-24T21:12:07.510 INFO:tasks.workunit.client.0.smithi179.stderr: 56450K .......... .......... .......... .......... .......... 33% 27.2M 4s 2024-08-24T21:12:07.512 INFO:tasks.workunit.client.0.smithi179.stderr: 56500K .......... .......... .......... .......... .......... 33% 29.4M 4s 2024-08-24T21:12:07.513 INFO:tasks.workunit.client.0.smithi179.stderr: 56550K .......... .......... .......... .......... .......... 33% 32.9M 4s 2024-08-24T21:12:07.515 INFO:tasks.workunit.client.0.smithi179.stderr: 56600K .......... .......... .......... .......... .......... 33% 38.1M 4s 2024-08-24T21:12:07.516 INFO:tasks.workunit.client.0.smithi179.stderr: 56650K .......... .......... .......... .......... .......... 33% 26.9M 4s 2024-08-24T21:12:07.518 INFO:tasks.workunit.client.0.smithi179.stderr: 56700K .......... .......... .......... .......... .......... 33% 22.2M 4s 2024-08-24T21:12:07.520 INFO:tasks.workunit.client.0.smithi179.stderr: 56750K .......... .......... .......... .......... .......... 33% 26.7M 4s 2024-08-24T21:12:07.524 INFO:tasks.workunit.client.0.smithi179.stderr: 56800K .......... .......... .......... .......... .......... 33% 17.5M 4s 2024-08-24T21:12:07.524 INFO:tasks.workunit.client.0.smithi179.stderr: 56850K .......... .......... .......... .......... .......... 33% 43.4M 4s 2024-08-24T21:12:07.525 INFO:tasks.workunit.client.0.smithi179.stderr: 56900K .......... .......... .......... .......... .......... 33% 29.2M 4s 2024-08-24T21:12:07.528 INFO:tasks.workunit.client.0.smithi179.stderr: 56950K .......... .......... .......... .......... .......... 33% 21.8M 4s 2024-08-24T21:12:07.529 INFO:tasks.workunit.client.0.smithi179.stderr: 57000K .......... .......... .......... .......... .......... 33% 41.3M 4s 2024-08-24T21:12:07.531 INFO:tasks.workunit.client.0.smithi179.stderr: 57050K .......... .......... .......... .......... .......... 33% 22.8M 4s 2024-08-24T21:12:07.533 INFO:tasks.workunit.client.0.smithi179.stderr: 57100K .......... .......... .......... .......... .......... 33% 28.9M 4s 2024-08-24T21:12:07.535 INFO:tasks.workunit.client.0.smithi179.stderr: 57150K .......... .......... .......... .......... .......... 33% 22.5M 4s 2024-08-24T21:12:07.537 INFO:tasks.workunit.client.0.smithi179.stderr: 57200K .......... .......... .......... .......... .......... 33% 26.4M 4s 2024-08-24T21:12:07.539 INFO:tasks.workunit.client.0.smithi179.stderr: 57250K .......... .......... .......... .......... .......... 33% 25.1M 4s 2024-08-24T21:12:07.540 INFO:tasks.workunit.client.0.smithi179.stderr: 57300K .......... .......... .......... .......... .......... 34% 46.6M 4s 2024-08-24T21:12:07.542 INFO:tasks.workunit.client.0.smithi179.stderr: 57350K .......... .......... .......... .......... .......... 34% 20.8M 4s 2024-08-24T21:12:07.543 INFO:tasks.workunit.client.0.smithi179.stderr: 57400K .......... .......... .......... .......... .......... 34% 44.0M 4s 2024-08-24T21:12:07.545 INFO:tasks.workunit.client.0.smithi179.stderr: 57450K .......... .......... .......... .......... .......... 34% 25.3M 4s 2024-08-24T21:12:07.547 INFO:tasks.workunit.client.0.smithi179.stderr: 57500K .......... .......... .......... .......... .......... 34% 34.4M 4s 2024-08-24T21:12:07.549 INFO:tasks.workunit.client.0.smithi179.stderr: 57550K .......... .......... .......... .......... .......... 34% 22.2M 4s 2024-08-24T21:12:07.551 INFO:tasks.workunit.client.0.smithi179.stderr: 57600K .......... .......... .......... .......... .......... 34% 25.3M 4s 2024-08-24T21:12:07.552 INFO:tasks.workunit.client.0.smithi179.stderr: 57650K .......... .......... .......... .......... .......... 34% 44.5M 4s 2024-08-24T21:12:07.554 INFO:tasks.workunit.client.0.smithi179.stderr: 57700K .......... .......... .......... .......... .......... 34% 23.9M 4s 2024-08-24T21:12:07.556 INFO:tasks.workunit.client.0.smithi179.stderr: 57750K .......... .......... .......... .......... .......... 34% 28.1M 4s 2024-08-24T21:12:07.557 INFO:tasks.workunit.client.0.smithi179.stderr: 57800K .......... .......... .......... .......... .......... 34% 38.2M 4s 2024-08-24T21:12:07.560 INFO:tasks.workunit.client.0.smithi179.stderr: 57850K .......... .......... .......... .......... .......... 34% 20.0M 4s 2024-08-24T21:12:07.560 INFO:tasks.workunit.client.0.smithi179.stderr: 57900K .......... .......... .......... .......... .......... 34% 70.7M 4s 2024-08-24T21:12:07.562 INFO:tasks.workunit.client.0.smithi179.stderr: 57950K .......... .......... .......... .......... .......... 34% 21.3M 4s 2024-08-24T21:12:07.564 INFO:tasks.workunit.client.0.smithi179.stderr: 58000K .......... .......... .......... .......... .......... 34% 27.5M 4s 2024-08-24T21:12:07.565 INFO:tasks.workunit.client.0.smithi179.stderr: 58050K .......... .......... .......... .......... .......... 34% 36.5M 4s 2024-08-24T21:12:07.567 INFO:tasks.workunit.client.0.smithi179.stderr: 58100K .......... .......... .......... .......... .......... 34% 25.0M 4s 2024-08-24T21:12:07.568 INFO:tasks.workunit.client.0.smithi179.stderr: 58150K .......... .......... .......... .......... .......... 34% 43.2M 4s 2024-08-24T21:12:07.570 INFO:tasks.workunit.client.0.smithi179.stderr: 58200K .......... .......... .......... .......... .......... 34% 24.9M 4s 2024-08-24T21:12:07.572 INFO:tasks.workunit.client.0.smithi179.stderr: 58250K .......... .......... .......... .......... .......... 34% 34.6M 4s 2024-08-24T21:12:07.573 INFO:tasks.workunit.client.0.smithi179.stderr: 58300K .......... .......... .......... .......... .......... 34% 28.0M 4s 2024-08-24T21:12:07.577 INFO:tasks.workunit.client.0.smithi179.stderr: 58350K .......... .......... .......... .......... .......... 34% 17.1M 4s 2024-08-24T21:12:07.578 INFO:tasks.workunit.client.0.smithi179.stderr: 58400K .......... .......... .......... .......... .......... 34% 25.7M 4s 2024-08-24T21:12:07.579 INFO:tasks.workunit.client.0.smithi179.stderr: 58450K .......... .......... .......... .......... .......... 34% 41.8M 4s 2024-08-24T21:12:07.581 INFO:tasks.workunit.client.0.smithi179.stderr: 58500K .......... .......... .......... .......... .......... 34% 37.0M 4s 2024-08-24T21:12:07.583 INFO:tasks.workunit.client.0.smithi179.stderr: 58550K .......... .......... .......... .......... .......... 34% 24.3M 4s 2024-08-24T21:12:07.585 INFO:tasks.workunit.client.0.smithi179.stderr: 58600K .......... .......... .......... .......... .......... 34% 22.1M 4s 2024-08-24T21:12:07.586 INFO:tasks.workunit.client.0.smithi179.stderr: 58650K .......... .......... .......... .......... .......... 34% 45.4M 4s 2024-08-24T21:12:07.588 INFO:tasks.workunit.client.0.smithi179.stderr: 58700K .......... .......... .......... .......... .......... 34% 24.1M 4s 2024-08-24T21:12:07.590 INFO:tasks.workunit.client.0.smithi179.stderr: 58750K .......... .......... .......... .......... .......... 34% 23.6M 4s 2024-08-24T21:12:07.592 INFO:tasks.workunit.client.0.smithi179.stderr: 58800K .......... .......... .......... .......... .......... 34% 31.7M 4s 2024-08-24T21:12:07.594 INFO:tasks.workunit.client.0.smithi179.stderr: 58850K .......... .......... .......... .......... .......... 34% 20.9M 4s 2024-08-24T21:12:07.595 INFO:tasks.workunit.client.0.smithi179.stderr: 58900K .......... .......... .......... .......... .......... 34% 46.2M 4s 2024-08-24T21:12:07.597 INFO:tasks.workunit.client.0.smithi179.stderr: 58950K .......... .......... .......... .......... .......... 35% 23.5M 4s 2024-08-24T21:12:07.599 INFO:tasks.workunit.client.0.smithi179.stderr: 59000K .......... .......... .......... .......... .......... 35% 37.9M 4s 2024-08-24T21:12:07.601 INFO:tasks.workunit.client.0.smithi179.stderr: 59050K .......... .......... .......... .......... .......... 35% 24.0M 4s 2024-08-24T21:12:07.603 INFO:tasks.workunit.client.0.smithi179.stderr: 59100K .......... .......... .......... .......... .......... 35% 19.3M 4s 2024-08-24T21:12:07.605 INFO:tasks.workunit.client.0.smithi179.stderr: 59150K .......... .......... .......... .......... .......... 35% 24.9M 4s 2024-08-24T21:12:07.606 INFO:tasks.workunit.client.0.smithi179.stderr: 59200K .......... .......... .......... .......... .......... 35% 42.9M 4s 2024-08-24T21:12:07.608 INFO:tasks.workunit.client.0.smithi179.stderr: 59250K .......... .......... .......... .......... .......... 35% 24.4M 4s 2024-08-24T21:12:07.609 INFO:tasks.workunit.client.0.smithi179.stderr: 59300K .......... .......... .......... .......... .......... 35% 39.8M 4s 2024-08-24T21:12:07.612 INFO:tasks.workunit.client.0.smithi179.stderr: 59350K .......... .......... .......... .......... .......... 35% 21.3M 4s 2024-08-24T21:12:07.613 INFO:tasks.workunit.client.0.smithi179.stderr: 59400K .......... .......... .......... .......... .......... 35% 59.0M 4s 2024-08-24T21:12:07.615 INFO:tasks.workunit.client.0.smithi179.stderr: 59450K .......... .......... .......... .......... .......... 35% 24.5M 4s 2024-08-24T21:12:07.616 INFO:tasks.workunit.client.0.smithi179.stderr: 59500K .......... .......... .......... .......... .......... 35% 39.1M 4s 2024-08-24T21:12:07.618 INFO:tasks.workunit.client.0.smithi179.stderr: 59550K .......... .......... .......... .......... .......... 35% 22.2M 4s 2024-08-24T21:12:07.620 INFO:tasks.workunit.client.0.smithi179.stderr: 59600K .......... .......... .......... .......... .......... 35% 25.1M 4s 2024-08-24T21:12:07.623 INFO:tasks.workunit.client.0.smithi179.stderr: 59650K .......... .......... .......... .......... .......... 35% 18.0M 4s 2024-08-24T21:12:07.624 INFO:tasks.workunit.client.0.smithi179.stderr: 59700K .......... .......... .......... .......... .......... 35% 42.0M 4s 2024-08-24T21:12:07.626 INFO:tasks.workunit.client.0.smithi179.stderr: 59750K .......... .......... .......... .......... .......... 35% 21.2M 4s 2024-08-24T21:12:07.627 INFO:tasks.workunit.client.0.smithi179.stderr: 59800K .......... .......... .......... .......... .......... 35% 37.8M 4s 2024-08-24T21:12:07.630 INFO:tasks.workunit.client.0.smithi179.stderr: 59850K .......... .......... .......... .......... .......... 35% 22.9M 4s 2024-08-24T21:12:07.630 INFO:tasks.workunit.client.0.smithi179.stderr: 59900K .......... .......... .......... .......... .......... 35% 66.4M 4s 2024-08-24T21:12:07.632 INFO:tasks.workunit.client.0.smithi179.stderr: 59950K .......... .......... .......... .......... .......... 35% 23.5M 4s 2024-08-24T21:12:07.635 INFO:tasks.workunit.client.0.smithi179.stderr: 60000K .......... .......... .......... .......... .......... 35% 18.2M 4s 2024-08-24T21:12:07.636 INFO:tasks.workunit.client.0.smithi179.stderr: 60050K .......... .......... .......... .......... .......... 35% 35.3M 4s 2024-08-24T21:12:07.639 INFO:tasks.workunit.client.0.smithi179.stderr: 60100K .......... .......... .......... .......... .......... 35% 21.7M 4s 2024-08-24T21:12:07.642 INFO:tasks.workunit.client.0.smithi179.stderr: 60150K .......... .......... .......... .......... .......... 35% 23.8M 4s 2024-08-24T21:12:07.642 INFO:tasks.workunit.client.0.smithi179.stderr: 60200K .......... .......... .......... .......... .......... 35% 50.5M 4s 2024-08-24T21:12:07.644 INFO:tasks.workunit.client.0.smithi179.stderr: 60250K .......... .......... .......... .......... .......... 35% 24.3M 4s 2024-08-24T21:12:07.646 INFO:tasks.workunit.client.0.smithi179.stderr: 60300K .......... .......... .......... .......... .......... 35% 28.3M 4s 2024-08-24T21:12:07.648 INFO:tasks.workunit.client.0.smithi179.stderr: 60350K .......... .......... .......... .......... .......... 35% 22.3M 4s 2024-08-24T21:12:07.651 INFO:tasks.workunit.client.0.smithi179.stderr: 60400K .......... .......... .......... .......... .......... 35% 25.6M 4s 2024-08-24T21:12:07.651 INFO:tasks.workunit.client.0.smithi179.stderr: 60450K .......... .......... .......... .......... .......... 35% 47.7M 4s 2024-08-24T21:12:07.653 INFO:tasks.workunit.client.0.smithi179.stderr: 60500K .......... .......... .......... .......... .......... 35% 21.3M 4s 2024-08-24T21:12:07.656 INFO:tasks.workunit.client.0.smithi179.stderr: 60550K .......... .......... .......... .......... .......... 35% 20.0M 4s 2024-08-24T21:12:07.657 INFO:tasks.workunit.client.0.smithi179.stderr: 60600K .......... .......... .......... .......... .......... 35% 37.9M 4s 2024-08-24T21:12:07.658 INFO:tasks.workunit.client.0.smithi179.stderr: 60650K .......... .......... .......... .......... .......... 36% 30.5M 4s 2024-08-24T21:12:07.660 INFO:tasks.workunit.client.0.smithi179.stderr: 60700K .......... .......... .......... .......... .......... 36% 24.0M 4s 2024-08-24T21:12:07.662 INFO:tasks.workunit.client.0.smithi179.stderr: 60750K .......... .......... .......... .......... .......... 36% 24.2M 4s 2024-08-24T21:12:07.665 INFO:tasks.workunit.client.0.smithi179.stderr: 60800K .......... .......... .......... .......... .......... 36% 19.9M 4s 2024-08-24T21:12:07.666 INFO:tasks.workunit.client.0.smithi179.stderr: 60850K .......... .......... .......... .......... .......... 36% 40.7M 4s 2024-08-24T21:12:07.668 INFO:tasks.workunit.client.0.smithi179.stderr: 60900K .......... .......... .......... .......... .......... 36% 24.7M 4s 2024-08-24T21:12:07.669 INFO:tasks.workunit.client.0.smithi179.stderr: 60950K .......... .......... .......... .......... .......... 36% 45.2M 4s 2024-08-24T21:12:07.671 INFO:tasks.workunit.client.0.smithi179.stderr: 61000K .......... .......... .......... .......... .......... 36% 22.1M 4s 2024-08-24T21:12:07.673 INFO:tasks.workunit.client.0.smithi179.stderr: 61050K .......... .......... .......... .......... .......... 36% 40.1M 4s 2024-08-24T21:12:07.675 INFO:tasks.workunit.client.0.smithi179.stderr: 61100K .......... .......... .......... .......... .......... 36% 23.8M 4s 2024-08-24T21:12:07.676 INFO:tasks.workunit.client.0.smithi179.stderr: 61150K .......... .......... .......... .......... .......... 36% 24.4M 4s 2024-08-24T21:12:07.679 INFO:tasks.workunit.client.0.smithi179.stderr: 61200K .......... .......... .......... .......... .......... 36% 21.8M 4s 2024-08-24T21:12:07.680 INFO:tasks.workunit.client.0.smithi179.stderr: 61250K .......... .......... .......... .......... .......... 36% 39.8M 4s 2024-08-24T21:12:07.682 INFO:tasks.workunit.client.0.smithi179.stderr: 61300K .......... .......... .......... .......... .......... 36% 30.1M 4s 2024-08-24T21:12:07.683 INFO:tasks.workunit.client.0.smithi179.stderr: 61350K .......... .......... .......... .......... .......... 36% 38.3M 4s 2024-08-24T21:12:07.685 INFO:tasks.workunit.client.0.smithi179.stderr: 61400K .......... .......... .......... .......... .......... 36% 23.7M 4s 2024-08-24T21:12:07.686 INFO:tasks.workunit.client.0.smithi179.stderr: 61450K .......... .......... .......... .......... .......... 36% 47.3M 4s 2024-08-24T21:12:07.688 INFO:tasks.workunit.client.0.smithi179.stderr: 61500K .......... .......... .......... .......... .......... 36% 21.4M 4s 2024-08-24T21:12:07.690 INFO:tasks.workunit.client.0.smithi179.stderr: 61550K .......... .......... .......... .......... .......... 36% 22.9M 4s 2024-08-24T21:12:07.691 INFO:tasks.workunit.client.0.smithi179.stderr: 61600K .......... .......... .......... .......... .......... 36% 42.0M 4s 2024-08-24T21:12:07.694 INFO:tasks.workunit.client.0.smithi179.stderr: 61650K .......... .......... .......... .......... .......... 36% 17.4M 4s 2024-08-24T21:12:07.695 INFO:tasks.workunit.client.0.smithi179.stderr: 61700K .......... .......... .......... .......... .......... 36% 45.2M 4s 2024-08-24T21:12:07.698 INFO:tasks.workunit.client.0.smithi179.stderr: 61750K .......... .......... .......... .......... .......... 36% 19.5M 4s 2024-08-24T21:12:07.700 INFO:tasks.workunit.client.0.smithi179.stderr: 61800K .......... .......... .......... .......... .......... 36% 23.9M 4s 2024-08-24T21:12:07.701 INFO:tasks.workunit.client.0.smithi179.stderr: 61850K .......... .......... .......... .......... .......... 36% 40.9M 4s 2024-08-24T21:12:07.703 INFO:tasks.workunit.client.0.smithi179.stderr: 61900K .......... .......... .......... .......... .......... 36% 23.4M 4s 2024-08-24T21:12:07.705 INFO:tasks.workunit.client.0.smithi179.stderr: 61950K .......... .......... .......... .......... .......... 36% 24.4M 4s 2024-08-24T21:12:07.707 INFO:tasks.workunit.client.0.smithi179.stderr: 62000K .......... .......... .......... .......... .......... 36% 44.2M 4s 2024-08-24T21:12:07.709 INFO:tasks.workunit.client.0.smithi179.stderr: 62050K .......... .......... .......... .......... .......... 36% 22.2M 4s 2024-08-24T21:12:07.710 INFO:tasks.workunit.client.0.smithi179.stderr: 62100K .......... .......... .......... .......... .......... 36% 33.4M 4s 2024-08-24T21:12:07.713 INFO:tasks.workunit.client.0.smithi179.stderr: 62150K .......... .......... .......... .......... .......... 36% 23.1M 4s 2024-08-24T21:12:07.713 INFO:tasks.workunit.client.0.smithi179.stderr: 62200K .......... .......... .......... .......... .......... 36% 55.2M 4s 2024-08-24T21:12:07.715 INFO:tasks.workunit.client.0.smithi179.stderr: 62250K .......... .......... .......... .......... .......... 36% 24.1M 4s 2024-08-24T21:12:07.716 INFO:tasks.workunit.client.0.smithi179.stderr: 62300K .......... .......... .......... .......... .......... 36% 40.1M 4s 2024-08-24T21:12:07.719 INFO:tasks.workunit.client.0.smithi179.stderr: 62350K .......... .......... .......... .......... .......... 37% 19.8M 4s 2024-08-24T21:12:07.721 INFO:tasks.workunit.client.0.smithi179.stderr: 62400K .......... .......... .......... .......... .......... 37% 23.3M 4s 2024-08-24T21:12:07.723 INFO:tasks.workunit.client.0.smithi179.stderr: 62450K .......... .......... .......... .......... .......... 37% 21.4M 4s 2024-08-24T21:12:07.725 INFO:tasks.workunit.client.0.smithi179.stderr: 62500K .......... .......... .......... .......... .......... 37% 28.4M 4s 2024-08-24T21:12:07.727 INFO:tasks.workunit.client.0.smithi179.stderr: 62550K .......... .......... .......... .......... .......... 37% 25.1M 4s 2024-08-24T21:12:07.728 INFO:tasks.workunit.client.0.smithi179.stderr: 62600K .......... .......... .......... .......... .......... 37% 39.0M 4s 2024-08-24T21:12:07.730 INFO:tasks.workunit.client.0.smithi179.stderr: 62650K .......... .......... .......... .......... .......... 37% 22.4M 4s 2024-08-24T21:12:07.731 INFO:tasks.workunit.client.0.smithi179.stderr: 62700K .......... .......... .......... .......... .......... 37% 46.7M 4s 2024-08-24T21:12:07.734 INFO:tasks.workunit.client.0.smithi179.stderr: 62750K .......... .......... .......... .......... .......... 37% 18.7M 4s 2024-08-24T21:12:07.736 INFO:tasks.workunit.client.0.smithi179.stderr: 62800K .......... .......... .......... .......... .......... 37% 23.8M 4s 2024-08-24T21:12:07.738 INFO:tasks.workunit.client.0.smithi179.stderr: 62850K .......... .......... .......... .......... .......... 37% 24.1M 4s 2024-08-24T21:12:07.741 INFO:tasks.workunit.client.0.smithi179.stderr: 62900K .......... .......... .......... .......... .......... 37% 22.8M 4s 2024-08-24T21:12:07.742 INFO:tasks.workunit.client.0.smithi179.stderr: 62950K .......... .......... .......... .......... .......... 37% 22.9M 4s 2024-08-24T21:12:07.744 INFO:tasks.workunit.client.0.smithi179.stderr: 63000K .......... .......... .......... .......... .......... 37% 34.1M 4s 2024-08-24T21:12:07.745 INFO:tasks.workunit.client.0.smithi179.stderr: 63050K .......... .......... .......... .......... .......... 37% 25.8M 4s 2024-08-24T21:12:07.747 INFO:tasks.workunit.client.0.smithi179.stderr: 63100K .......... .......... .......... .......... .......... 37% 31.9M 4s 2024-08-24T21:12:07.749 INFO:tasks.workunit.client.0.smithi179.stderr: 63150K .......... .......... .......... .......... .......... 37% 23.0M 4s 2024-08-24T21:12:07.751 INFO:tasks.workunit.client.0.smithi179.stderr: 63200K .......... .......... .......... .......... .......... 37% 24.5M 4s 2024-08-24T21:12:07.752 INFO:tasks.workunit.client.0.smithi179.stderr: 63250K .......... .......... .......... .......... .......... 37% 39.5M 4s 2024-08-24T21:12:07.754 INFO:tasks.workunit.client.0.smithi179.stderr: 63300K .......... .......... .......... .......... .......... 37% 28.0M 4s 2024-08-24T21:12:07.755 INFO:tasks.workunit.client.0.smithi179.stderr: 63350K .......... .......... .......... .......... .......... 37% 40.8M 4s 2024-08-24T21:12:07.757 INFO:tasks.workunit.client.0.smithi179.stderr: 63400K .......... .......... .......... .......... .......... 37% 23.8M 4s 2024-08-24T21:12:07.760 INFO:tasks.workunit.client.0.smithi179.stderr: 63450K .......... .......... .......... .......... .......... 37% 22.0M 4s 2024-08-24T21:12:07.760 INFO:tasks.workunit.client.0.smithi179.stderr: 63500K .......... .......... .......... .......... .......... 37% 53.4M 4s 2024-08-24T21:12:07.762 INFO:tasks.workunit.client.0.smithi179.stderr: 63550K .......... .......... .......... .......... .......... 37% 24.0M 4s 2024-08-24T21:12:07.765 INFO:tasks.workunit.client.0.smithi179.stderr: 63600K .......... .......... .......... .......... .......... 37% 23.2M 4s 2024-08-24T21:12:07.767 INFO:tasks.workunit.client.0.smithi179.stderr: 63650K .......... .......... .......... .......... .......... 37% 30.0M 4s 2024-08-24T21:12:07.769 INFO:tasks.workunit.client.0.smithi179.stderr: 63700K .......... .......... .......... .......... .......... 37% 26.0M 4s 2024-08-24T21:12:07.769 INFO:tasks.workunit.client.0.smithi179.stderr: 63750K .......... .......... .......... .......... .......... 37% 58.5M 4s 2024-08-24T21:12:07.771 INFO:tasks.workunit.client.0.smithi179.stderr: 63800K .......... .......... .......... .......... .......... 37% 20.9M 4s 2024-08-24T21:12:07.774 INFO:tasks.workunit.client.0.smithi179.stderr: 63850K .......... .......... .......... .......... .......... 37% 30.8M 4s 2024-08-24T21:12:07.776 INFO:tasks.workunit.client.0.smithi179.stderr: 63900K .......... .......... .......... .......... .......... 37% 22.3M 4s 2024-08-24T21:12:07.780 INFO:tasks.workunit.client.0.smithi179.stderr: 63950K .......... .......... .......... .......... .......... 37% 24.1M 4s 2024-08-24T21:12:07.780 INFO:tasks.workunit.client.0.smithi179.stderr: 64000K .......... .......... .......... .......... .......... 37% 61.5M 4s 2024-08-24T21:12:07.780 INFO:tasks.workunit.client.0.smithi179.stderr: 64050K .......... .......... .......... .......... .......... 38% 20.5M 4s 2024-08-24T21:12:07.782 INFO:tasks.workunit.client.0.smithi179.stderr: 64100K .......... .......... .......... .......... .......... 38% 31.5M 4s 2024-08-24T21:12:07.784 INFO:tasks.workunit.client.0.smithi179.stderr: 64150K .......... .......... .......... .......... .......... 38% 25.5M 4s 2024-08-24T21:12:07.786 INFO:tasks.workunit.client.0.smithi179.stderr: 64200K .......... .......... .......... .......... .......... 38% 26.9M 4s 2024-08-24T21:12:07.787 INFO:tasks.workunit.client.0.smithi179.stderr: 64250K .......... .......... .......... .......... .......... 38% 29.5M 4s 2024-08-24T21:12:07.789 INFO:tasks.workunit.client.0.smithi179.stderr: 64300K .......... .......... .......... .......... .......... 38% 37.2M 4s 2024-08-24T21:12:07.791 INFO:tasks.workunit.client.0.smithi179.stderr: 64350K .......... .......... .......... .......... .......... 38% 18.7M 4s 2024-08-24T21:12:07.792 INFO:tasks.workunit.client.0.smithi179.stderr: 64400K .......... .......... .......... .......... .......... 38% 41.6M 4s 2024-08-24T21:12:07.794 INFO:tasks.workunit.client.0.smithi179.stderr: 64450K .......... .......... .......... .......... .......... 38% 32.4M 4s 2024-08-24T21:12:07.795 INFO:tasks.workunit.client.0.smithi179.stderr: 64500K .......... .......... .......... .......... .......... 38% 30.9M 4s 2024-08-24T21:12:07.798 INFO:tasks.workunit.client.0.smithi179.stderr: 64550K .......... .......... .......... .......... .......... 38% 22.6M 4s 2024-08-24T21:12:07.799 INFO:tasks.workunit.client.0.smithi179.stderr: 64600K .......... .......... .......... .......... .......... 38% 45.5M 4s 2024-08-24T21:12:07.802 INFO:tasks.workunit.client.0.smithi179.stderr: 64650K .......... .......... .......... .......... .......... 38% 17.8M 4s 2024-08-24T21:12:07.803 INFO:tasks.workunit.client.0.smithi179.stderr: 64700K .......... .......... .......... .......... .......... 38% 28.6M 4s 2024-08-24T21:12:07.808 INFO:tasks.workunit.client.0.smithi179.stderr: 64750K .......... .......... .......... .......... .......... 38% 12.9M 4s 2024-08-24T21:12:07.808 INFO:tasks.workunit.client.0.smithi179.stderr: 64800K .......... .......... .......... .......... .......... 38% 49.9M 4s 2024-08-24T21:12:07.811 INFO:tasks.workunit.client.0.smithi179.stderr: 64850K .......... .......... .......... .......... .......... 38% 18.5M 4s 2024-08-24T21:12:07.813 INFO:tasks.workunit.client.0.smithi179.stderr: 64900K .......... .......... .......... .......... .......... 38% 27.5M 4s 2024-08-24T21:12:07.814 INFO:tasks.workunit.client.0.smithi179.stderr: 64950K .......... .......... .......... .......... .......... 38% 25.1M 4s 2024-08-24T21:12:07.815 INFO:tasks.workunit.client.0.smithi179.stderr: 65000K .......... .......... .......... .......... .......... 38% 41.9M 4s 2024-08-24T21:12:07.819 INFO:tasks.workunit.client.0.smithi179.stderr: 65050K .......... .......... .......... .......... .......... 38% 16.7M 4s 2024-08-24T21:12:07.821 INFO:tasks.workunit.client.0.smithi179.stderr: 65100K .......... .......... .......... .......... .......... 38% 26.8M 4s 2024-08-24T21:12:07.822 INFO:tasks.workunit.client.0.smithi179.stderr: 65150K .......... .......... .......... .......... .......... 38% 31.9M 4s 2024-08-24T21:12:07.824 INFO:tasks.workunit.client.0.smithi179.stderr: 65200K .......... .......... .......... .......... .......... 38% 23.2M 4s 2024-08-24T21:12:07.827 INFO:tasks.workunit.client.0.smithi179.stderr: 65250K .......... .......... .......... .......... .......... 38% 16.9M 4s 2024-08-24T21:12:07.828 INFO:tasks.workunit.client.0.smithi179.stderr: 65300K .......... .......... .......... .......... .......... 38% 55.9M 4s 2024-08-24T21:12:07.829 INFO:tasks.workunit.client.0.smithi179.stderr: 65350K .......... .......... .......... .......... .......... 38% 25.0M 4s 2024-08-24T21:12:07.832 INFO:tasks.workunit.client.0.smithi179.stderr: 65400K .......... .......... .......... .......... .......... 38% 33.4M 4s 2024-08-24T21:12:07.833 INFO:tasks.workunit.client.0.smithi179.stderr: 65450K .......... .......... .......... .......... .......... 38% 24.3M 4s 2024-08-24T21:12:07.834 INFO:tasks.workunit.client.0.smithi179.stderr: 65500K .......... .......... .......... .......... .......... 38% 44.5M 4s 2024-08-24T21:12:07.836 INFO:tasks.workunit.client.0.smithi179.stderr: 65550K .......... .......... .......... .......... .......... 38% 23.7M 4s 2024-08-24T21:12:07.838 INFO:tasks.workunit.client.0.smithi179.stderr: 65600K .......... .......... .......... .......... .......... 38% 24.3M 4s 2024-08-24T21:12:07.839 INFO:tasks.workunit.client.0.smithi179.stderr: 65650K .......... .......... .......... .......... .......... 38% 41.4M 4s 2024-08-24T21:12:07.841 INFO:tasks.workunit.client.0.smithi179.stderr: 65700K .......... .......... .......... .......... .......... 39% 24.3M 4s 2024-08-24T21:12:07.844 INFO:tasks.workunit.client.0.smithi179.stderr: 65750K .......... .......... .......... .......... .......... 39% 23.4M 4s 2024-08-24T21:12:07.845 INFO:tasks.workunit.client.0.smithi179.stderr: 65800K .......... .......... .......... .......... .......... 39% 35.8M 4s 2024-08-24T21:12:07.847 INFO:tasks.workunit.client.0.smithi179.stderr: 65850K .......... .......... .......... .......... .......... 39% 24.6M 4s 2024-08-24T21:12:07.849 INFO:tasks.workunit.client.0.smithi179.stderr: 65900K .......... .......... .......... .......... .......... 39% 30.4M 4s 2024-08-24T21:12:07.850 INFO:tasks.workunit.client.0.smithi179.stderr: 65950K .......... .......... .......... .......... .......... 39% 31.9M 4s 2024-08-24T21:12:07.852 INFO:tasks.workunit.client.0.smithi179.stderr: 66000K .......... .......... .......... .......... .......... 39% 21.6M 4s 2024-08-24T21:12:07.854 INFO:tasks.workunit.client.0.smithi179.stderr: 66050K .......... .......... .......... .......... .......... 39% 39.5M 4s 2024-08-24T21:12:07.855 INFO:tasks.workunit.client.0.smithi179.stderr: 66100K .......... .......... .......... .......... .......... 39% 25.0M 4s 2024-08-24T21:12:07.856 INFO:tasks.workunit.client.0.smithi179.stderr: 66150K .......... .......... .......... .......... .......... 39% 38.4M 4s 2024-08-24T21:12:07.858 INFO:tasks.workunit.client.0.smithi179.stderr: 66200K .......... .......... .......... .......... .......... 39% 25.9M 4s 2024-08-24T21:12:07.860 INFO:tasks.workunit.client.0.smithi179.stderr: 66250K .......... .......... .......... .......... .......... 39% 35.2M 4s 2024-08-24T21:12:07.861 INFO:tasks.workunit.client.0.smithi179.stderr: 66300K .......... .......... .......... .......... .......... 39% 27.5M 4s 2024-08-24T21:12:07.864 INFO:tasks.workunit.client.0.smithi179.stderr: 66350K .......... .......... .......... .......... .......... 39% 20.9M 4s 2024-08-24T21:12:07.866 INFO:tasks.workunit.client.0.smithi179.stderr: 66400K .......... .......... .......... .......... .......... 39% 30.3M 4s 2024-08-24T21:12:07.867 INFO:tasks.workunit.client.0.smithi179.stderr: 66450K .......... .......... .......... .......... .......... 39% 37.8M 4s 2024-08-24T21:12:07.869 INFO:tasks.workunit.client.0.smithi179.stderr: 66500K .......... .......... .......... .......... .......... 39% 21.2M 4s 2024-08-24T21:12:07.871 INFO:tasks.workunit.client.0.smithi179.stderr: 66550K .......... .......... .......... .......... .......... 39% 43.1M 4s 2024-08-24T21:12:07.872 INFO:tasks.workunit.client.0.smithi179.stderr: 66600K .......... .......... .......... .......... .......... 39% 25.8M 4s 2024-08-24T21:12:07.874 INFO:tasks.workunit.client.0.smithi179.stderr: 66650K .......... .......... .......... .......... .......... 39% 35.1M 4s 2024-08-24T21:12:07.876 INFO:tasks.workunit.client.0.smithi179.stderr: 66700K .......... .......... .......... .......... .......... 39% 23.2M 4s 2024-08-24T21:12:07.878 INFO:tasks.workunit.client.0.smithi179.stderr: 66750K .......... .......... .......... .......... .......... 39% 23.3M 4s 2024-08-24T21:12:07.879 INFO:tasks.workunit.client.0.smithi179.stderr: 66800K .......... .......... .......... .......... .......... 39% 44.9M 4s 2024-08-24T21:12:07.880 INFO:tasks.workunit.client.0.smithi179.stderr: 66850K .......... .......... .......... .......... .......... 39% 28.1M 4s 2024-08-24T21:12:07.883 INFO:tasks.workunit.client.0.smithi179.stderr: 66900K .......... .......... .......... .......... .......... 39% 20.0M 4s 2024-08-24T21:12:07.885 INFO:tasks.workunit.client.0.smithi179.stderr: 66950K .......... .......... .......... .......... .......... 39% 39.2M 4s 2024-08-24T21:12:07.886 INFO:tasks.workunit.client.0.smithi179.stderr: 67000K .......... .......... .......... .......... .......... 39% 24.2M 4s 2024-08-24T21:12:07.888 INFO:tasks.workunit.client.0.smithi179.stderr: 67050K .......... .......... .......... .......... .......... 39% 33.4M 4s 2024-08-24T21:12:07.890 INFO:tasks.workunit.client.0.smithi179.stderr: 67100K .......... .......... .......... .......... .......... 39% 28.5M 4s 2024-08-24T21:12:07.892 INFO:tasks.workunit.client.0.smithi179.stderr: 67150K .......... .......... .......... .......... .......... 39% 23.2M 4s 2024-08-24T21:12:07.893 INFO:tasks.workunit.client.0.smithi179.stderr: 67200K .......... .......... .......... .......... .......... 39% 43.3M 4s 2024-08-24T21:12:07.895 INFO:tasks.workunit.client.0.smithi179.stderr: 67250K .......... .......... .......... .......... .......... 39% 25.3M 4s 2024-08-24T21:12:07.896 INFO:tasks.workunit.client.0.smithi179.stderr: 67300K .......... .......... .......... .......... .......... 39% 41.1M 4s 2024-08-24T21:12:07.898 INFO:tasks.workunit.client.0.smithi179.stderr: 67350K .......... .......... .......... .......... .......... 39% 23.1M 4s 2024-08-24T21:12:07.899 INFO:tasks.workunit.client.0.smithi179.stderr: 67400K .......... .......... .......... .......... .......... 40% 42.8M 4s 2024-08-24T21:12:07.902 INFO:tasks.workunit.client.0.smithi179.stderr: 67450K .......... .......... .......... .......... .......... 40% 20.1M 4s 2024-08-24T21:12:07.904 INFO:tasks.workunit.client.0.smithi179.stderr: 67500K .......... .......... .......... .......... .......... 40% 25.3M 4s 2024-08-24T21:12:07.905 INFO:tasks.workunit.client.0.smithi179.stderr: 67550K .......... .......... .......... .......... .......... 40% 26.8M 4s 2024-08-24T21:12:07.907 INFO:tasks.workunit.client.0.smithi179.stderr: 67600K .......... .......... .......... .......... .......... 40% 27.7M 4s 2024-08-24T21:12:07.909 INFO:tasks.workunit.client.0.smithi179.stderr: 67650K .......... .......... .......... .......... .......... 40% 30.5M 4s 2024-08-24T21:12:07.910 INFO:tasks.workunit.client.0.smithi179.stderr: 67700K .......... .......... .......... .......... .......... 40% 28.0M 4s 2024-08-24T21:12:07.912 INFO:tasks.workunit.client.0.smithi179.stderr: 67750K .......... .......... .......... .......... .......... 40% 24.4M 4s 2024-08-24T21:12:07.914 INFO:tasks.workunit.client.0.smithi179.stderr: 67800K .......... .......... .......... .......... .......... 40% 34.6M 4s 2024-08-24T21:12:07.915 INFO:tasks.workunit.client.0.smithi179.stderr: 67850K .......... .......... .......... .......... .......... 40% 31.9M 4s 2024-08-24T21:12:07.917 INFO:tasks.workunit.client.0.smithi179.stderr: 67900K .......... .......... .......... .......... .......... 40% 37.2M 4s 2024-08-24T21:12:07.919 INFO:tasks.workunit.client.0.smithi179.stderr: 67950K .......... .......... .......... .......... .......... 40% 23.7M 4s 2024-08-24T21:12:07.922 INFO:tasks.workunit.client.0.smithi179.stderr: 68000K .......... .......... .......... .......... .......... 40% 20.1M 4s 2024-08-24T21:12:07.922 INFO:tasks.workunit.client.0.smithi179.stderr: 68050K .......... .......... .......... .......... .......... 40% 45.0M 4s 2024-08-24T21:12:07.924 INFO:tasks.workunit.client.0.smithi179.stderr: 68100K .......... .......... .......... .......... .......... 40% 31.5M 4s 2024-08-24T21:12:07.926 INFO:tasks.workunit.client.0.smithi179.stderr: 68150K .......... .......... .......... .......... .......... 40% 29.4M 4s 2024-08-24T21:12:07.928 INFO:tasks.workunit.client.0.smithi179.stderr: 68200K .......... .......... .......... .......... .......... 40% 23.7M 4s 2024-08-24T21:12:07.929 INFO:tasks.workunit.client.0.smithi179.stderr: 68250K .......... .......... .......... .......... .......... 40% 29.5M 4s 2024-08-24T21:12:07.930 INFO:tasks.workunit.client.0.smithi179.stderr: 68300K .......... .......... .......... .......... .......... 40% 44.6M 4s 2024-08-24T21:12:07.932 INFO:tasks.workunit.client.0.smithi179.stderr: 68350K .......... .......... .......... .......... .......... 40% 24.3M 4s 2024-08-24T21:12:07.934 INFO:tasks.workunit.client.0.smithi179.stderr: 68400K .......... .......... .......... .......... .......... 40% 24.6M 4s 2024-08-24T21:12:07.935 INFO:tasks.workunit.client.0.smithi179.stderr: 68450K .......... .......... .......... .......... .......... 40% 40.2M 4s 2024-08-24T21:12:07.938 INFO:tasks.workunit.client.0.smithi179.stderr: 68500K .......... .......... .......... .......... .......... 40% 23.1M 4s 2024-08-24T21:12:07.939 INFO:tasks.workunit.client.0.smithi179.stderr: 68550K .......... .......... .......... .......... .......... 40% 29.3M 4s 2024-08-24T21:12:07.940 INFO:tasks.workunit.client.0.smithi179.stderr: 68600K .......... .......... .......... .......... .......... 40% 33.3M 4s 2024-08-24T21:12:07.944 INFO:tasks.workunit.client.0.smithi179.stderr: 68650K .......... .......... .......... .......... .......... 40% 22.7M 4s 2024-08-24T21:12:07.944 INFO:tasks.workunit.client.0.smithi179.stderr: 68700K .......... .......... .......... .......... .......... 40% 44.0M 4s 2024-08-24T21:12:07.946 INFO:tasks.workunit.client.0.smithi179.stderr: 68750K .......... .......... .......... .......... .......... 40% 22.7M 4s 2024-08-24T21:12:07.947 INFO:tasks.workunit.client.0.smithi179.stderr: 68800K .......... .......... .......... .......... .......... 40% 42.0M 4s 2024-08-24T21:12:07.949 INFO:tasks.workunit.client.0.smithi179.stderr: 68850K .......... .......... .......... .......... .......... 40% 27.6M 4s 2024-08-24T21:12:07.951 INFO:tasks.workunit.client.0.smithi179.stderr: 68900K .......... .......... .......... .......... .......... 40% 22.1M 4s 2024-08-24T21:12:07.953 INFO:tasks.workunit.client.0.smithi179.stderr: 68950K .......... .......... .......... .......... .......... 40% 35.5M 4s 2024-08-24T21:12:07.954 INFO:tasks.workunit.client.0.smithi179.stderr: 69000K .......... .......... .......... .......... .......... 40% 38.6M 4s 2024-08-24T21:12:07.956 INFO:tasks.workunit.client.0.smithi179.stderr: 69050K .......... .......... .......... .......... .......... 40% 31.7M 4s 2024-08-24T21:12:07.957 INFO:tasks.workunit.client.0.smithi179.stderr: 69100K .......... .......... .......... .......... .......... 41% 22.3M 4s 2024-08-24T21:12:07.960 INFO:tasks.workunit.client.0.smithi179.stderr: 69150K .......... .......... .......... .......... .......... 41% 26.4M 4s 2024-08-24T21:12:07.961 INFO:tasks.workunit.client.0.smithi179.stderr: 69200K .......... .......... .......... .......... .......... 41% 31.3M 4s 2024-08-24T21:12:07.963 INFO:tasks.workunit.client.0.smithi179.stderr: 69250K .......... .......... .......... .......... .......... 41% 23.5M 4s 2024-08-24T21:12:07.965 INFO:tasks.workunit.client.0.smithi179.stderr: 69300K .......... .......... .......... .......... .......... 41% 21.2M 4s 2024-08-24T21:12:07.967 INFO:tasks.workunit.client.0.smithi179.stderr: 69350K .......... .......... .......... .......... .......... 41% 46.1M 4s 2024-08-24T21:12:07.969 INFO:tasks.workunit.client.0.smithi179.stderr: 69400K .......... .......... .......... .......... .......... 41% 21.5M 4s 2024-08-24T21:12:07.970 INFO:tasks.workunit.client.0.smithi179.stderr: 69450K .......... .......... .......... .......... .......... 41% 29.0M 4s 2024-08-24T21:12:07.973 INFO:tasks.workunit.client.0.smithi179.stderr: 69500K .......... .......... .......... .......... .......... 41% 22.0M 4s 2024-08-24T21:12:07.975 INFO:tasks.workunit.client.0.smithi179.stderr: 69550K .......... .......... .......... .......... .......... 41% 19.7M 4s 2024-08-24T21:12:07.976 INFO:tasks.workunit.client.0.smithi179.stderr: 69600K .......... .......... .......... .......... .......... 41% 42.2M 4s 2024-08-24T21:12:07.982 INFO:tasks.workunit.client.0.smithi179.stderr: 69650K .......... .......... .......... .......... .......... 41% 13.1M 4s 2024-08-24T21:12:07.982 INFO:tasks.workunit.client.0.smithi179.stderr: 69700K .......... .......... .......... .......... .......... 41% 40.2M 4s 2024-08-24T21:12:07.985 INFO:tasks.workunit.client.0.smithi179.stderr: 69750K .......... .......... .......... .......... .......... 41% 15.6M 4s 2024-08-24T21:12:07.988 INFO:tasks.workunit.client.0.smithi179.stderr: 69800K .......... .......... .......... .......... .......... 41% 14.0M 4s 2024-08-24T21:12:07.990 INFO:tasks.workunit.client.0.smithi179.stderr: 69850K .......... .......... .......... .......... .......... 41% 26.2M 4s 2024-08-24T21:12:07.992 INFO:tasks.workunit.client.0.smithi179.stderr: 69900K .......... .......... .......... .......... .......... 41% 21.9M 4s 2024-08-24T21:12:07.996 INFO:tasks.workunit.client.0.smithi179.stderr: 69950K .......... .......... .......... .......... .......... 41% 12.9M 4s 2024-08-24T21:12:07.997 INFO:tasks.workunit.client.0.smithi179.stderr: 70000K .......... .......... .......... .......... .......... 41% 31.5M 4s 2024-08-24T21:12:07.999 INFO:tasks.workunit.client.0.smithi179.stderr: 70050K .......... .......... .......... .......... .......... 41% 25.2M 4s 2024-08-24T21:12:08.001 INFO:tasks.workunit.client.0.smithi179.stderr: 70100K .......... .......... .......... .......... .......... 41% 26.2M 4s 2024-08-24T21:12:08.003 INFO:tasks.workunit.client.0.smithi179.stderr: 70150K .......... .......... .......... .......... .......... 41% 24.6M 4s 2024-08-24T21:12:08.004 INFO:tasks.workunit.client.0.smithi179.stderr: 70200K .......... .......... .......... .......... .......... 41% 38.4M 4s 2024-08-24T21:12:08.006 INFO:tasks.workunit.client.0.smithi179.stderr: 70250K .......... .......... .......... .......... .......... 41% 24.1M 4s 2024-08-24T21:12:08.009 INFO:tasks.workunit.client.0.smithi179.stderr: 70300K .......... .......... .......... .......... .......... 41% 22.2M 4s 2024-08-24T21:12:08.011 INFO:tasks.workunit.client.0.smithi179.stderr: 70350K .......... .......... .......... .......... .......... 41% 24.9M 4s 2024-08-24T21:12:08.012 INFO:tasks.workunit.client.0.smithi179.stderr: 70400K .......... .......... .......... .......... .......... 41% 44.3M 4s 2024-08-24T21:12:08.014 INFO:tasks.workunit.client.0.smithi179.stderr: 70450K .......... .......... .......... .......... .......... 41% 25.2M 4s 2024-08-24T21:12:08.015 INFO:tasks.workunit.client.0.smithi179.stderr: 70500K .......... .......... .......... .......... .......... 41% 36.8M 4s 2024-08-24T21:12:08.017 INFO:tasks.workunit.client.0.smithi179.stderr: 70550K .......... .......... .......... .......... .......... 41% 24.5M 4s 2024-08-24T21:12:08.018 INFO:tasks.workunit.client.0.smithi179.stderr: 70600K .......... .......... .......... .......... .......... 41% 58.2M 4s 2024-08-24T21:12:08.020 INFO:tasks.workunit.client.0.smithi179.stderr: 70650K .......... .......... .......... .......... .......... 41% 22.5M 4s 2024-08-24T21:12:08.021 INFO:tasks.workunit.client.0.smithi179.stderr: 70700K .......... .......... .......... .......... .......... 41% 38.7M 4s 2024-08-24T21:12:08.024 INFO:tasks.workunit.client.0.smithi179.stderr: 70750K .......... .......... .......... .......... .......... 42% 24.3M 4s 2024-08-24T21:12:08.025 INFO:tasks.workunit.client.0.smithi179.stderr: 70800K .......... .......... .......... .......... .......... 42% 26.4M 4s 2024-08-24T21:12:08.029 INFO:tasks.workunit.client.0.smithi179.stderr: 70850K .......... .......... .......... .......... .......... 42% 15.3M 4s 2024-08-24T21:12:08.029 INFO:tasks.workunit.client.0.smithi179.stderr: 70900K .......... .......... .......... .......... .......... 42% 39.8M 4s 2024-08-24T21:12:08.032 INFO:tasks.workunit.client.0.smithi179.stderr: 70950K .......... .......... .......... .......... .......... 42% 21.2M 4s 2024-08-24T21:12:08.033 INFO:tasks.workunit.client.0.smithi179.stderr: 71000K .......... .......... .......... .......... .......... 42% 36.2M 4s 2024-08-24T21:12:08.035 INFO:tasks.workunit.client.0.smithi179.stderr: 71050K .......... .......... .......... .......... .......... 42% 23.7M 4s 2024-08-24T21:12:08.037 INFO:tasks.workunit.client.0.smithi179.stderr: 71100K .......... .......... .......... .......... .......... 42% 27.1M 4s 2024-08-24T21:12:08.039 INFO:tasks.workunit.client.0.smithi179.stderr: 71150K .......... .......... .......... .......... .......... 42% 27.7M 4s 2024-08-24T21:12:08.041 INFO:tasks.workunit.client.0.smithi179.stderr: 71200K .......... .......... .......... .......... .......... 42% 25.5M 4s 2024-08-24T21:12:08.042 INFO:tasks.workunit.client.0.smithi179.stderr: 71250K .......... .......... .......... .......... .......... 42% 38.0M 4s 2024-08-24T21:12:08.044 INFO:tasks.workunit.client.0.smithi179.stderr: 71300K .......... .......... .......... .......... .......... 42% 25.8M 4s 2024-08-24T21:12:08.045 INFO:tasks.workunit.client.0.smithi179.stderr: 71350K .......... .......... .......... .......... .......... 42% 41.7M 4s 2024-08-24T21:12:08.047 INFO:tasks.workunit.client.0.smithi179.stderr: 71400K .......... .......... .......... .......... .......... 42% 24.3M 4s 2024-08-24T21:12:08.049 INFO:tasks.workunit.client.0.smithi179.stderr: 71450K .......... .......... .......... .......... .......... 42% 21.6M 4s 2024-08-24T21:12:08.050 INFO:tasks.workunit.client.0.smithi179.stderr: 71500K .......... .......... .......... .......... .......... 42% 46.2M 4s 2024-08-24T21:12:08.052 INFO:tasks.workunit.client.0.smithi179.stderr: 71550K .......... .......... .......... .......... .......... 42% 24.3M 4s 2024-08-24T21:12:08.055 INFO:tasks.workunit.client.0.smithi179.stderr: 71600K .......... .......... .......... .......... .......... 42% 24.5M 4s 2024-08-24T21:12:08.055 INFO:tasks.workunit.client.0.smithi179.stderr: 71650K .......... .......... .......... .......... .......... 42% 46.5M 4s 2024-08-24T21:12:08.058 INFO:tasks.workunit.client.0.smithi179.stderr: 71700K .......... .......... .......... .......... .......... 42% 20.2M 4s 2024-08-24T21:12:08.059 INFO:tasks.workunit.client.0.smithi179.stderr: 71750K .......... .......... .......... .......... .......... 42% 32.8M 4s 2024-08-24T21:12:08.061 INFO:tasks.workunit.client.0.smithi179.stderr: 71800K .......... .......... .......... .......... .......... 42% 26.2M 4s 2024-08-24T21:12:08.062 INFO:tasks.workunit.client.0.smithi179.stderr: 71850K .......... .......... .......... .......... .......... 42% 49.9M 4s 2024-08-24T21:12:08.064 INFO:tasks.workunit.client.0.smithi179.stderr: 71900K .......... .......... .......... .......... .......... 42% 25.7M 4s 2024-08-24T21:12:08.066 INFO:tasks.workunit.client.0.smithi179.stderr: 71950K .......... .......... .......... .......... .......... 42% 22.6M 4s 2024-08-24T21:12:08.068 INFO:tasks.workunit.client.0.smithi179.stderr: 72000K .......... .......... .......... .......... .......... 42% 25.4M 4s 2024-08-24T21:12:08.069 INFO:tasks.workunit.client.0.smithi179.stderr: 72050K .......... .......... .......... .......... .......... 42% 38.1M 4s 2024-08-24T21:12:08.071 INFO:tasks.workunit.client.0.smithi179.stderr: 72100K .......... .......... .......... .......... .......... 42% 27.9M 4s 2024-08-24T21:12:08.073 INFO:tasks.workunit.client.0.smithi179.stderr: 72150K .......... .......... .......... .......... .......... 42% 30.9M 4s 2024-08-24T21:12:08.075 INFO:tasks.workunit.client.0.smithi179.stderr: 72200K .......... .......... .......... .......... .......... 42% 21.8M 4s 2024-08-24T21:12:08.076 INFO:tasks.workunit.client.0.smithi179.stderr: 72250K .......... .......... .......... .......... .......... 42% 39.6M 4s 2024-08-24T21:12:08.078 INFO:tasks.workunit.client.0.smithi179.stderr: 72300K .......... .......... .......... .......... .......... 42% 27.5M 4s 2024-08-24T21:12:08.080 INFO:tasks.workunit.client.0.smithi179.stderr: 72350K .......... .......... .......... .......... .......... 42% 21.6M 4s 2024-08-24T21:12:08.082 INFO:tasks.workunit.client.0.smithi179.stderr: 72400K .......... .......... .......... .......... .......... 42% 41.3M 4s 2024-08-24T21:12:08.083 INFO:tasks.workunit.client.0.smithi179.stderr: 72450K .......... .......... .......... .......... .......... 43% 24.7M 4s 2024-08-24T21:12:08.085 INFO:tasks.workunit.client.0.smithi179.stderr: 72500K .......... .......... .......... .......... .......... 43% 28.6M 4s 2024-08-24T21:12:08.087 INFO:tasks.workunit.client.0.smithi179.stderr: 72550K .......... .......... .......... .......... .......... 43% 25.2M 4s 2024-08-24T21:12:08.089 INFO:tasks.workunit.client.0.smithi179.stderr: 72600K .......... .......... .......... .......... .......... 43% 27.0M 4s 2024-08-24T21:12:08.091 INFO:tasks.workunit.client.0.smithi179.stderr: 72650K .......... .......... .......... .......... .......... 43% 42.3M 4s 2024-08-24T21:12:08.092 INFO:tasks.workunit.client.0.smithi179.stderr: 72700K .......... .......... .......... .......... .......... 43% 26.7M 4s 2024-08-24T21:12:08.094 INFO:tasks.workunit.client.0.smithi179.stderr: 72750K .......... .......... .......... .......... .......... 43% 22.4M 4s 2024-08-24T21:12:08.097 INFO:tasks.workunit.client.0.smithi179.stderr: 72800K .......... .......... .......... .......... .......... 43% 24.9M 4s 2024-08-24T21:12:08.097 INFO:tasks.workunit.client.0.smithi179.stderr: 72850K .......... .......... .......... .......... .......... 43% 41.9M 4s 2024-08-24T21:12:08.098 INFO:tasks.workunit.client.0.smithi179.stderr: 72900K .......... .......... .......... .......... .......... 43% 40.7M 4s 2024-08-24T21:12:08.101 INFO:tasks.workunit.client.0.smithi179.stderr: 72950K .......... .......... .......... .......... .......... 43% 21.7M 4s 2024-08-24T21:12:08.102 INFO:tasks.workunit.client.0.smithi179.stderr: 73000K .......... .......... .......... .......... .......... 43% 40.5M 4s 2024-08-24T21:12:08.104 INFO:tasks.workunit.client.0.smithi179.stderr: 73050K .......... .......... .......... .......... .......... 43% 22.5M 4s 2024-08-24T21:12:08.106 INFO:tasks.workunit.client.0.smithi179.stderr: 73100K .......... .......... .......... .......... .......... 43% 25.7M 4s 2024-08-24T21:12:08.108 INFO:tasks.workunit.client.0.smithi179.stderr: 73150K .......... .......... .......... .......... .......... 43% 20.7M 4s 2024-08-24T21:12:08.109 INFO:tasks.workunit.client.0.smithi179.stderr: 73200K .......... .......... .......... .......... .......... 43% 49.4M 4s 2024-08-24T21:12:08.111 INFO:tasks.workunit.client.0.smithi179.stderr: 73250K .......... .......... .......... .......... .......... 43% 25.0M 4s 2024-08-24T21:12:08.112 INFO:tasks.workunit.client.0.smithi179.stderr: 73300K .......... .......... .......... .......... .......... 43% 40.9M 4s 2024-08-24T21:12:08.115 INFO:tasks.workunit.client.0.smithi179.stderr: 73350K .......... .......... .......... .......... .......... 43% 19.2M 4s 2024-08-24T21:12:08.116 INFO:tasks.workunit.client.0.smithi179.stderr: 73400K .......... .......... .......... .......... .......... 43% 59.6M 4s 2024-08-24T21:12:08.118 INFO:tasks.workunit.client.0.smithi179.stderr: 73450K .......... .......... .......... .......... .......... 43% 20.3M 3s 2024-08-24T21:12:08.119 INFO:tasks.workunit.client.0.smithi179.stderr: 73500K .......... .......... .......... .......... .......... 43% 44.6M 3s 2024-08-24T21:12:08.121 INFO:tasks.workunit.client.0.smithi179.stderr: 73550K .......... .......... .......... .......... .......... 43% 24.5M 3s 2024-08-24T21:12:08.123 INFO:tasks.workunit.client.0.smithi179.stderr: 73600K .......... .......... .......... .......... .......... 43% 34.2M 3s 2024-08-24T21:12:08.126 INFO:tasks.workunit.client.0.smithi179.stderr: 73650K .......... .......... .......... .......... .......... 43% 15.7M 3s 2024-08-24T21:12:08.127 INFO:tasks.workunit.client.0.smithi179.stderr: 73700K .......... .......... .......... .......... .......... 43% 43.8M 3s 2024-08-24T21:12:08.129 INFO:tasks.workunit.client.0.smithi179.stderr: 73750K .......... .......... .......... .......... .......... 43% 24.5M 3s 2024-08-24T21:12:08.130 INFO:tasks.workunit.client.0.smithi179.stderr: 73800K .......... .......... .......... .......... .......... 43% 44.5M 3s 2024-08-24T21:12:08.132 INFO:tasks.workunit.client.0.smithi179.stderr: 73850K .......... .......... .......... .......... .......... 43% 20.2M 3s 2024-08-24T21:12:08.133 INFO:tasks.workunit.client.0.smithi179.stderr: 73900K .......... .......... .......... .......... .......... 43% 40.0M 3s 2024-08-24T21:12:08.136 INFO:tasks.workunit.client.0.smithi179.stderr: 73950K .......... .......... .......... .......... .......... 43% 20.7M 3s 2024-08-24T21:12:08.138 INFO:tasks.workunit.client.0.smithi179.stderr: 74000K .......... .......... .......... .......... .......... 43% 23.2M 3s 2024-08-24T21:12:08.139 INFO:tasks.workunit.client.0.smithi179.stderr: 74050K .......... .......... .......... .......... .......... 43% 33.7M 3s 2024-08-24T21:12:08.141 INFO:tasks.workunit.client.0.smithi179.stderr: 74100K .......... .......... .......... .......... .......... 43% 26.9M 3s 2024-08-24T21:12:08.142 INFO:tasks.workunit.client.0.smithi179.stderr: 74150K .......... .......... .......... .......... .......... 44% 43.0M 3s 2024-08-24T21:12:08.144 INFO:tasks.workunit.client.0.smithi179.stderr: 74200K .......... .......... .......... .......... .......... 44% 23.4M 3s 2024-08-24T21:12:08.146 INFO:tasks.workunit.client.0.smithi179.stderr: 74250K .......... .......... .......... .......... .......... 44% 34.2M 3s 2024-08-24T21:12:08.148 INFO:tasks.workunit.client.0.smithi179.stderr: 74300K .......... .......... .......... .......... .......... 44% 22.2M 3s 2024-08-24T21:12:08.150 INFO:tasks.workunit.client.0.smithi179.stderr: 74350K .......... .......... .......... .......... .......... 44% 27.4M 3s 2024-08-24T21:12:08.151 INFO:tasks.workunit.client.0.smithi179.stderr: 74400K .......... .......... .......... .......... .......... 44% 34.2M 3s 2024-08-24T21:12:08.153 INFO:tasks.workunit.client.0.smithi179.stderr: 74450K .......... .......... .......... .......... .......... 44% 32.6M 3s 2024-08-24T21:12:08.155 INFO:tasks.workunit.client.0.smithi179.stderr: 74500K .......... .......... .......... .......... .......... 44% 25.1M 3s 2024-08-24T21:12:08.156 INFO:tasks.workunit.client.0.smithi179.stderr: 74550K .......... .......... .......... .......... .......... 44% 37.6M 3s 2024-08-24T21:12:08.158 INFO:tasks.workunit.client.0.smithi179.stderr: 74600K .......... .......... .......... .......... .......... 44% 24.2M 3s 2024-08-24T21:12:08.159 INFO:tasks.workunit.client.0.smithi179.stderr: 74650K .......... .......... .......... .......... .......... 44% 47.5M 3s 2024-08-24T21:12:08.161 INFO:tasks.workunit.client.0.smithi179.stderr: 74700K .......... .......... .......... .......... .......... 44% 24.4M 3s 2024-08-24T21:12:08.164 INFO:tasks.workunit.client.0.smithi179.stderr: 74750K .......... .......... .......... .......... .......... 44% 18.0M 3s 2024-08-24T21:12:08.166 INFO:tasks.workunit.client.0.smithi179.stderr: 74800K .......... .......... .......... .......... .......... 44% 30.5M 3s 2024-08-24T21:12:08.168 INFO:tasks.workunit.client.0.smithi179.stderr: 74850K .......... .......... .......... .......... .......... 44% 22.1M 3s 2024-08-24T21:12:08.171 INFO:tasks.workunit.client.0.smithi179.stderr: 74900K .......... .......... .......... .......... .......... 44% 23.1M 3s 2024-08-24T21:12:08.171 INFO:tasks.workunit.client.0.smithi179.stderr: 74950K .......... .......... .......... .......... .......... 44% 46.5M 3s 2024-08-24T21:12:08.173 INFO:tasks.workunit.client.0.smithi179.stderr: 75000K .......... .......... .......... .......... .......... 44% 25.0M 3s 2024-08-24T21:12:08.174 INFO:tasks.workunit.client.0.smithi179.stderr: 75050K .......... .......... .......... .......... .......... 44% 42.6M 3s 2024-08-24T21:12:08.176 INFO:tasks.workunit.client.0.smithi179.stderr: 75100K .......... .......... .......... .......... .......... 44% 20.9M 3s 2024-08-24T21:12:08.179 INFO:tasks.workunit.client.0.smithi179.stderr: 75150K .......... .......... .......... .......... .......... 44% 21.6M 3s 2024-08-24T21:12:08.180 INFO:tasks.workunit.client.0.smithi179.stderr: 75200K .......... .......... .......... .......... .......... 44% 40.6M 3s 2024-08-24T21:12:08.182 INFO:tasks.workunit.client.0.smithi179.stderr: 75250K .......... .......... .......... .......... .......... 44% 22.0M 3s 2024-08-24T21:12:08.183 INFO:tasks.workunit.client.0.smithi179.stderr: 75300K .......... .......... .......... .......... .......... 44% 40.2M 3s 2024-08-24T21:12:08.186 INFO:tasks.workunit.client.0.smithi179.stderr: 75350K .......... .......... .......... .......... .......... 44% 19.3M 3s 2024-08-24T21:12:08.191 INFO:tasks.workunit.client.0.smithi179.stderr: 75400K .......... .......... .......... .......... .......... 44% 23.1M 3s 2024-08-24T21:12:08.191 INFO:tasks.workunit.client.0.smithi179.stderr: 75450K .......... .......... .......... .......... .......... 44% 68.7M 3s 2024-08-24T21:12:08.191 INFO:tasks.workunit.client.0.smithi179.stderr: 75500K .......... .......... .......... .......... .......... 44% 23.0M 3s 2024-08-24T21:12:08.193 INFO:tasks.workunit.client.0.smithi179.stderr: 75550K .......... .......... .......... .......... .......... 44% 23.2M 3s 2024-08-24T21:12:08.194 INFO:tasks.workunit.client.0.smithi179.stderr: 75600K .......... .......... .......... .......... .......... 44% 28.4M 3s 2024-08-24T21:12:08.196 INFO:tasks.workunit.client.0.smithi179.stderr: 75650K .......... .......... .......... .......... .......... 44% 23.5M 3s 2024-08-24T21:12:08.197 INFO:tasks.workunit.client.0.smithi179.stderr: 75700K .......... .......... .......... .......... .......... 44% 49.0M 3s 2024-08-24T21:12:08.200 INFO:tasks.workunit.client.0.smithi179.stderr: 75750K .......... .......... .......... .......... .......... 44% 22.3M 3s 2024-08-24T21:12:08.201 INFO:tasks.workunit.client.0.smithi179.stderr: 75800K .......... .......... .......... .......... .......... 44% 32.3M 3s 2024-08-24T21:12:08.204 INFO:tasks.workunit.client.0.smithi179.stderr: 75850K .......... .......... .......... .......... .......... 45% 19.4M 3s 2024-08-24T21:12:08.205 INFO:tasks.workunit.client.0.smithi179.stderr: 75900K .......... .......... .......... .......... .......... 45% 49.0M 3s 2024-08-24T21:12:08.209 INFO:tasks.workunit.client.0.smithi179.stderr: 75950K .......... .......... .......... .......... .......... 45% 14.2M 3s 2024-08-24T21:12:08.209 INFO:tasks.workunit.client.0.smithi179.stderr: 76000K .......... .......... .......... .......... .......... 45% 49.4M 3s 2024-08-24T21:12:08.211 INFO:tasks.workunit.client.0.smithi179.stderr: 76050K .......... .......... .......... .......... .......... 45% 24.4M 3s 2024-08-24T21:12:08.212 INFO:tasks.workunit.client.0.smithi179.stderr: 76100K .......... .......... .......... .......... .......... 45% 41.9M 3s 2024-08-24T21:12:08.214 INFO:tasks.workunit.client.0.smithi179.stderr: 76150K .......... .......... .......... .......... .......... 45% 23.8M 3s 2024-08-24T21:12:08.215 INFO:tasks.workunit.client.0.smithi179.stderr: 76200K .......... .......... .......... .......... .......... 45% 41.4M 3s 2024-08-24T21:12:08.217 INFO:tasks.workunit.client.0.smithi179.stderr: 76250K .......... .......... .......... .......... .......... 45% 23.5M 3s 2024-08-24T21:12:08.219 INFO:tasks.workunit.client.0.smithi179.stderr: 76300K .......... .......... .......... .......... .......... 45% 38.7M 3s 2024-08-24T21:12:08.221 INFO:tasks.workunit.client.0.smithi179.stderr: 76350K .......... .......... .......... .......... .......... 45% 21.6M 3s 2024-08-24T21:12:08.223 INFO:tasks.workunit.client.0.smithi179.stderr: 76400K .......... .......... .......... .......... .......... 45% 28.4M 3s 2024-08-24T21:12:08.224 INFO:tasks.workunit.client.0.smithi179.stderr: 76450K .......... .......... .......... .......... .......... 45% 37.0M 3s 2024-08-24T21:12:08.226 INFO:tasks.workunit.client.0.smithi179.stderr: 76500K .......... .......... .......... .......... .......... 45% 25.1M 3s 2024-08-24T21:12:08.228 INFO:tasks.workunit.client.0.smithi179.stderr: 76550K .......... .......... .......... .......... .......... 45% 35.0M 3s 2024-08-24T21:12:08.230 INFO:tasks.workunit.client.0.smithi179.stderr: 76600K .......... .......... .......... .......... .......... 45% 24.6M 3s 2024-08-24T21:12:08.232 INFO:tasks.workunit.client.0.smithi179.stderr: 76650K .......... .......... .......... .......... .......... 45% 23.6M 3s 2024-08-24T21:12:08.232 INFO:tasks.workunit.client.0.smithi179.stderr: 76700K .......... .......... .......... .......... .......... 45% 56.7M 3s 2024-08-24T21:12:08.235 INFO:tasks.workunit.client.0.smithi179.stderr: 76750K .......... .......... .......... .......... .......... 45% 21.0M 3s 2024-08-24T21:12:08.237 INFO:tasks.workunit.client.0.smithi179.stderr: 76800K .......... .......... .......... .......... .......... 45% 20.6M 3s 2024-08-24T21:12:08.239 INFO:tasks.workunit.client.0.smithi179.stderr: 76850K .......... .......... .......... .......... .......... 45% 28.0M 3s 2024-08-24T21:12:08.241 INFO:tasks.workunit.client.0.smithi179.stderr: 76900K .......... .......... .......... .......... .......... 45% 21.3M 3s 2024-08-24T21:12:08.242 INFO:tasks.workunit.client.0.smithi179.stderr: 76950K .......... .......... .......... .......... .......... 45% 39.4M 3s 2024-08-24T21:12:08.244 INFO:tasks.workunit.client.0.smithi179.stderr: 77000K .......... .......... .......... .......... .......... 45% 23.9M 3s 2024-08-24T21:12:08.245 INFO:tasks.workunit.client.0.smithi179.stderr: 77050K .......... .......... .......... .......... .......... 45% 42.0M 3s 2024-08-24T21:12:08.248 INFO:tasks.workunit.client.0.smithi179.stderr: 77100K .......... .......... .......... .......... .......... 45% 20.9M 3s 2024-08-24T21:12:08.250 INFO:tasks.workunit.client.0.smithi179.stderr: 77150K .......... .......... .......... .......... .......... 45% 27.5M 3s 2024-08-24T21:12:08.252 INFO:tasks.workunit.client.0.smithi179.stderr: 77200K .......... .......... .......... .......... .......... 45% 21.0M 3s 2024-08-24T21:12:08.253 INFO:tasks.workunit.client.0.smithi179.stderr: 77250K .......... .......... .......... .......... .......... 45% 46.9M 3s 2024-08-24T21:12:08.255 INFO:tasks.workunit.client.0.smithi179.stderr: 77300K .......... .......... .......... .......... .......... 45% 21.3M 3s 2024-08-24T21:12:08.256 INFO:tasks.workunit.client.0.smithi179.stderr: 77350K .......... .......... .......... .......... .......... 45% 40.0M 3s 2024-08-24T21:12:08.259 INFO:tasks.workunit.client.0.smithi179.stderr: 77400K .......... .......... .......... .......... .......... 45% 22.7M 3s 2024-08-24T21:12:08.260 INFO:tasks.workunit.client.0.smithi179.stderr: 77450K .......... .......... .......... .......... .......... 45% 45.3M 3s 2024-08-24T21:12:08.263 INFO:tasks.workunit.client.0.smithi179.stderr: 77500K .......... .......... .......... .......... .......... 46% 19.1M 3s 2024-08-24T21:12:08.265 INFO:tasks.workunit.client.0.smithi179.stderr: 77550K .......... .......... .......... .......... .......... 46% 22.8M 3s 2024-08-24T21:12:08.266 INFO:tasks.workunit.client.0.smithi179.stderr: 77600K .......... .......... .......... .......... .......... 46% 31.1M 3s 2024-08-24T21:12:08.269 INFO:tasks.workunit.client.0.smithi179.stderr: 77650K .......... .......... .......... .......... .......... 46% 18.9M 3s 2024-08-24T21:12:08.271 INFO:tasks.workunit.client.0.smithi179.stderr: 77700K .......... .......... .......... .......... .......... 46% 22.2M 3s 2024-08-24T21:12:08.272 INFO:tasks.workunit.client.0.smithi179.stderr: 77750K .......... .......... .......... .......... .......... 46% 57.6M 3s 2024-08-24T21:12:08.274 INFO:tasks.workunit.client.0.smithi179.stderr: 77800K .......... .......... .......... .......... .......... 46% 22.6M 3s 2024-08-24T21:12:08.275 INFO:tasks.workunit.client.0.smithi179.stderr: 77850K .......... .......... .......... .......... .......... 46% 36.6M 3s 2024-08-24T21:12:08.278 INFO:tasks.workunit.client.0.smithi179.stderr: 77900K .......... .......... .......... .......... .......... 46% 19.0M 3s 2024-08-24T21:12:08.280 INFO:tasks.workunit.client.0.smithi179.stderr: 77950K .......... .......... .......... .......... .......... 46% 21.6M 3s 2024-08-24T21:12:08.282 INFO:tasks.workunit.client.0.smithi179.stderr: 78000K .......... .......... .......... .......... .......... 46% 42.4M 3s 2024-08-24T21:12:08.284 INFO:tasks.workunit.client.0.smithi179.stderr: 78050K .......... .......... .......... .......... .......... 46% 19.6M 3s 2024-08-24T21:12:08.286 INFO:tasks.workunit.client.0.smithi179.stderr: 78100K .......... .......... .......... .......... .......... 46% 24.2M 3s 2024-08-24T21:12:08.288 INFO:tasks.workunit.client.0.smithi179.stderr: 78150K .......... .......... .......... .......... .......... 46% 24.8M 3s 2024-08-24T21:12:08.290 INFO:tasks.workunit.client.0.smithi179.stderr: 78200K .......... .......... .......... .......... .......... 46% 20.1M 3s 2024-08-24T21:12:08.292 INFO:tasks.workunit.client.0.smithi179.stderr: 78250K .......... .......... .......... .......... .......... 46% 30.4M 3s 2024-08-24T21:12:08.294 INFO:tasks.workunit.client.0.smithi179.stderr: 78300K .......... .......... .......... .......... .......... 46% 25.4M 3s 2024-08-24T21:12:08.296 INFO:tasks.workunit.client.0.smithi179.stderr: 78350K .......... .......... .......... .......... .......... 46% 21.0M 3s 2024-08-24T21:12:08.297 INFO:tasks.workunit.client.0.smithi179.stderr: 78400K .......... .......... .......... .......... .......... 46% 42.3M 3s 2024-08-24T21:12:08.299 INFO:tasks.workunit.client.0.smithi179.stderr: 78450K .......... .......... .......... .......... .......... 46% 23.5M 3s 2024-08-24T21:12:08.300 INFO:tasks.workunit.client.0.smithi179.stderr: 78500K .......... .......... .......... .......... .......... 46% 44.2M 3s 2024-08-24T21:12:08.302 INFO:tasks.workunit.client.0.smithi179.stderr: 78550K .......... .......... .......... .......... .......... 46% 24.5M 3s 2024-08-24T21:12:08.303 INFO:tasks.workunit.client.0.smithi179.stderr: 78600K .......... .......... .......... .......... .......... 46% 43.8M 3s 2024-08-24T21:12:08.306 INFO:tasks.workunit.client.0.smithi179.stderr: 78650K .......... .......... .......... .......... .......... 46% 20.5M 3s 2024-08-24T21:12:08.306 INFO:tasks.workunit.client.0.smithi179.stderr: 78700K .......... .......... .......... .......... .......... 46% 58.5M 3s 2024-08-24T21:12:08.310 INFO:tasks.workunit.client.0.smithi179.stderr: 78750K .......... .......... .......... .......... .......... 46% 15.8M 3s 2024-08-24T21:12:08.311 INFO:tasks.workunit.client.0.smithi179.stderr: 78800K .......... .......... .......... .......... .......... 46% 41.2M 3s 2024-08-24T21:12:08.313 INFO:tasks.workunit.client.0.smithi179.stderr: 78850K .......... .......... .......... .......... .......... 46% 24.9M 3s 2024-08-24T21:12:08.314 INFO:tasks.workunit.client.0.smithi179.stderr: 78900K .......... .......... .......... .......... .......... 46% 45.4M 3s 2024-08-24T21:12:08.316 INFO:tasks.workunit.client.0.smithi179.stderr: 78950K .......... .......... .......... .......... .......... 46% 22.6M 3s 2024-08-24T21:12:08.317 INFO:tasks.workunit.client.0.smithi179.stderr: 79000K .......... .......... .......... .......... .......... 46% 45.8M 3s 2024-08-24T21:12:08.319 INFO:tasks.workunit.client.0.smithi179.stderr: 79050K .......... .......... .......... .......... .......... 46% 24.8M 3s 2024-08-24T21:12:08.321 INFO:tasks.workunit.client.0.smithi179.stderr: 79100K .......... .......... .......... .......... .......... 46% 29.4M 3s 2024-08-24T21:12:08.323 INFO:tasks.workunit.client.0.smithi179.stderr: 79150K .......... .......... .......... .......... .......... 46% 26.8M 3s 2024-08-24T21:12:08.325 INFO:tasks.workunit.client.0.smithi179.stderr: 79200K .......... .......... .......... .......... .......... 47% 24.6M 3s 2024-08-24T21:12:08.330 INFO:tasks.workunit.client.0.smithi179.stderr: 79250K .......... .......... .......... .......... .......... 47% 11.9M 3s 2024-08-24T21:12:08.331 INFO:tasks.workunit.client.0.smithi179.stderr: 79300K .......... .......... .......... .......... .......... 47% 72.9M 3s 2024-08-24T21:12:08.331 INFO:tasks.workunit.client.0.smithi179.stderr: 79350K .......... .......... .......... .......... .......... 47% 66.4M 3s 2024-08-24T21:12:08.332 INFO:tasks.workunit.client.0.smithi179.stderr: 79400K .......... .......... .......... .......... .......... 47% 37.8M 3s 2024-08-24T21:12:08.334 INFO:tasks.workunit.client.0.smithi179.stderr: 79450K .......... .......... .......... .......... .......... 47% 22.7M 3s 2024-08-24T21:12:08.335 INFO:tasks.workunit.client.0.smithi179.stderr: 79500K .......... .......... .......... .......... .......... 47% 45.2M 3s 2024-08-24T21:12:08.337 INFO:tasks.workunit.client.0.smithi179.stderr: 79550K .......... .......... .......... .......... .......... 47% 23.2M 3s 2024-08-24T21:12:08.339 INFO:tasks.workunit.client.0.smithi179.stderr: 79600K .......... .......... .......... .......... .......... 47% 24.8M 3s 2024-08-24T21:12:08.340 INFO:tasks.workunit.client.0.smithi179.stderr: 79650K .......... .......... .......... .......... .......... 47% 40.8M 3s 2024-08-24T21:12:08.342 INFO:tasks.workunit.client.0.smithi179.stderr: 79700K .......... .......... .......... .......... .......... 47% 25.7M 3s 2024-08-24T21:12:08.343 INFO:tasks.workunit.client.0.smithi179.stderr: 79750K .......... .......... .......... .......... .......... 47% 28.3M 3s 2024-08-24T21:12:08.345 INFO:tasks.workunit.client.0.smithi179.stderr: 79800K .......... .......... .......... .......... .......... 47% 24.4M 3s 2024-08-24T21:12:08.347 INFO:tasks.workunit.client.0.smithi179.stderr: 79850K .......... .......... .......... .......... .......... 47% 30.4M 3s 2024-08-24T21:12:08.350 INFO:tasks.workunit.client.0.smithi179.stderr: 79900K .......... .......... .......... .......... .......... 47% 15.3M 3s 2024-08-24T21:12:08.353 INFO:tasks.workunit.client.0.smithi179.stderr: 79950K .......... .......... .......... .......... .......... 47% 20.4M 3s 2024-08-24T21:12:08.356 INFO:tasks.workunit.client.0.smithi179.stderr: 80000K .......... .......... .......... .......... .......... 47% 15.3M 3s 2024-08-24T21:12:08.357 INFO:tasks.workunit.client.0.smithi179.stderr: 80050K .......... .......... .......... .......... .......... 47% 46.7M 3s 2024-08-24T21:12:08.359 INFO:tasks.workunit.client.0.smithi179.stderr: 80100K .......... .......... .......... .......... .......... 47% 21.9M 3s 2024-08-24T21:12:08.360 INFO:tasks.workunit.client.0.smithi179.stderr: 80150K .......... .......... .......... .......... .......... 47% 41.7M 3s 2024-08-24T21:12:08.362 INFO:tasks.workunit.client.0.smithi179.stderr: 80200K .......... .......... .......... .......... .......... 47% 24.8M 3s 2024-08-24T21:12:08.364 INFO:tasks.workunit.client.0.smithi179.stderr: 80250K .......... .......... .......... .......... .......... 47% 23.4M 3s 2024-08-24T21:12:08.367 INFO:tasks.workunit.client.0.smithi179.stderr: 80300K .......... .......... .......... .......... .......... 47% 21.4M 3s 2024-08-24T21:12:08.369 INFO:tasks.workunit.client.0.smithi179.stderr: 80350K .......... .......... .......... .......... .......... 47% 24.3M 3s 2024-08-24T21:12:08.370 INFO:tasks.workunit.client.0.smithi179.stderr: 80400K .......... .......... .......... .......... .......... 47% 33.6M 3s 2024-08-24T21:12:08.372 INFO:tasks.workunit.client.0.smithi179.stderr: 80450K .......... .......... .......... .......... .......... 47% 22.9M 3s 2024-08-24T21:12:08.375 INFO:tasks.workunit.client.0.smithi179.stderr: 80500K .......... .......... .......... .......... .......... 47% 22.5M 3s 2024-08-24T21:12:08.375 INFO:tasks.workunit.client.0.smithi179.stderr: 80550K .......... .......... .......... .......... .......... 47% 41.6M 3s 2024-08-24T21:12:08.378 INFO:tasks.workunit.client.0.smithi179.stderr: 80600K .......... .......... .......... .......... .......... 47% 23.1M 3s 2024-08-24T21:12:08.379 INFO:tasks.workunit.client.0.smithi179.stderr: 80650K .......... .......... .......... .......... .......... 47% 45.6M 3s 2024-08-24T21:12:08.381 INFO:tasks.workunit.client.0.smithi179.stderr: 80700K .......... .......... .......... .......... .......... 47% 24.7M 3s 2024-08-24T21:12:08.383 INFO:tasks.workunit.client.0.smithi179.stderr: 80750K .......... .......... .......... .......... .......... 47% 23.0M 3s 2024-08-24T21:12:08.384 INFO:tasks.workunit.client.0.smithi179.stderr: 80800K .......... .......... .......... .......... .......... 47% 45.7M 3s 2024-08-24T21:12:08.386 INFO:tasks.workunit.client.0.smithi179.stderr: 80850K .......... .......... .......... .......... .......... 47% 25.7M 3s 2024-08-24T21:12:08.387 INFO:tasks.workunit.client.0.smithi179.stderr: 80900K .......... .......... .......... .......... .......... 48% 29.1M 3s 2024-08-24T21:12:08.389 INFO:tasks.workunit.client.0.smithi179.stderr: 80950K .......... .......... .......... .......... .......... 48% 26.1M 3s 2024-08-24T21:12:08.391 INFO:tasks.workunit.client.0.smithi179.stderr: 81000K .......... .......... .......... .......... .......... 48% 38.7M 3s 2024-08-24T21:12:08.393 INFO:tasks.workunit.client.0.smithi179.stderr: 81050K .......... .......... .......... .......... .......... 48% 24.1M 3s 2024-08-24T21:12:08.395 INFO:tasks.workunit.client.0.smithi179.stderr: 81100K .......... .......... .......... .......... .......... 48% 25.0M 3s 2024-08-24T21:12:08.397 INFO:tasks.workunit.client.0.smithi179.stderr: 81150K .......... .......... .......... .......... .......... 48% 23.4M 3s 2024-08-24T21:12:08.398 INFO:tasks.workunit.client.0.smithi179.stderr: 81200K .......... .......... .......... .......... .......... 48% 42.3M 3s 2024-08-24T21:12:08.400 INFO:tasks.workunit.client.0.smithi179.stderr: 81250K .......... .......... .......... .......... .......... 48% 24.7M 3s 2024-08-24T21:12:08.401 INFO:tasks.workunit.client.0.smithi179.stderr: 81300K .......... .......... .......... .......... .......... 48% 49.1M 3s 2024-08-24T21:12:08.403 INFO:tasks.workunit.client.0.smithi179.stderr: 81350K .......... .......... .......... .......... .......... 48% 23.3M 3s 2024-08-24T21:12:08.404 INFO:tasks.workunit.client.0.smithi179.stderr: 81400K .......... .......... .......... .......... .......... 48% 44.4M 3s 2024-08-24T21:12:08.406 INFO:tasks.workunit.client.0.smithi179.stderr: 81450K .......... .......... .......... .......... .......... 48% 29.1M 3s 2024-08-24T21:12:08.408 INFO:tasks.workunit.client.0.smithi179.stderr: 81500K .......... .......... .......... .......... .......... 48% 34.8M 3s 2024-08-24T21:12:08.410 INFO:tasks.workunit.client.0.smithi179.stderr: 81550K .......... .......... .......... .......... .......... 48% 22.9M 3s 2024-08-24T21:12:08.411 INFO:tasks.workunit.client.0.smithi179.stderr: 81600K .......... .......... .......... .......... .......... 48% 21.2M 3s 2024-08-24T21:12:08.414 INFO:tasks.workunit.client.0.smithi179.stderr: 81650K .......... .......... .......... .......... .......... 48% 22.0M 3s 2024-08-24T21:12:08.415 INFO:tasks.workunit.client.0.smithi179.stderr: 81700K .......... .......... .......... .......... .......... 48% 39.8M 3s 2024-08-24T21:12:08.416 INFO:tasks.workunit.client.0.smithi179.stderr: 81750K .......... .......... .......... .......... .......... 48% 40.4M 3s 2024-08-24T21:12:08.418 INFO:tasks.workunit.client.0.smithi179.stderr: 81800K .......... .......... .......... .......... .......... 48% 26.8M 3s 2024-08-24T21:12:08.420 INFO:tasks.workunit.client.0.smithi179.stderr: 81850K .......... .......... .......... .......... .......... 48% 23.4M 3s 2024-08-24T21:12:08.421 INFO:tasks.workunit.client.0.smithi179.stderr: 81900K .......... .......... .......... .......... .......... 48% 44.9M 3s 2024-08-24T21:12:08.423 INFO:tasks.workunit.client.0.smithi179.stderr: 81950K .......... .......... .......... .......... .......... 48% 23.5M 3s 2024-08-24T21:12:08.426 INFO:tasks.workunit.client.0.smithi179.stderr: 82000K .......... .......... .......... .......... .......... 48% 23.4M 3s 2024-08-24T21:12:08.426 INFO:tasks.workunit.client.0.smithi179.stderr: 82050K .......... .......... .......... .......... .......... 48% 58.7M 3s 2024-08-24T21:12:08.428 INFO:tasks.workunit.client.0.smithi179.stderr: 82100K .......... .......... .......... .......... .......... 48% 24.5M 3s 2024-08-24T21:12:08.431 INFO:tasks.workunit.client.0.smithi179.stderr: 82150K .......... .......... .......... .......... .......... 48% 19.9M 3s 2024-08-24T21:12:08.432 INFO:tasks.workunit.client.0.smithi179.stderr: 82200K .......... .......... .......... .......... .......... 48% 47.3M 3s 2024-08-24T21:12:08.434 INFO:tasks.workunit.client.0.smithi179.stderr: 82250K .......... .......... .......... .......... .......... 48% 25.2M 3s 2024-08-24T21:12:08.435 INFO:tasks.workunit.client.0.smithi179.stderr: 82300K .......... .......... .......... .......... .......... 48% 41.4M 3s 2024-08-24T21:12:08.437 INFO:tasks.workunit.client.0.smithi179.stderr: 82350K .......... .......... .......... .......... .......... 48% 23.9M 3s 2024-08-24T21:12:08.439 INFO:tasks.workunit.client.0.smithi179.stderr: 82400K .......... .......... .......... .......... .......... 48% 23.9M 3s 2024-08-24T21:12:08.441 INFO:tasks.workunit.client.0.smithi179.stderr: 82450K .......... .......... .......... .......... .......... 48% 33.6M 3s 2024-08-24T21:12:08.442 INFO:tasks.workunit.client.0.smithi179.stderr: 82500K .......... .......... .......... .......... .......... 48% 25.8M 3s 2024-08-24T21:12:08.444 INFO:tasks.workunit.client.0.smithi179.stderr: 82550K .......... .......... .......... .......... .......... 49% 32.5M 3s 2024-08-24T21:12:08.446 INFO:tasks.workunit.client.0.smithi179.stderr: 82600K .......... .......... .......... .......... .......... 49% 24.4M 3s 2024-08-24T21:12:08.447 INFO:tasks.workunit.client.0.smithi179.stderr: 82650K .......... .......... .......... .......... .......... 49% 44.3M 3s 2024-08-24T21:12:08.449 INFO:tasks.workunit.client.0.smithi179.stderr: 82700K .......... .......... .......... .......... .......... 49% 20.8M 3s 2024-08-24T21:12:08.452 INFO:tasks.workunit.client.0.smithi179.stderr: 82750K .......... .......... .......... .......... .......... 49% 21.6M 3s 2024-08-24T21:12:08.453 INFO:tasks.workunit.client.0.smithi179.stderr: 82800K .......... .......... .......... .......... .......... 49% 24.3M 3s 2024-08-24T21:12:08.455 INFO:tasks.workunit.client.0.smithi179.stderr: 82850K .......... .......... .......... .......... .......... 49% 41.7M 3s 2024-08-24T21:12:08.457 INFO:tasks.workunit.client.0.smithi179.stderr: 82900K .......... .......... .......... .......... .......... 49% 24.9M 3s 2024-08-24T21:12:08.458 INFO:tasks.workunit.client.0.smithi179.stderr: 82950K .......... .......... .......... .......... .......... 49% 40.5M 3s 2024-08-24T21:12:08.460 INFO:tasks.workunit.client.0.smithi179.stderr: 83000K .......... .......... .......... .......... .......... 49% 22.5M 3s 2024-08-24T21:12:08.461 INFO:tasks.workunit.client.0.smithi179.stderr: 83050K .......... .......... .......... .......... .......... 49% 50.4M 3s 2024-08-24T21:12:08.463 INFO:tasks.workunit.client.0.smithi179.stderr: 83100K .......... .......... .......... .......... .......... 49% 24.6M 3s 2024-08-24T21:12:08.465 INFO:tasks.workunit.client.0.smithi179.stderr: 83150K .......... .......... .......... .......... .......... 49% 23.7M 3s 2024-08-24T21:12:08.466 INFO:tasks.workunit.client.0.smithi179.stderr: 83200K .......... .......... .......... .......... .......... 49% 38.7M 3s 2024-08-24T21:12:08.469 INFO:tasks.workunit.client.0.smithi179.stderr: 83250K .......... .......... .......... .......... .......... 49% 24.9M 3s 2024-08-24T21:12:08.470 INFO:tasks.workunit.client.0.smithi179.stderr: 83300K .......... .......... .......... .......... .......... 49% 24.0M 3s 2024-08-24T21:12:08.471 INFO:tasks.workunit.client.0.smithi179.stderr: 83350K .......... .......... .......... .......... .......... 49% 42.8M 3s 2024-08-24T21:12:08.473 INFO:tasks.workunit.client.0.smithi179.stderr: 83400K .......... .......... .......... .......... .......... 49% 23.5M 3s 2024-08-24T21:12:08.475 INFO:tasks.workunit.client.0.smithi179.stderr: 83450K .......... .......... .......... .......... .......... 49% 40.7M 3s 2024-08-24T21:12:08.478 INFO:tasks.workunit.client.0.smithi179.stderr: 83500K .......... .......... .......... .......... .......... 49% 23.1M 3s 2024-08-24T21:12:08.478 INFO:tasks.workunit.client.0.smithi179.stderr: 83550K .......... .......... .......... .......... .......... 49% 30.4M 3s 2024-08-24T21:12:08.480 INFO:tasks.workunit.client.0.smithi179.stderr: 83600K .......... .......... .......... .......... .......... 49% 38.8M 3s 2024-08-24T21:12:08.482 INFO:tasks.workunit.client.0.smithi179.stderr: 83650K .......... .......... .......... .......... .......... 49% 22.8M 3s 2024-08-24T21:12:08.483 INFO:tasks.workunit.client.0.smithi179.stderr: 83700K .......... .......... .......... .......... .......... 49% 40.3M 3s 2024-08-24T21:12:08.485 INFO:tasks.workunit.client.0.smithi179.stderr: 83750K .......... .......... .......... .......... .......... 49% 23.4M 3s 2024-08-24T21:12:08.486 INFO:tasks.workunit.client.0.smithi179.stderr: 83800K .......... .......... .......... .......... .......... 49% 48.3M 3s 2024-08-24T21:12:08.488 INFO:tasks.workunit.client.0.smithi179.stderr: 83850K .......... .......... .......... .......... .......... 49% 22.9M 3s 2024-08-24T21:12:08.490 INFO:tasks.workunit.client.0.smithi179.stderr: 83900K .......... .......... .......... .......... .......... 49% 35.9M 3s 2024-08-24T21:12:08.493 INFO:tasks.workunit.client.0.smithi179.stderr: 83950K .......... .......... .......... .......... .......... 49% 16.2M 3s 2024-08-24T21:12:08.494 INFO:tasks.workunit.client.0.smithi179.stderr: 84000K .......... .......... .......... .......... .......... 49% 41.6M 3s 2024-08-24T21:12:08.497 INFO:tasks.workunit.client.0.smithi179.stderr: 84050K .......... .......... .......... .......... .......... 49% 22.7M 3s 2024-08-24T21:12:08.497 INFO:tasks.workunit.client.0.smithi179.stderr: 84100K .......... .......... .......... .......... .......... 49% 51.5M 3s 2024-08-24T21:12:08.499 INFO:tasks.workunit.client.0.smithi179.stderr: 84150K .......... .......... .......... .......... .......... 49% 23.4M 3s 2024-08-24T21:12:08.500 INFO:tasks.workunit.client.0.smithi179.stderr: 84200K .......... .......... .......... .......... .......... 49% 41.4M 3s 2024-08-24T21:12:08.502 INFO:tasks.workunit.client.0.smithi179.stderr: 84250K .......... .......... .......... .......... .......... 50% 24.5M 3s 2024-08-24T21:12:08.503 INFO:tasks.workunit.client.0.smithi179.stderr: 84300K .......... .......... .......... .......... .......... 50% 41.0M 3s 2024-08-24T21:12:08.505 INFO:tasks.workunit.client.0.smithi179.stderr: 84350K .......... .......... .......... .......... .......... 50% 24.5M 3s 2024-08-24T21:12:08.507 INFO:tasks.workunit.client.0.smithi179.stderr: 84400K .......... .......... .......... .......... .......... 50% 23.1M 3s 2024-08-24T21:12:08.510 INFO:tasks.workunit.client.0.smithi179.stderr: 84450K .......... .......... .......... .......... .......... 50% 33.2M 3s 2024-08-24T21:12:08.511 INFO:tasks.workunit.client.0.smithi179.stderr: 84500K .......... .......... .......... .......... .......... 50% 24.5M 3s 2024-08-24T21:12:08.513 INFO:tasks.workunit.client.0.smithi179.stderr: 84550K .......... .......... .......... .......... .......... 50% 22.5M 3s 2024-08-24T21:12:08.514 INFO:tasks.workunit.client.0.smithi179.stderr: 84600K .......... .......... .......... .......... .......... 50% 45.5M 3s 2024-08-24T21:12:08.517 INFO:tasks.workunit.client.0.smithi179.stderr: 84650K .......... .......... .......... .......... .......... 50% 18.5M 3s 2024-08-24T21:12:08.518 INFO:tasks.workunit.client.0.smithi179.stderr: 84700K .......... .......... .......... .......... .......... 50% 38.1M 3s 2024-08-24T21:12:08.521 INFO:tasks.workunit.client.0.smithi179.stderr: 84750K .......... .......... .......... .......... .......... 50% 18.4M 3s 2024-08-24T21:12:08.523 INFO:tasks.workunit.client.0.smithi179.stderr: 84800K .......... .......... .......... .......... .......... 50% 20.6M 3s 2024-08-24T21:12:08.525 INFO:tasks.workunit.client.0.smithi179.stderr: 84850K .......... .......... .......... .......... .......... 50% 33.3M 3s 2024-08-24T21:12:08.527 INFO:tasks.workunit.client.0.smithi179.stderr: 84900K .......... .......... .......... .......... .......... 50% 16.7M 3s 2024-08-24T21:12:08.530 INFO:tasks.workunit.client.0.smithi179.stderr: 84950K .......... .......... .......... .......... .......... 50% 20.7M 3s 2024-08-24T21:12:08.533 INFO:tasks.workunit.client.0.smithi179.stderr: 85000K .......... .......... .......... .......... .......... 50% 20.6M 3s 2024-08-24T21:12:08.535 INFO:tasks.workunit.client.0.smithi179.stderr: 85050K .......... .......... .......... .......... .......... 50% 17.1M 3s 2024-08-24T21:12:08.536 INFO:tasks.workunit.client.0.smithi179.stderr: 85100K .......... .......... .......... .......... .......... 50% 35.5M 3s 2024-08-24T21:12:08.539 INFO:tasks.workunit.client.0.smithi179.stderr: 85150K .......... .......... .......... .......... .......... 50% 16.9M 3s 2024-08-24T21:12:08.542 INFO:tasks.workunit.client.0.smithi179.stderr: 85200K .......... .......... .......... .......... .......... 50% 18.9M 3s 2024-08-24T21:12:08.543 INFO:tasks.workunit.client.0.smithi179.stderr: 85250K .......... .......... .......... .......... .......... 50% 38.3M 3s 2024-08-24T21:12:08.546 INFO:tasks.workunit.client.0.smithi179.stderr: 85300K .......... .......... .......... .......... .......... 50% 16.7M 3s 2024-08-24T21:12:08.547 INFO:tasks.workunit.client.0.smithi179.stderr: 85350K .......... .......... .......... .......... .......... 50% 41.8M 3s 2024-08-24T21:12:08.550 INFO:tasks.workunit.client.0.smithi179.stderr: 85400K .......... .......... .......... .......... .......... 50% 21.0M 3s 2024-08-24T21:12:08.552 INFO:tasks.workunit.client.0.smithi179.stderr: 85450K .......... .......... .......... .......... .......... 50% 17.7M 3s 2024-08-24T21:12:08.555 INFO:tasks.workunit.client.0.smithi179.stderr: 85500K .......... .......... .......... .......... .......... 50% 21.1M 3s 2024-08-24T21:12:08.558 INFO:tasks.workunit.client.0.smithi179.stderr: 85550K .......... .......... .......... .......... .......... 50% 18.0M 3s 2024-08-24T21:12:08.559 INFO:tasks.workunit.client.0.smithi179.stderr: 85600K .......... .......... .......... .......... .......... 50% 29.4M 3s 2024-08-24T21:12:08.560 INFO:tasks.workunit.client.0.smithi179.stderr: 85650K .......... .......... .......... .......... .......... 50% 45.1M 3s 2024-08-24T21:12:08.562 INFO:tasks.workunit.client.0.smithi179.stderr: 85700K .......... .......... .......... .......... .......... 50% 24.2M 3s 2024-08-24T21:12:08.563 INFO:tasks.workunit.client.0.smithi179.stderr: 85750K .......... .......... .......... .......... .......... 50% 37.8M 3s 2024-08-24T21:12:08.566 INFO:tasks.workunit.client.0.smithi179.stderr: 85800K .......... .......... .......... .......... .......... 50% 22.8M 3s 2024-08-24T21:12:08.566 INFO:tasks.workunit.client.0.smithi179.stderr: 85850K .......... .......... .......... .......... .......... 50% 69.4M 3s 2024-08-24T21:12:08.569 INFO:tasks.workunit.client.0.smithi179.stderr: 85900K .......... .......... .......... .......... .......... 50% 26.6M 3s 2024-08-24T21:12:08.570 INFO:tasks.workunit.client.0.smithi179.stderr: 85950K .......... .......... .......... .......... .......... 51% 25.1M 3s 2024-08-24T21:12:08.572 INFO:tasks.workunit.client.0.smithi179.stderr: 86000K .......... .......... .......... .......... .......... 51% 29.9M 3s 2024-08-24T21:12:08.574 INFO:tasks.workunit.client.0.smithi179.stderr: 86050K .......... .......... .......... .......... .......... 51% 24.8M 3s 2024-08-24T21:12:08.577 INFO:tasks.workunit.client.0.smithi179.stderr: 86100K .......... .......... .......... .......... .......... 51% 21.7M 3s 2024-08-24T21:12:08.577 INFO:tasks.workunit.client.0.smithi179.stderr: 86150K .......... .......... .......... .......... .......... 51% 57.9M 3s 2024-08-24T21:12:08.579 INFO:tasks.workunit.client.0.smithi179.stderr: 86200K .......... .......... .......... .......... .......... 51% 26.8M 3s 2024-08-24T21:12:08.580 INFO:tasks.workunit.client.0.smithi179.stderr: 86250K .......... .......... .......... .......... .......... 51% 26.9M 3s 2024-08-24T21:12:08.583 INFO:tasks.workunit.client.0.smithi179.stderr: 86300K .......... .......... .......... .......... .......... 51% 21.2M 3s 2024-08-24T21:12:08.585 INFO:tasks.workunit.client.0.smithi179.stderr: 86350K .......... .......... .......... .......... .......... 51% 20.1M 3s 2024-08-24T21:12:08.586 INFO:tasks.workunit.client.0.smithi179.stderr: 86400K .......... .......... .......... .......... .......... 51% 42.9M 3s 2024-08-24T21:12:08.588 INFO:tasks.workunit.client.0.smithi179.stderr: 86450K .......... .......... .......... .......... .......... 51% 34.0M 3s 2024-08-24T21:12:08.591 INFO:tasks.workunit.client.0.smithi179.stderr: 86500K .......... .......... .......... .......... .......... 51% 18.3M 3s 2024-08-24T21:12:08.592 INFO:tasks.workunit.client.0.smithi179.stderr: 86550K .......... .......... .......... .......... .......... 51% 37.9M 3s 2024-08-24T21:12:08.593 INFO:tasks.workunit.client.0.smithi179.stderr: 86600K .......... .......... .......... .......... .......... 51% 46.2M 3s 2024-08-24T21:12:08.595 INFO:tasks.workunit.client.0.smithi179.stderr: 86650K .......... .......... .......... .......... .......... 51% 24.8M 3s 2024-08-24T21:12:08.596 INFO:tasks.workunit.client.0.smithi179.stderr: 86700K .......... .......... .......... .......... .......... 51% 39.3M 3s 2024-08-24T21:12:08.599 INFO:tasks.workunit.client.0.smithi179.stderr: 86750K .......... .......... .......... .......... .......... 51% 21.4M 3s 2024-08-24T21:12:08.600 INFO:tasks.workunit.client.0.smithi179.stderr: 86800K .......... .......... .......... .......... .......... 51% 25.2M 3s 2024-08-24T21:12:08.602 INFO:tasks.workunit.client.0.smithi179.stderr: 86850K .......... .......... .......... .......... .......... 51% 24.9M 3s 2024-08-24T21:12:08.603 INFO:tasks.workunit.client.0.smithi179.stderr: 86900K .......... .......... .......... .......... .......... 51% 44.4M 3s 2024-08-24T21:12:08.606 INFO:tasks.workunit.client.0.smithi179.stderr: 86950K .......... .......... .......... .......... .......... 51% 20.2M 3s 2024-08-24T21:12:08.608 INFO:tasks.workunit.client.0.smithi179.stderr: 87000K .......... .......... .......... .......... .......... 51% 32.6M 3s 2024-08-24T21:12:08.610 INFO:tasks.workunit.client.0.smithi179.stderr: 87050K .......... .......... .......... .......... .......... 51% 24.1M 3s 2024-08-24T21:12:08.610 INFO:tasks.workunit.client.0.smithi179.stderr: 87100K .......... .......... .......... .......... .......... 51% 45.8M 3s 2024-08-24T21:12:08.613 INFO:tasks.workunit.client.0.smithi179.stderr: 87150K .......... .......... .......... .......... .......... 51% 23.2M 3s 2024-08-24T21:12:08.615 INFO:tasks.workunit.client.0.smithi179.stderr: 87200K .......... .......... .......... .......... .......... 51% 24.1M 3s 2024-08-24T21:12:08.617 INFO:tasks.workunit.client.0.smithi179.stderr: 87250K .......... .......... .......... .......... .......... 51% 22.8M 3s 2024-08-24T21:12:08.618 INFO:tasks.workunit.client.0.smithi179.stderr: 87300K .......... .......... .......... .......... .......... 51% 36.2M 3s 2024-08-24T21:12:08.621 INFO:tasks.workunit.client.0.smithi179.stderr: 87350K .......... .......... .......... .......... .......... 51% 21.6M 3s 2024-08-24T21:12:08.621 INFO:tasks.workunit.client.0.smithi179.stderr: 87400K .......... .......... .......... .......... .......... 51% 49.6M 3s 2024-08-24T21:12:08.623 INFO:tasks.workunit.client.0.smithi179.stderr: 87450K .......... .......... .......... .......... .......... 51% 24.5M 3s 2024-08-24T21:12:08.624 INFO:tasks.workunit.client.0.smithi179.stderr: 87500K .......... .......... .......... .......... .......... 51% 39.7M 3s 2024-08-24T21:12:08.626 INFO:tasks.workunit.client.0.smithi179.stderr: 87550K .......... .......... .......... .......... .......... 51% 23.0M 3s 2024-08-24T21:12:08.628 INFO:tasks.workunit.client.0.smithi179.stderr: 87600K .......... .......... .......... .......... .......... 51% 25.1M 3s 2024-08-24T21:12:08.630 INFO:tasks.workunit.client.0.smithi179.stderr: 87650K .......... .......... .......... .......... .......... 52% 37.4M 3s 2024-08-24T21:12:08.632 INFO:tasks.workunit.client.0.smithi179.stderr: 87700K .......... .......... .......... .......... .......... 52% 27.2M 3s 2024-08-24T21:12:08.634 INFO:tasks.workunit.client.0.smithi179.stderr: 87750K .......... .......... .......... .......... .......... 52% 22.6M 3s 2024-08-24T21:12:08.634 INFO:tasks.workunit.client.0.smithi179.stderr: 87800K .......... .......... .......... .......... .......... 52% 43.3M 3s 2024-08-24T21:12:08.637 INFO:tasks.workunit.client.0.smithi179.stderr: 87850K .......... .......... .......... .......... .......... 52% 23.4M 3s 2024-08-24T21:12:08.638 INFO:tasks.workunit.client.0.smithi179.stderr: 87900K .......... .......... .......... .......... .......... 52% 49.0M 3s 2024-08-24T21:12:08.640 INFO:tasks.workunit.client.0.smithi179.stderr: 87950K .......... .......... .......... .......... .......... 52% 20.6M 3s 2024-08-24T21:12:08.642 INFO:tasks.workunit.client.0.smithi179.stderr: 88000K .......... .......... .......... .......... .......... 52% 24.0M 3s 2024-08-24T21:12:08.643 INFO:tasks.workunit.client.0.smithi179.stderr: 88050K .......... .......... .......... .......... .......... 52% 41.5M 3s 2024-08-24T21:12:08.645 INFO:tasks.workunit.client.0.smithi179.stderr: 88100K .......... .......... .......... .......... .......... 52% 24.7M 3s 2024-08-24T21:12:08.646 INFO:tasks.workunit.client.0.smithi179.stderr: 88150K .......... .......... .......... .......... .......... 52% 41.9M 3s 2024-08-24T21:12:08.649 INFO:tasks.workunit.client.0.smithi179.stderr: 88200K .......... .......... .......... .......... .......... 52% 29.6M 3s 2024-08-24T21:12:08.650 INFO:tasks.workunit.client.0.smithi179.stderr: 88250K .......... .......... .......... .......... .......... 52% 25.3M 3s 2024-08-24T21:12:08.652 INFO:tasks.workunit.client.0.smithi179.stderr: 88300K .......... .......... .......... .......... .......... 52% 29.6M 3s 2024-08-24T21:12:08.654 INFO:tasks.workunit.client.0.smithi179.stderr: 88350K .......... .......... .......... .......... .......... 52% 23.2M 3s 2024-08-24T21:12:08.656 INFO:tasks.workunit.client.0.smithi179.stderr: 88400K .......... .......... .......... .......... .......... 52% 23.9M 3s 2024-08-24T21:12:08.657 INFO:tasks.workunit.client.0.smithi179.stderr: 88450K .......... .......... .......... .......... .......... 52% 32.9M 3s 2024-08-24T21:12:08.659 INFO:tasks.workunit.client.0.smithi179.stderr: 88500K .......... .......... .......... .......... .......... 52% 24.8M 3s 2024-08-24T21:12:08.660 INFO:tasks.workunit.client.0.smithi179.stderr: 88550K .......... .......... .......... .......... .......... 52% 44.4M 3s 2024-08-24T21:12:08.663 INFO:tasks.workunit.client.0.smithi179.stderr: 88600K .......... .......... .......... .......... .......... 52% 22.0M 3s 2024-08-24T21:12:08.664 INFO:tasks.workunit.client.0.smithi179.stderr: 88650K .......... .......... .......... .......... .......... 52% 46.4M 3s 2024-08-24T21:12:08.666 INFO:tasks.workunit.client.0.smithi179.stderr: 88700K .......... .......... .......... .......... .......... 52% 22.9M 3s 2024-08-24T21:12:08.668 INFO:tasks.workunit.client.0.smithi179.stderr: 88750K .......... .......... .......... .......... .......... 52% 24.3M 3s 2024-08-24T21:12:08.669 INFO:tasks.workunit.client.0.smithi179.stderr: 88800K .......... .......... .......... .......... .......... 52% 39.5M 3s 2024-08-24T21:12:08.671 INFO:tasks.workunit.client.0.smithi179.stderr: 88850K .......... .......... .......... .......... .......... 52% 22.4M 3s 2024-08-24T21:12:08.672 INFO:tasks.workunit.client.0.smithi179.stderr: 88900K .......... .......... .......... .......... .......... 52% 50.2M 3s 2024-08-24T21:12:08.674 INFO:tasks.workunit.client.0.smithi179.stderr: 88950K .......... .......... .......... .......... .......... 52% 21.1M 3s 2024-08-24T21:12:08.676 INFO:tasks.workunit.client.0.smithi179.stderr: 89000K .......... .......... .......... .......... .......... 52% 36.8M 3s 2024-08-24T21:12:08.678 INFO:tasks.workunit.client.0.smithi179.stderr: 89050K .......... .......... .......... .......... .......... 52% 25.9M 3s 2024-08-24T21:12:08.680 INFO:tasks.workunit.client.0.smithi179.stderr: 89100K .......... .......... .......... .......... .......... 52% 20.1M 3s 2024-08-24T21:12:08.682 INFO:tasks.workunit.client.0.smithi179.stderr: 89150K .......... .......... .......... .......... .......... 52% 24.8M 3s 2024-08-24T21:12:08.683 INFO:tasks.workunit.client.0.smithi179.stderr: 89200K .......... .......... .......... .......... .......... 52% 45.9M 3s 2024-08-24T21:12:08.685 INFO:tasks.workunit.client.0.smithi179.stderr: 89250K .......... .......... .......... .......... .......... 52% 25.2M 3s 2024-08-24T21:12:08.686 INFO:tasks.workunit.client.0.smithi179.stderr: 89300K .......... .......... .......... .......... .......... 53% 41.7M 3s 2024-08-24T21:12:08.689 INFO:tasks.workunit.client.0.smithi179.stderr: 89350K .......... .......... .......... .......... .......... 53% 20.6M 3s 2024-08-24T21:12:08.690 INFO:tasks.workunit.client.0.smithi179.stderr: 89400K .......... .......... .......... .......... .......... 53% 50.8M 3s 2024-08-24T21:12:08.692 INFO:tasks.workunit.client.0.smithi179.stderr: 89450K .......... .......... .......... .......... .......... 53% 24.2M 3s 2024-08-24T21:12:08.694 INFO:tasks.workunit.client.0.smithi179.stderr: 89500K .......... .......... .......... .......... .......... 53% 32.8M 3s 2024-08-24T21:12:08.696 INFO:tasks.workunit.client.0.smithi179.stderr: 89550K .......... .......... .......... .......... .......... 53% 25.8M 3s 2024-08-24T21:12:08.698 INFO:tasks.workunit.client.0.smithi179.stderr: 89600K .......... .......... .......... .......... .......... 53% 24.1M 3s 2024-08-24T21:12:08.699 INFO:tasks.workunit.client.0.smithi179.stderr: 89650K .......... .......... .......... .......... .......... 53% 24.3M 3s 2024-08-24T21:12:08.700 INFO:tasks.workunit.client.0.smithi179.stderr: 89700K .......... .......... .......... .......... .......... 53% 50.8M 3s 2024-08-24T21:12:08.702 INFO:tasks.workunit.client.0.smithi179.stderr: 89750K .......... .......... .......... .......... .......... 53% 24.3M 3s 2024-08-24T21:12:08.703 INFO:tasks.workunit.client.0.smithi179.stderr: 89800K .......... .......... .......... .......... .......... 53% 39.1M 3s 2024-08-24T21:12:08.706 INFO:tasks.workunit.client.0.smithi179.stderr: 89850K .......... .......... .......... .......... .......... 53% 24.4M 3s 2024-08-24T21:12:08.707 INFO:tasks.workunit.client.0.smithi179.stderr: 89900K .......... .......... .......... .......... .......... 53% 34.7M 3s 2024-08-24T21:12:08.709 INFO:tasks.workunit.client.0.smithi179.stderr: 89950K .......... .......... .......... .......... .......... 53% 21.6M 3s 2024-08-24T21:12:08.711 INFO:tasks.workunit.client.0.smithi179.stderr: 90000K .......... .......... .......... .......... .......... 53% 25.4M 3s 2024-08-24T21:12:08.713 INFO:tasks.workunit.client.0.smithi179.stderr: 90050K .......... .......... .......... .......... .......... 53% 21.1M 3s 2024-08-24T21:12:08.715 INFO:tasks.workunit.client.0.smithi179.stderr: 90100K .......... .......... .......... .......... .......... 53% 31.6M 3s 2024-08-24T21:12:08.717 INFO:tasks.workunit.client.0.smithi179.stderr: 90150K .......... .......... .......... .......... .......... 53% 24.0M 3s 2024-08-24T21:12:08.718 INFO:tasks.workunit.client.0.smithi179.stderr: 90200K .......... .......... .......... .......... .......... 53% 58.5M 3s 2024-08-24T21:12:08.720 INFO:tasks.workunit.client.0.smithi179.stderr: 90250K .......... .......... .......... .......... .......... 53% 24.2M 3s 2024-08-24T21:12:08.721 INFO:tasks.workunit.client.0.smithi179.stderr: 90300K .......... .......... .......... .......... .......... 53% 31.5M 3s 2024-08-24T21:12:08.723 INFO:tasks.workunit.client.0.smithi179.stderr: 90350K .......... .......... .......... .......... .......... 53% 23.9M 3s 2024-08-24T21:12:08.725 INFO:tasks.workunit.client.0.smithi179.stderr: 90400K .......... .......... .......... .......... .......... 53% 25.0M 3s 2024-08-24T21:12:08.726 INFO:tasks.workunit.client.0.smithi179.stderr: 90450K .......... .......... .......... .......... .......... 53% 39.4M 3s 2024-08-24T21:12:08.729 INFO:tasks.workunit.client.0.smithi179.stderr: 90500K .......... .......... .......... .......... .......... 53% 23.4M 3s 2024-08-24T21:12:08.730 INFO:tasks.workunit.client.0.smithi179.stderr: 90550K .......... .......... .......... .......... .......... 53% 39.4M 3s 2024-08-24T21:12:08.732 INFO:tasks.workunit.client.0.smithi179.stderr: 90600K .......... .......... .......... .......... .......... 53% 21.8M 3s 2024-08-24T21:12:08.736 INFO:tasks.workunit.client.0.smithi179.stderr: 90650K .......... .......... .......... .......... .......... 53% 23.8M 3s 2024-08-24T21:12:08.736 INFO:tasks.workunit.client.0.smithi179.stderr: 90700K .......... .......... .......... .......... .......... 53% 42.0M 3s 2024-08-24T21:12:08.737 INFO:tasks.workunit.client.0.smithi179.stderr: 90750K .......... .......... .......... .......... .......... 53% 26.0M 3s 2024-08-24T21:12:08.740 INFO:tasks.workunit.client.0.smithi179.stderr: 90800K .......... .......... .......... .......... .......... 53% 20.9M 3s 2024-08-24T21:12:08.741 INFO:tasks.workunit.client.0.smithi179.stderr: 90850K .......... .......... .......... .......... .......... 53% 46.0M 3s 2024-08-24T21:12:08.743 INFO:tasks.workunit.client.0.smithi179.stderr: 90900K .......... .......... .......... .......... .......... 53% 19.6M 3s 2024-08-24T21:12:08.744 INFO:tasks.workunit.client.0.smithi179.stderr: 90950K .......... .......... .......... .......... .......... 53% 43.7M 3s 2024-08-24T21:12:08.747 INFO:tasks.workunit.client.0.smithi179.stderr: 91000K .......... .......... .......... .......... .......... 54% 23.3M 3s 2024-08-24T21:12:08.748 INFO:tasks.workunit.client.0.smithi179.stderr: 91050K .......... .......... .......... .......... .......... 54% 29.0M 3s 2024-08-24T21:12:08.751 INFO:tasks.workunit.client.0.smithi179.stderr: 91100K .......... .......... .......... .......... .......... 54% 18.7M 3s 2024-08-24T21:12:08.752 INFO:tasks.workunit.client.0.smithi179.stderr: 91150K .......... .......... .......... .......... .......... 54% 28.1M 3s 2024-08-24T21:12:08.756 INFO:tasks.workunit.client.0.smithi179.stderr: 91200K .......... .......... .......... .......... .......... 54% 20.9M 3s 2024-08-24T21:12:08.756 INFO:tasks.workunit.client.0.smithi179.stderr: 91250K .......... .......... .......... .......... .......... 54% 75.5M 3s 2024-08-24T21:12:08.758 INFO:tasks.workunit.client.0.smithi179.stderr: 91300K .......... .......... .......... .......... .......... 54% 20.2M 3s 2024-08-24T21:12:08.759 INFO:tasks.workunit.client.0.smithi179.stderr: 91350K .......... .......... .......... .......... .......... 54% 40.3M 3s 2024-08-24T21:12:08.761 INFO:tasks.workunit.client.0.smithi179.stderr: 91400K .......... .......... .......... .......... .......... 54% 24.9M 3s 2024-08-24T21:12:08.762 INFO:tasks.workunit.client.0.smithi179.stderr: 91450K .......... .......... .......... .......... .......... 54% 46.3M 3s 2024-08-24T21:12:08.764 INFO:tasks.workunit.client.0.smithi179.stderr: 91500K .......... .......... .......... .......... .......... 54% 22.2M 3s 2024-08-24T21:12:08.766 INFO:tasks.workunit.client.0.smithi179.stderr: 91550K .......... .......... .......... .......... .......... 54% 23.7M 3s 2024-08-24T21:12:08.767 INFO:tasks.workunit.client.0.smithi179.stderr: 91600K .......... .......... .......... .......... .......... 54% 39.0M 3s 2024-08-24T21:12:08.769 INFO:tasks.workunit.client.0.smithi179.stderr: 91650K .......... .......... .......... .......... .......... 54% 26.6M 3s 2024-08-24T21:12:08.771 INFO:tasks.workunit.client.0.smithi179.stderr: 91700K .......... .......... .......... .......... .......... 54% 37.7M 3s 2024-08-24T21:12:08.772 INFO:tasks.workunit.client.0.smithi179.stderr: 91750K .......... .......... .......... .......... .......... 54% 24.8M 3s 2024-08-24T21:12:08.775 INFO:tasks.workunit.client.0.smithi179.stderr: 91800K .......... .......... .......... .......... .......... 54% 25.5M 3s 2024-08-24T21:12:08.776 INFO:tasks.workunit.client.0.smithi179.stderr: 91850K .......... .......... .......... .......... .......... 54% 35.5M 3s 2024-08-24T21:12:08.778 INFO:tasks.workunit.client.0.smithi179.stderr: 91900K .......... .......... .......... .......... .......... 54% 22.3M 3s 2024-08-24T21:12:08.780 INFO:tasks.workunit.client.0.smithi179.stderr: 91950K .......... .......... .......... .......... .......... 54% 25.8M 3s 2024-08-24T21:12:08.781 INFO:tasks.workunit.client.0.smithi179.stderr: 92000K .......... .......... .......... .......... .......... 54% 38.7M 3s 2024-08-24T21:12:08.783 INFO:tasks.workunit.client.0.smithi179.stderr: 92050K .......... .......... .......... .......... .......... 54% 23.3M 3s 2024-08-24T21:12:08.785 INFO:tasks.workunit.client.0.smithi179.stderr: 92100K .......... .......... .......... .......... .......... 54% 33.8M 3s 2024-08-24T21:12:08.787 INFO:tasks.workunit.client.0.smithi179.stderr: 92150K .......... .......... .......... .......... .......... 54% 19.9M 3s 2024-08-24T21:12:08.788 INFO:tasks.workunit.client.0.smithi179.stderr: 92200K .......... .......... .......... .......... .......... 54% 49.8M 3s 2024-08-24T21:12:08.791 INFO:tasks.workunit.client.0.smithi179.stderr: 92250K .......... .......... .......... .......... .......... 54% 20.4M 3s 2024-08-24T21:12:08.792 INFO:tasks.workunit.client.0.smithi179.stderr: 92300K .......... .......... .......... .......... .......... 54% 36.3M 3s 2024-08-24T21:12:08.795 INFO:tasks.workunit.client.0.smithi179.stderr: 92350K .......... .......... .......... .......... .......... 54% 21.3M 3s 2024-08-24T21:12:08.796 INFO:tasks.workunit.client.0.smithi179.stderr: 92400K .......... .......... .......... .......... .......... 54% 23.5M 3s 2024-08-24T21:12:08.800 INFO:tasks.workunit.client.0.smithi179.stderr: 92450K .......... .......... .......... .......... .......... 54% 20.3M 3s 2024-08-24T21:12:08.800 INFO:tasks.workunit.client.0.smithi179.stderr: 92500K .......... .......... .......... .......... .......... 54% 50.9M 3s 2024-08-24T21:12:08.802 INFO:tasks.workunit.client.0.smithi179.stderr: 92550K .......... .......... .......... .......... .......... 54% 23.2M 3s 2024-08-24T21:12:08.804 INFO:tasks.workunit.client.0.smithi179.stderr: 92600K .......... .......... .......... .......... .......... 54% 30.7M 3s 2024-08-24T21:12:08.805 INFO:tasks.workunit.client.0.smithi179.stderr: 92650K .......... .......... .......... .......... .......... 54% 27.9M 3s 2024-08-24T21:12:08.806 INFO:tasks.workunit.client.0.smithi179.stderr: 92700K .......... .......... .......... .......... .......... 55% 45.8M 3s 2024-08-24T21:12:08.809 INFO:tasks.workunit.client.0.smithi179.stderr: 92750K .......... .......... .......... .......... .......... 55% 19.6M 3s 2024-08-24T21:12:08.811 INFO:tasks.workunit.client.0.smithi179.stderr: 92800K .......... .......... .......... .......... .......... 55% 21.7M 3s 2024-08-24T21:12:08.812 INFO:tasks.workunit.client.0.smithi179.stderr: 92850K .......... .......... .......... .......... .......... 55% 41.1M 3s 2024-08-24T21:12:08.814 INFO:tasks.workunit.client.0.smithi179.stderr: 92900K .......... .......... .......... .......... .......... 55% 22.9M 3s 2024-08-24T21:12:08.817 INFO:tasks.workunit.client.0.smithi179.stderr: 92950K .......... .......... .......... .......... .......... 55% 19.2M 3s 2024-08-24T21:12:08.818 INFO:tasks.workunit.client.0.smithi179.stderr: 93000K .......... .......... .......... .......... .......... 55% 40.6M 3s 2024-08-24T21:12:08.820 INFO:tasks.workunit.client.0.smithi179.stderr: 93050K .......... .......... .......... .......... .......... 55% 24.1M 3s 2024-08-24T21:12:08.821 INFO:tasks.workunit.client.0.smithi179.stderr: 93100K .......... .......... .......... .......... .......... 55% 39.1M 3s 2024-08-24T21:12:08.823 INFO:tasks.workunit.client.0.smithi179.stderr: 93150K .......... .......... .......... .......... .......... 55% 24.6M 3s 2024-08-24T21:12:08.826 INFO:tasks.workunit.client.0.smithi179.stderr: 93200K .......... .......... .......... .......... .......... 55% 19.3M 3s 2024-08-24T21:12:08.827 INFO:tasks.workunit.client.0.smithi179.stderr: 93250K .......... .......... .......... .......... .......... 55% 40.4M 3s 2024-08-24T21:12:08.829 INFO:tasks.workunit.client.0.smithi179.stderr: 93300K .......... .......... .......... .......... .......... 55% 27.4M 3s 2024-08-24T21:12:08.830 INFO:tasks.workunit.client.0.smithi179.stderr: 93350K .......... .......... .......... .......... .......... 55% 40.6M 3s 2024-08-24T21:12:08.832 INFO:tasks.workunit.client.0.smithi179.stderr: 93400K .......... .......... .......... .......... .......... 55% 18.8M 3s 2024-08-24T21:12:08.834 INFO:tasks.workunit.client.0.smithi179.stderr: 93450K .......... .......... .......... .......... .......... 55% 48.8M 3s 2024-08-24T21:12:08.835 INFO:tasks.workunit.client.0.smithi179.stderr: 93500K .......... .......... .......... .......... .......... 55% 25.6M 3s 2024-08-24T21:12:08.838 INFO:tasks.workunit.client.0.smithi179.stderr: 93550K .......... .......... .......... .......... .......... 55% 17.3M 3s 2024-08-24T21:12:08.840 INFO:tasks.workunit.client.0.smithi179.stderr: 93600K .......... .......... .......... .......... .......... 55% 27.2M 3s 2024-08-24T21:12:08.841 INFO:tasks.workunit.client.0.smithi179.stderr: 93650K .......... .......... .......... .......... .......... 55% 39.4M 3s 2024-08-24T21:12:08.843 INFO:tasks.workunit.client.0.smithi179.stderr: 93700K .......... .......... .......... .......... .......... 55% 23.3M 3s 2024-08-24T21:12:08.844 INFO:tasks.workunit.client.0.smithi179.stderr: 93750K .......... .......... .......... .......... .......... 55% 42.6M 3s 2024-08-24T21:12:08.847 INFO:tasks.workunit.client.0.smithi179.stderr: 93800K .......... .......... .......... .......... .......... 55% 24.3M 3s 2024-08-24T21:12:08.848 INFO:tasks.workunit.client.0.smithi179.stderr: 93850K .......... .......... .......... .......... .......... 55% 41.2M 3s 2024-08-24T21:12:08.850 INFO:tasks.workunit.client.0.smithi179.stderr: 93900K .......... .......... .......... .......... .......... 55% 24.2M 3s 2024-08-24T21:12:08.851 INFO:tasks.workunit.client.0.smithi179.stderr: 93950K .......... .......... .......... .......... .......... 55% 26.9M 3s 2024-08-24T21:12:08.853 INFO:tasks.workunit.client.0.smithi179.stderr: 94000K .......... .......... .......... .......... .......... 55% 38.8M 3s 2024-08-24T21:12:08.855 INFO:tasks.workunit.client.0.smithi179.stderr: 94050K .......... .......... .......... .......... .......... 55% 22.2M 3s 2024-08-24T21:12:08.857 INFO:tasks.workunit.client.0.smithi179.stderr: 94100K .......... .......... .......... .......... .......... 55% 23.8M 3s 2024-08-24T21:12:08.859 INFO:tasks.workunit.client.0.smithi179.stderr: 94150K .......... .......... .......... .......... .......... 55% 33.3M 3s 2024-08-24T21:12:08.860 INFO:tasks.workunit.client.0.smithi179.stderr: 94200K .......... .......... .......... .......... .......... 55% 28.8M 3s 2024-08-24T21:12:08.862 INFO:tasks.workunit.client.0.smithi179.stderr: 94250K .......... .......... .......... .......... .......... 55% 30.6M 3s 2024-08-24T21:12:08.864 INFO:tasks.workunit.client.0.smithi179.stderr: 94300K .......... .......... .......... .......... .......... 55% 26.3M 3s 2024-08-24T21:12:08.866 INFO:tasks.workunit.client.0.smithi179.stderr: 94350K .......... .......... .......... .......... .......... 56% 21.9M 3s 2024-08-24T21:12:08.867 INFO:tasks.workunit.client.0.smithi179.stderr: 94400K .......... .......... .......... .......... .......... 56% 41.8M 3s 2024-08-24T21:12:08.869 INFO:tasks.workunit.client.0.smithi179.stderr: 94450K .......... .......... .......... .......... .......... 56% 24.0M 3s 2024-08-24T21:12:08.870 INFO:tasks.workunit.client.0.smithi179.stderr: 94500K .......... .......... .......... .......... .......... 56% 45.9M 3s 2024-08-24T21:12:08.872 INFO:tasks.workunit.client.0.smithi179.stderr: 94550K .......... .......... .......... .......... .......... 56% 24.6M 3s 2024-08-24T21:12:08.873 INFO:tasks.workunit.client.0.smithi179.stderr: 94600K .......... .......... .......... .......... .......... 56% 36.9M 3s 2024-08-24T21:12:08.876 INFO:tasks.workunit.client.0.smithi179.stderr: 94650K .......... .......... .......... .......... .......... 56% 23.9M 3s 2024-08-24T21:12:08.877 INFO:tasks.workunit.client.0.smithi179.stderr: 94700K .......... .......... .......... .......... .......... 56% 26.4M 3s 2024-08-24T21:12:08.880 INFO:tasks.workunit.client.0.smithi179.stderr: 94750K .......... .......... .......... .......... .......... 56% 22.5M 3s 2024-08-24T21:12:08.881 INFO:tasks.workunit.client.0.smithi179.stderr: 94800K .......... .......... .......... .......... .......... 56% 41.8M 3s 2024-08-24T21:12:08.883 INFO:tasks.workunit.client.0.smithi179.stderr: 94850K .......... .......... .......... .......... .......... 56% 23.1M 3s 2024-08-24T21:12:08.884 INFO:tasks.workunit.client.0.smithi179.stderr: 94900K .......... .......... .......... .......... .......... 56% 41.4M 3s 2024-08-24T21:12:08.886 INFO:tasks.workunit.client.0.smithi179.stderr: 94950K .......... .......... .......... .......... .......... 56% 23.6M 3s 2024-08-24T21:12:08.887 INFO:tasks.workunit.client.0.smithi179.stderr: 95000K .......... .......... .......... .......... .......... 56% 45.9M 3s 2024-08-24T21:12:08.889 INFO:tasks.workunit.client.0.smithi179.stderr: 95050K .......... .......... .......... .......... .......... 56% 24.5M 3s 2024-08-24T21:12:08.890 INFO:tasks.workunit.client.0.smithi179.stderr: 95100K .......... .......... .......... .......... .......... 56% 39.9M 3s 2024-08-24T21:12:08.893 INFO:tasks.workunit.client.0.smithi179.stderr: 95150K .......... .......... .......... .......... .......... 56% 20.7M 3s 2024-08-24T21:12:08.895 INFO:tasks.workunit.client.0.smithi179.stderr: 95200K .......... .......... .......... .......... .......... 56% 18.2M 3s 2024-08-24T21:12:08.900 INFO:tasks.workunit.client.0.smithi179.stderr: 95250K .......... .......... .......... .......... .......... 56% 16.9M 3s 2024-08-24T21:12:08.900 INFO:tasks.workunit.client.0.smithi179.stderr: 95300K .......... .......... .......... .......... .......... 56% 45.4M 3s 2024-08-24T21:12:08.901 INFO:tasks.workunit.client.0.smithi179.stderr: 95350K .......... .......... .......... .......... .......... 56% 40.1M 3s 2024-08-24T21:12:08.903 INFO:tasks.workunit.client.0.smithi179.stderr: 95400K .......... .......... .......... .......... .......... 56% 18.0M 3s 2024-08-24T21:12:08.905 INFO:tasks.workunit.client.0.smithi179.stderr: 95450K .......... .......... .......... .......... .......... 56% 23.9M 3s 2024-08-24T21:12:08.906 INFO:tasks.workunit.client.0.smithi179.stderr: 95500K .......... .......... .......... .......... .......... 56% 38.0M 3s 2024-08-24T21:12:08.908 INFO:tasks.workunit.client.0.smithi179.stderr: 95550K .......... .......... .......... .......... .......... 56% 26.3M 3s 2024-08-24T21:12:08.911 INFO:tasks.workunit.client.0.smithi179.stderr: 95600K .......... .......... .......... .......... .......... 56% 22.2M 3s 2024-08-24T21:12:08.912 INFO:tasks.workunit.client.0.smithi179.stderr: 95650K .......... .......... .......... .......... .......... 56% 29.5M 3s 2024-08-24T21:12:08.915 INFO:tasks.workunit.client.0.smithi179.stderr: 95700K .......... .......... .......... .......... .......... 56% 22.3M 3s 2024-08-24T21:12:08.917 INFO:tasks.workunit.client.0.smithi179.stderr: 95750K .......... .......... .......... .......... .......... 56% 22.5M 3s 2024-08-24T21:12:08.918 INFO:tasks.workunit.client.0.smithi179.stderr: 95800K .......... .......... .......... .......... .......... 56% 48.1M 3s 2024-08-24T21:12:08.919 INFO:tasks.workunit.client.0.smithi179.stderr: 95850K .......... .......... .......... .......... .......... 56% 30.8M 3s 2024-08-24T21:12:08.921 INFO:tasks.workunit.client.0.smithi179.stderr: 95900K .......... .......... .......... .......... .......... 56% 28.0M 3s 2024-08-24T21:12:08.923 INFO:tasks.workunit.client.0.smithi179.stderr: 95950K .......... .......... .......... .......... .......... 56% 22.2M 3s 2024-08-24T21:12:08.926 INFO:tasks.workunit.client.0.smithi179.stderr: 96000K .......... .......... .......... .......... .......... 56% 21.5M 3s 2024-08-24T21:12:08.927 INFO:tasks.workunit.client.0.smithi179.stderr: 96050K .......... .......... .......... .......... .......... 57% 46.6M 3s 2024-08-24T21:12:08.929 INFO:tasks.workunit.client.0.smithi179.stderr: 96100K .......... .......... .......... .......... .......... 57% 26.4M 3s 2024-08-24T21:12:08.930 INFO:tasks.workunit.client.0.smithi179.stderr: 96150K .......... .......... .......... .......... .......... 57% 35.1M 3s 2024-08-24T21:12:08.932 INFO:tasks.workunit.client.0.smithi179.stderr: 96200K .......... .......... .......... .......... .......... 57% 24.2M 3s 2024-08-24T21:12:08.933 INFO:tasks.workunit.client.0.smithi179.stderr: 96250K .......... .......... .......... .......... .......... 57% 45.5M 3s 2024-08-24T21:12:08.934 INFO:tasks.workunit.client.0.smithi179.stderr: 96300K .......... .......... .......... .......... .......... 57% 32.8M 3s 2024-08-24T21:12:08.937 INFO:tasks.workunit.client.0.smithi179.stderr: 96350K .......... .......... .......... .......... .......... 57% 18.9M 3s 2024-08-24T21:12:08.939 INFO:tasks.workunit.client.0.smithi179.stderr: 96400K .......... .......... .......... .......... .......... 57% 23.7M 3s 2024-08-24T21:12:08.940 INFO:tasks.workunit.client.0.smithi179.stderr: 96450K .......... .......... .......... .......... .......... 57% 38.1M 3s 2024-08-24T21:12:08.942 INFO:tasks.workunit.client.0.smithi179.stderr: 96500K .......... .......... .......... .......... .......... 57% 25.0M 3s 2024-08-24T21:12:08.943 INFO:tasks.workunit.client.0.smithi179.stderr: 96550K .......... .......... .......... .......... .......... 57% 44.8M 3s 2024-08-24T21:12:08.946 INFO:tasks.workunit.client.0.smithi179.stderr: 96600K .......... .......... .......... .......... .......... 57% 22.1M 3s 2024-08-24T21:12:08.947 INFO:tasks.workunit.client.0.smithi179.stderr: 96650K .......... .......... .......... .......... .......... 57% 32.7M 3s 2024-08-24T21:12:08.949 INFO:tasks.workunit.client.0.smithi179.stderr: 96700K .......... .......... .......... .......... .......... 57% 27.1M 3s 2024-08-24T21:12:08.951 INFO:tasks.workunit.client.0.smithi179.stderr: 96750K .......... .......... .......... .......... .......... 57% 24.7M 3s 2024-08-24T21:12:08.952 INFO:tasks.workunit.client.0.smithi179.stderr: 96800K .......... .......... .......... .......... .......... 57% 42.2M 3s 2024-08-24T21:12:08.954 INFO:tasks.workunit.client.0.smithi179.stderr: 96850K .......... .......... .......... .......... .......... 57% 25.9M 3s 2024-08-24T21:12:08.956 INFO:tasks.workunit.client.0.smithi179.stderr: 96900K .......... .......... .......... .......... .......... 57% 28.6M 3s 2024-08-24T21:12:08.957 INFO:tasks.workunit.client.0.smithi179.stderr: 96950K .......... .......... .......... .......... .......... 57% 28.4M 3s 2024-08-24T21:12:08.959 INFO:tasks.workunit.client.0.smithi179.stderr: 97000K .......... .......... .......... .......... .......... 57% 25.7M 3s 2024-08-24T21:12:08.960 INFO:tasks.workunit.client.0.smithi179.stderr: 97050K .......... .......... .......... .......... .......... 57% 40.2M 3s 2024-08-24T21:12:08.962 INFO:tasks.workunit.client.0.smithi179.stderr: 97100K .......... .......... .......... .......... .......... 57% 29.6M 3s 2024-08-24T21:12:08.965 INFO:tasks.workunit.client.0.smithi179.stderr: 97150K .......... .......... .......... .......... .......... 57% 21.2M 3s 2024-08-24T21:12:08.966 INFO:tasks.workunit.client.0.smithi179.stderr: 97200K .......... .......... .......... .......... .......... 57% 35.3M 3s 2024-08-24T21:12:08.968 INFO:tasks.workunit.client.0.smithi179.stderr: 97250K .......... .......... .......... .......... .......... 57% 24.1M 3s 2024-08-24T21:12:08.969 INFO:tasks.workunit.client.0.smithi179.stderr: 97300K .......... .......... .......... .......... .......... 57% 44.6M 3s 2024-08-24T21:12:08.971 INFO:tasks.workunit.client.0.smithi179.stderr: 97350K .......... .......... .......... .......... .......... 57% 23.9M 3s 2024-08-24T21:12:08.972 INFO:tasks.workunit.client.0.smithi179.stderr: 97400K .......... .......... .......... .......... .......... 57% 41.5M 3s 2024-08-24T21:12:08.975 INFO:tasks.workunit.client.0.smithi179.stderr: 97450K .......... .......... .......... .......... .......... 57% 21.9M 3s 2024-08-24T21:12:08.976 INFO:tasks.workunit.client.0.smithi179.stderr: 97500K .......... .......... .......... .......... .......... 57% 26.6M 3s 2024-08-24T21:12:08.978 INFO:tasks.workunit.client.0.smithi179.stderr: 97550K .......... .......... .......... .......... .......... 57% 22.7M 3s 2024-08-24T21:12:08.979 INFO:tasks.workunit.client.0.smithi179.stderr: 97600K .......... .......... .......... .......... .......... 57% 44.7M 3s 2024-08-24T21:12:08.981 INFO:tasks.workunit.client.0.smithi179.stderr: 97650K .......... .......... .......... .......... .......... 57% 24.8M 3s 2024-08-24T21:12:08.982 INFO:tasks.workunit.client.0.smithi179.stderr: 97700K .......... .......... .......... .......... .......... 57% 39.8M 3s 2024-08-24T21:12:08.985 INFO:tasks.workunit.client.0.smithi179.stderr: 97750K .......... .......... .......... .......... .......... 58% 23.9M 3s 2024-08-24T21:12:08.986 INFO:tasks.workunit.client.0.smithi179.stderr: 97800K .......... .......... .......... .......... .......... 58% 42.9M 3s 2024-08-24T21:12:08.988 INFO:tasks.workunit.client.0.smithi179.stderr: 97850K .......... .......... .......... .......... .......... 58% 22.1M 3s 2024-08-24T21:12:08.989 INFO:tasks.workunit.client.0.smithi179.stderr: 97900K .......... .......... .......... .......... .......... 58% 40.3M 3s 2024-08-24T21:12:08.991 INFO:tasks.workunit.client.0.smithi179.stderr: 97950K .......... .......... .......... .......... .......... 58% 23.5M 3s 2024-08-24T21:12:08.994 INFO:tasks.workunit.client.0.smithi179.stderr: 98000K .......... .......... .......... .......... .......... 58% 22.2M 3s 2024-08-24T21:12:08.996 INFO:tasks.workunit.client.0.smithi179.stderr: 98050K .......... .......... .......... .......... .......... 58% 22.8M 3s 2024-08-24T21:12:08.997 INFO:tasks.workunit.client.0.smithi179.stderr: 98100K .......... .......... .......... .......... .......... 58% 45.7M 3s 2024-08-24T21:12:08.999 INFO:tasks.workunit.client.0.smithi179.stderr: 98150K .......... .......... .......... .......... .......... 58% 23.6M 3s 2024-08-24T21:12:09.000 INFO:tasks.workunit.client.0.smithi179.stderr: 98200K .......... .......... .......... .......... .......... 58% 31.1M 3s 2024-08-24T21:12:09.003 INFO:tasks.workunit.client.0.smithi179.stderr: 98250K .......... .......... .......... .......... .......... 58% 26.9M 3s 2024-08-24T21:12:09.003 INFO:tasks.workunit.client.0.smithi179.stderr: 98300K .......... .......... .......... .......... .......... 58% 44.8M 3s 2024-08-24T21:12:09.005 INFO:tasks.workunit.client.0.smithi179.stderr: 98350K .......... .......... .......... .......... .......... 58% 24.1M 3s 2024-08-24T21:12:09.007 INFO:tasks.workunit.client.0.smithi179.stderr: 98400K .......... .......... .......... .......... .......... 58% 24.2M 3s 2024-08-24T21:12:09.013 INFO:tasks.workunit.client.0.smithi179.stderr: 98450K .......... .......... .......... .......... .......... 58% 39.8M 3s 2024-08-24T21:12:09.013 INFO:tasks.workunit.client.0.smithi179.stderr: 98500K .......... .......... .......... .......... .......... 58% 24.2M 3s 2024-08-24T21:12:09.013 INFO:tasks.workunit.client.0.smithi179.stderr: 98550K .......... .......... .......... .......... .......... 58% 38.7M 3s 2024-08-24T21:12:09.014 INFO:tasks.workunit.client.0.smithi179.stderr: 98600K .......... .......... .......... .......... .......... 58% 26.3M 3s 2024-08-24T21:12:09.016 INFO:tasks.workunit.client.0.smithi179.stderr: 98650K .......... .......... .......... .......... .......... 58% 23.9M 3s 2024-08-24T21:12:09.017 INFO:tasks.workunit.client.0.smithi179.stderr: 98700K .......... .......... .......... .......... .......... 58% 41.0M 3s 2024-08-24T21:12:09.019 INFO:tasks.workunit.client.0.smithi179.stderr: 98750K .......... .......... .......... .......... .......... 58% 22.6M 3s 2024-08-24T21:12:09.021 INFO:tasks.workunit.client.0.smithi179.stderr: 98800K .......... .......... .......... .......... .......... 58% 24.2M 3s 2024-08-24T21:12:09.022 INFO:tasks.workunit.client.0.smithi179.stderr: 98850K .......... .......... .......... .......... .......... 58% 47.4M 3s 2024-08-24T21:12:09.024 INFO:tasks.workunit.client.0.smithi179.stderr: 98900K .......... .......... .......... .......... .......... 58% 25.3M 3s 2024-08-24T21:12:09.025 INFO:tasks.workunit.client.0.smithi179.stderr: 98950K .......... .......... .......... .......... .......... 58% 39.7M 3s 2024-08-24T21:12:09.027 INFO:tasks.workunit.client.0.smithi179.stderr: 99000K .......... .......... .......... .......... .......... 58% 23.6M 3s 2024-08-24T21:12:09.028 INFO:tasks.workunit.client.0.smithi179.stderr: 99050K .......... .......... .......... .......... .......... 58% 45.9M 3s 2024-08-24T21:12:09.030 INFO:tasks.workunit.client.0.smithi179.stderr: 99100K .......... .......... .......... .......... .......... 58% 25.0M 3s 2024-08-24T21:12:09.032 INFO:tasks.workunit.client.0.smithi179.stderr: 99150K .......... .......... .......... .......... .......... 58% 23.3M 3s 2024-08-24T21:12:09.034 INFO:tasks.workunit.client.0.smithi179.stderr: 99200K .......... .......... .......... .......... .......... 58% 37.6M 3s 2024-08-24T21:12:09.036 INFO:tasks.workunit.client.0.smithi179.stderr: 99250K .......... .......... .......... .......... .......... 58% 21.5M 3s 2024-08-24T21:12:09.038 INFO:tasks.workunit.client.0.smithi179.stderr: 99300K .......... .......... .......... .......... .......... 58% 25.3M 3s 2024-08-24T21:12:09.039 INFO:tasks.workunit.client.0.smithi179.stderr: 99350K .......... .......... .......... .......... .......... 58% 42.2M 3s 2024-08-24T21:12:09.041 INFO:tasks.workunit.client.0.smithi179.stderr: 99400K .......... .......... .......... .......... .......... 58% 22.3M 3s 2024-08-24T21:12:09.043 INFO:tasks.workunit.client.0.smithi179.stderr: 99450K .......... .......... .......... .......... .......... 59% 45.7M 3s 2024-08-24T21:12:09.045 INFO:tasks.workunit.client.0.smithi179.stderr: 99500K .......... .......... .......... .......... .......... 59% 23.7M 3s 2024-08-24T21:12:09.047 INFO:tasks.workunit.client.0.smithi179.stderr: 99550K .......... .......... .......... .......... .......... 59% 21.7M 3s 2024-08-24T21:12:09.048 INFO:tasks.workunit.client.0.smithi179.stderr: 99600K .......... .......... .......... .......... .......... 59% 48.3M 3s 2024-08-24T21:12:09.050 INFO:tasks.workunit.client.0.smithi179.stderr: 99650K .......... .......... .......... .......... .......... 59% 23.6M 3s 2024-08-24T21:12:09.052 INFO:tasks.workunit.client.0.smithi179.stderr: 99700K .......... .......... .......... .......... .......... 59% 35.4M 3s 2024-08-24T21:12:09.054 INFO:tasks.workunit.client.0.smithi179.stderr: 99750K .......... .......... .......... .......... .......... 59% 22.1M 3s 2024-08-24T21:12:09.056 INFO:tasks.workunit.client.0.smithi179.stderr: 99800K .......... .......... .......... .......... .......... 59% 22.8M 3s 2024-08-24T21:12:09.057 INFO:tasks.workunit.client.0.smithi179.stderr: 99850K .......... .......... .......... .......... .......... 59% 39.0M 3s 2024-08-24T21:12:09.059 INFO:tasks.workunit.client.0.smithi179.stderr: 99900K .......... .......... .......... .......... .......... 59% 25.0M 3s 2024-08-24T21:12:09.061 INFO:tasks.workunit.client.0.smithi179.stderr: 99950K .......... .......... .......... .......... .......... 59% 21.5M 3s 2024-08-24T21:12:09.062 INFO:tasks.workunit.client.0.smithi179.stderr:100000K .......... .......... .......... .......... .......... 59% 37.2M 2s 2024-08-24T21:12:09.065 INFO:tasks.workunit.client.0.smithi179.stderr:100050K .......... .......... .......... .......... .......... 59% 18.1M 2s 2024-08-24T21:12:09.066 INFO:tasks.workunit.client.0.smithi179.stderr:100100K .......... .......... .......... .......... .......... 59% 48.0M 2s 2024-08-24T21:12:09.068 INFO:tasks.workunit.client.0.smithi179.stderr:100150K .......... .......... .......... .......... .......... 59% 24.9M 2s 2024-08-24T21:12:09.072 INFO:tasks.workunit.client.0.smithi179.stderr:100200K .......... .......... .......... .......... .......... 59% 20.9M 2s 2024-08-24T21:12:09.072 INFO:tasks.workunit.client.0.smithi179.stderr:100250K .......... .......... .......... .......... .......... 59% 39.8M 2s 2024-08-24T21:12:09.075 INFO:tasks.workunit.client.0.smithi179.stderr:100300K .......... .......... .......... .......... .......... 59% 17.9M 2s 2024-08-24T21:12:09.078 INFO:tasks.workunit.client.0.smithi179.stderr:100350K .......... .......... .......... .......... .......... 59% 18.0M 2s 2024-08-24T21:12:09.078 INFO:tasks.workunit.client.0.smithi179.stderr:100400K .......... .......... .......... .......... .......... 59% 46.1M 2s 2024-08-24T21:12:09.081 INFO:tasks.workunit.client.0.smithi179.stderr:100450K .......... .......... .......... .......... .......... 59% 19.5M 2s 2024-08-24T21:12:09.083 INFO:tasks.workunit.client.0.smithi179.stderr:100500K .......... .......... .......... .......... .......... 59% 32.1M 2s 2024-08-24T21:12:09.083 INFO:tasks.workunit.client.0.smithi179.stderr:100550K .......... .......... .......... .......... .......... 59% 31.6M 2s 2024-08-24T21:12:09.085 INFO:tasks.workunit.client.0.smithi179.stderr:100600K .......... .......... .......... .......... .......... 59% 27.5M 2s 2024-08-24T21:12:09.088 INFO:tasks.workunit.client.0.smithi179.stderr:100650K .......... .......... .......... .......... .......... 59% 20.0M 2s 2024-08-24T21:12:09.091 INFO:tasks.workunit.client.0.smithi179.stderr:100700K .......... .......... .......... .......... .......... 59% 21.1M 2s 2024-08-24T21:12:09.092 INFO:tasks.workunit.client.0.smithi179.stderr:100750K .......... .......... .......... .......... .......... 59% 30.8M 2s 2024-08-24T21:12:09.094 INFO:tasks.workunit.client.0.smithi179.stderr:100800K .......... .......... .......... .......... .......... 59% 21.5M 2s 2024-08-24T21:12:09.096 INFO:tasks.workunit.client.0.smithi179.stderr:100850K .......... .......... .......... .......... .......... 59% 32.0M 2s 2024-08-24T21:12:09.097 INFO:tasks.workunit.client.0.smithi179.stderr:100900K .......... .......... .......... .......... .......... 59% 28.5M 2s 2024-08-24T21:12:09.100 INFO:tasks.workunit.client.0.smithi179.stderr:100950K .......... .......... .......... .......... .......... 59% 17.7M 2s 2024-08-24T21:12:09.102 INFO:tasks.workunit.client.0.smithi179.stderr:101000K .......... .......... .......... .......... .......... 59% 30.8M 2s 2024-08-24T21:12:09.105 INFO:tasks.workunit.client.0.smithi179.stderr:101050K .......... .......... .......... .......... .......... 59% 20.7M 2s 2024-08-24T21:12:09.105 INFO:tasks.workunit.client.0.smithi179.stderr:101100K .......... .......... .......... .......... .......... 60% 54.0M 2s 2024-08-24T21:12:09.107 INFO:tasks.workunit.client.0.smithi179.stderr:101150K .......... .......... .......... .......... .......... 60% 22.7M 2s 2024-08-24T21:12:09.109 INFO:tasks.workunit.client.0.smithi179.stderr:101200K .......... .......... .......... .......... .......... 60% 20.4M 2s 2024-08-24T21:12:09.112 INFO:tasks.workunit.client.0.smithi179.stderr:101250K .......... .......... .......... .......... .......... 60% 28.0M 2s 2024-08-24T21:12:09.114 INFO:tasks.workunit.client.0.smithi179.stderr:101300K .......... .......... .......... .......... .......... 60% 29.0M 2s 2024-08-24T21:12:09.114 INFO:tasks.workunit.client.0.smithi179.stderr:101350K .......... .......... .......... .......... .......... 60% 46.4M 2s 2024-08-24T21:12:09.116 INFO:tasks.workunit.client.0.smithi179.stderr:101400K .......... .......... .......... .......... .......... 60% 23.9M 2s 2024-08-24T21:12:09.118 INFO:tasks.workunit.client.0.smithi179.stderr:101450K .......... .......... .......... .......... .......... 60% 23.3M 2s 2024-08-24T21:12:09.119 INFO:tasks.workunit.client.0.smithi179.stderr:101500K .......... .......... .......... .......... .......... 60% 37.2M 2s 2024-08-24T21:12:09.121 INFO:tasks.workunit.client.0.smithi179.stderr:101550K .......... .......... .......... .......... .......... 60% 24.3M 2s 2024-08-24T21:12:09.124 INFO:tasks.workunit.client.0.smithi179.stderr:101600K .......... .......... .......... .......... .......... 60% 21.7M 2s 2024-08-24T21:12:09.125 INFO:tasks.workunit.client.0.smithi179.stderr:101650K .......... .......... .......... .......... .......... 60% 45.8M 2s 2024-08-24T21:12:09.127 INFO:tasks.workunit.client.0.smithi179.stderr:101700K .......... .......... .......... .......... .......... 60% 23.9M 2s 2024-08-24T21:12:09.128 INFO:tasks.workunit.client.0.smithi179.stderr:101750K .......... .......... .......... .......... .......... 60% 36.9M 2s 2024-08-24T21:12:09.130 INFO:tasks.workunit.client.0.smithi179.stderr:101800K .......... .......... .......... .......... .......... 60% 25.7M 2s 2024-08-24T21:12:09.131 INFO:tasks.workunit.client.0.smithi179.stderr:101850K .......... .......... .......... .......... .......... 60% 46.5M 2s 2024-08-24T21:12:09.133 INFO:tasks.workunit.client.0.smithi179.stderr:101900K .......... .......... .......... .......... .......... 60% 24.4M 2s 2024-08-24T21:12:09.135 INFO:tasks.workunit.client.0.smithi179.stderr:101950K .......... .......... .......... .......... .......... 60% 19.3M 2s 2024-08-24T21:12:09.137 INFO:tasks.workunit.client.0.smithi179.stderr:102000K .......... .......... .......... .......... .......... 60% 34.3M 2s 2024-08-24T21:12:09.139 INFO:tasks.workunit.client.0.smithi179.stderr:102050K .......... .......... .......... .......... .......... 60% 24.1M 2s 2024-08-24T21:12:09.141 INFO:tasks.workunit.client.0.smithi179.stderr:102100K .......... .......... .......... .......... .......... 60% 26.8M 2s 2024-08-24T21:12:09.142 INFO:tasks.workunit.client.0.smithi179.stderr:102150K .......... .......... .......... .......... .......... 60% 41.9M 2s 2024-08-24T21:12:09.144 INFO:tasks.workunit.client.0.smithi179.stderr:102200K .......... .......... .......... .......... .......... 60% 27.8M 2s 2024-08-24T21:12:09.146 INFO:tasks.workunit.client.0.smithi179.stderr:102250K .......... .......... .......... .......... .......... 60% 25.7M 2s 2024-08-24T21:12:09.147 INFO:tasks.workunit.client.0.smithi179.stderr:102300K .......... .......... .......... .......... .......... 60% 30.5M 2s 2024-08-24T21:12:09.150 INFO:tasks.workunit.client.0.smithi179.stderr:102350K .......... .......... .......... .......... .......... 60% 23.7M 2s 2024-08-24T21:12:09.151 INFO:tasks.workunit.client.0.smithi179.stderr:102400K .......... .......... .......... .......... .......... 60% 44.9M 2s 2024-08-24T21:12:09.153 INFO:tasks.workunit.client.0.smithi179.stderr:102450K .......... .......... .......... .......... .......... 60% 24.9M 2s 2024-08-24T21:12:09.154 INFO:tasks.workunit.client.0.smithi179.stderr:102500K .......... .......... .......... .......... .......... 60% 35.2M 2s 2024-08-24T21:12:09.156 INFO:tasks.workunit.client.0.smithi179.stderr:102550K .......... .......... .......... .......... .......... 60% 22.5M 2s 2024-08-24T21:12:09.158 INFO:tasks.workunit.client.0.smithi179.stderr:102600K .......... .......... .......... .......... .......... 60% 23.5M 2s 2024-08-24T21:12:09.160 INFO:tasks.workunit.client.0.smithi179.stderr:102650K .......... .......... .......... .......... .......... 60% 32.1M 2s 2024-08-24T21:12:09.161 INFO:tasks.workunit.client.0.smithi179.stderr:102700K .......... .......... .......... .......... .......... 60% 28.7M 2s 2024-08-24T21:12:09.163 INFO:tasks.workunit.client.0.smithi179.stderr:102750K .......... .......... .......... .......... .......... 60% 24.5M 2s 2024-08-24T21:12:09.164 INFO:tasks.workunit.client.0.smithi179.stderr:102800K .......... .......... .......... .......... .......... 61% 42.2M 2s 2024-08-24T21:12:09.167 INFO:tasks.workunit.client.0.smithi179.stderr:102850K .......... .......... .......... .......... .......... 61% 21.8M 2s 2024-08-24T21:12:09.168 INFO:tasks.workunit.client.0.smithi179.stderr:102900K .......... .......... .......... .......... .......... 61% 43.9M 2s 2024-08-24T21:12:09.170 INFO:tasks.workunit.client.0.smithi179.stderr:102950K .......... .......... .......... .......... .......... 61% 22.1M 2s 2024-08-24T21:12:09.171 INFO:tasks.workunit.client.0.smithi179.stderr:103000K .......... .......... .......... .......... .......... 61% 33.3M 2s 2024-08-24T21:12:09.173 INFO:tasks.workunit.client.0.smithi179.stderr:103050K .......... .......... .......... .......... .......... 61% 29.1M 2s 2024-08-24T21:12:09.175 INFO:tasks.workunit.client.0.smithi179.stderr:103100K .......... .......... .......... .......... .......... 61% 21.7M 2s 2024-08-24T21:12:09.177 INFO:tasks.workunit.client.0.smithi179.stderr:103150K .......... .......... .......... .......... .......... 61% 25.9M 2s 2024-08-24T21:12:09.178 INFO:tasks.workunit.client.0.smithi179.stderr:103200K .......... .......... .......... .......... .......... 61% 40.1M 2s 2024-08-24T21:12:09.180 INFO:tasks.workunit.client.0.smithi179.stderr:103250K .......... .......... .......... .......... .......... 61% 25.9M 2s 2024-08-24T21:12:09.181 INFO:tasks.workunit.client.0.smithi179.stderr:103300K .......... .......... .......... .......... .......... 61% 41.7M 2s 2024-08-24T21:12:09.183 INFO:tasks.workunit.client.0.smithi179.stderr:103350K .......... .......... .......... .......... .......... 61% 23.7M 2s 2024-08-24T21:12:09.185 INFO:tasks.workunit.client.0.smithi179.stderr:103400K .......... .......... .......... .......... .......... 61% 42.3M 2s 2024-08-24T21:12:09.187 INFO:tasks.workunit.client.0.smithi179.stderr:103450K .......... .......... .......... .......... .......... 61% 24.9M 2s 2024-08-24T21:12:09.188 INFO:tasks.workunit.client.0.smithi179.stderr:103500K .......... .......... .......... .......... .......... 61% 46.0M 2s 2024-08-24T21:12:09.190 INFO:tasks.workunit.client.0.smithi179.stderr:103550K .......... .......... .......... .......... .......... 61% 22.4M 2s 2024-08-24T21:12:09.192 INFO:tasks.workunit.client.0.smithi179.stderr:103600K .......... .......... .......... .......... .......... 61% 24.0M 2s 2024-08-24T21:12:09.194 INFO:tasks.workunit.client.0.smithi179.stderr:103650K .......... .......... .......... .......... .......... 61% 22.6M 2s 2024-08-24T21:12:09.195 INFO:tasks.workunit.client.0.smithi179.stderr:103700K .......... .......... .......... .......... .......... 61% 43.2M 2s 2024-08-24T21:12:09.197 INFO:tasks.workunit.client.0.smithi179.stderr:103750K .......... .......... .......... .......... .......... 61% 23.4M 2s 2024-08-24T21:12:09.198 INFO:tasks.workunit.client.0.smithi179.stderr:103800K .......... .......... .......... .......... .......... 61% 44.3M 2s 2024-08-24T21:12:09.201 INFO:tasks.workunit.client.0.smithi179.stderr:103850K .......... .......... .......... .......... .......... 61% 23.4M 2s 2024-08-24T21:12:09.201 INFO:tasks.workunit.client.0.smithi179.stderr:103900K .......... .......... .......... .......... .......... 61% 50.0M 2s 2024-08-24T21:12:09.203 INFO:tasks.workunit.client.0.smithi179.stderr:103950K .......... .......... .......... .......... .......... 61% 22.6M 2s 2024-08-24T21:12:09.206 INFO:tasks.workunit.client.0.smithi179.stderr:104000K .......... .......... .......... .......... .......... 61% 26.2M 2s 2024-08-24T21:12:09.208 INFO:tasks.workunit.client.0.smithi179.stderr:104050K .......... .......... .......... .......... .......... 61% 26.9M 2s 2024-08-24T21:12:09.210 INFO:tasks.workunit.client.0.smithi179.stderr:104100K .......... .......... .......... .......... .......... 61% 27.0M 2s 2024-08-24T21:12:09.210 INFO:tasks.workunit.client.0.smithi179.stderr:104150K .......... .......... .......... .......... .......... 61% 45.2M 2s 2024-08-24T21:12:09.217 INFO:tasks.workunit.client.0.smithi179.stderr:104200K .......... .......... .......... .......... .......... 61% 21.2M 2s 2024-08-24T21:12:09.217 INFO:tasks.workunit.client.0.smithi179.stderr:104250K .......... .......... .......... .......... .......... 61% 25.2M 2s 2024-08-24T21:12:09.217 INFO:tasks.workunit.client.0.smithi179.stderr:104300K .......... .......... .......... .......... .......... 61% 37.8M 2s 2024-08-24T21:12:09.218 INFO:tasks.workunit.client.0.smithi179.stderr:104350K .......... .......... .......... .......... .......... 61% 20.3M 2s 2024-08-24T21:12:09.220 INFO:tasks.workunit.client.0.smithi179.stderr:104400K .......... .......... .......... .......... .......... 61% 23.8M 2s 2024-08-24T21:12:09.221 INFO:tasks.workunit.client.0.smithi179.stderr:104450K .......... .......... .......... .......... .......... 61% 47.6M 2s 2024-08-24T21:12:09.223 INFO:tasks.workunit.client.0.smithi179.stderr:104500K .......... .......... .......... .......... .......... 62% 24.4M 2s 2024-08-24T21:12:09.224 INFO:tasks.workunit.client.0.smithi179.stderr:104550K .......... .......... .......... .......... .......... 62% 41.9M 2s 2024-08-24T21:12:09.226 INFO:tasks.workunit.client.0.smithi179.stderr:104600K .......... .......... .......... .......... .......... 62% 22.7M 2s 2024-08-24T21:12:09.228 INFO:tasks.workunit.client.0.smithi179.stderr:104650K .......... .......... .......... .......... .......... 62% 33.0M 2s 2024-08-24T21:12:09.230 INFO:tasks.workunit.client.0.smithi179.stderr:104700K .......... .......... .......... .......... .......... 62% 26.0M 2s 2024-08-24T21:12:09.232 INFO:tasks.workunit.client.0.smithi179.stderr:104750K .......... .......... .......... .......... .......... 62% 23.1M 2s 2024-08-24T21:12:09.233 INFO:tasks.workunit.client.0.smithi179.stderr:104800K .......... .......... .......... .......... .......... 62% 40.9M 2s 2024-08-24T21:12:09.235 INFO:tasks.workunit.client.0.smithi179.stderr:104850K .......... .......... .......... .......... .......... 62% 22.6M 2s 2024-08-24T21:12:09.237 INFO:tasks.workunit.client.0.smithi179.stderr:104900K .......... .......... .......... .......... .......... 62% 26.1M 2s 2024-08-24T21:12:09.238 INFO:tasks.workunit.client.0.smithi179.stderr:104950K .......... .......... .......... .......... .......... 62% 35.9M 2s 2024-08-24T21:12:09.240 INFO:tasks.workunit.client.0.smithi179.stderr:105000K .......... .......... .......... .......... .......... 62% 25.0M 2s 2024-08-24T21:12:09.242 INFO:tasks.workunit.client.0.smithi179.stderr:105050K .......... .......... .......... .......... .......... 62% 39.1M 2s 2024-08-24T21:12:09.244 INFO:tasks.workunit.client.0.smithi179.stderr:105100K .......... .......... .......... .......... .......... 62% 23.7M 2s 2024-08-24T21:12:09.246 INFO:tasks.workunit.client.0.smithi179.stderr:105150K .......... .......... .......... .......... .......... 62% 24.9M 2s 2024-08-24T21:12:09.247 INFO:tasks.workunit.client.0.smithi179.stderr:105200K .......... .......... .......... .......... .......... 62% 41.5M 2s 2024-08-24T21:12:09.249 INFO:tasks.workunit.client.0.smithi179.stderr:105250K .......... .......... .......... .......... .......... 62% 27.3M 2s 2024-08-24T21:12:09.250 INFO:tasks.workunit.client.0.smithi179.stderr:105300K .......... .......... .......... .......... .......... 62% 39.6M 2s 2024-08-24T21:12:09.252 INFO:tasks.workunit.client.0.smithi179.stderr:105350K .......... .......... .......... .......... .......... 62% 24.2M 2s 2024-08-24T21:12:09.254 INFO:tasks.workunit.client.0.smithi179.stderr:105400K .......... .......... .......... .......... .......... 62% 20.1M 2s 2024-08-24T21:12:09.256 INFO:tasks.workunit.client.0.smithi179.stderr:105450K .......... .......... .......... .......... .......... 62% 46.4M 2s 2024-08-24T21:12:09.258 INFO:tasks.workunit.client.0.smithi179.stderr:105500K .......... .......... .......... .......... .......... 62% 20.3M 2s 2024-08-24T21:12:09.259 INFO:tasks.workunit.client.0.smithi179.stderr:105550K .......... .......... .......... .......... .......... 62% 31.5M 2s 2024-08-24T21:12:09.261 INFO:tasks.workunit.client.0.smithi179.stderr:105600K .......... .......... .......... .......... .......... 62% 26.9M 2s 2024-08-24T21:12:09.264 INFO:tasks.workunit.client.0.smithi179.stderr:105650K .......... .......... .......... .......... .......... 62% 19.4M 2s 2024-08-24T21:12:09.265 INFO:tasks.workunit.client.0.smithi179.stderr:105700K .......... .......... .......... .......... .......... 62% 52.2M 2s 2024-08-24T21:12:09.267 INFO:tasks.workunit.client.0.smithi179.stderr:105750K .......... .......... .......... .......... .......... 62% 23.3M 2s 2024-08-24T21:12:09.269 INFO:tasks.workunit.client.0.smithi179.stderr:105800K .......... .......... .......... .......... .......... 62% 34.0M 2s 2024-08-24T21:12:09.270 INFO:tasks.workunit.client.0.smithi179.stderr:105850K .......... .......... .......... .......... .......... 62% 24.4M 2s 2024-08-24T21:12:09.271 INFO:tasks.workunit.client.0.smithi179.stderr:105900K .......... .......... .......... .......... .......... 62% 43.3M 2s 2024-08-24T21:12:09.275 INFO:tasks.workunit.client.0.smithi179.stderr:105950K .......... .......... .......... .......... .......... 62% 15.0M 2s 2024-08-24T21:12:09.275 INFO:tasks.workunit.client.0.smithi179.stderr:106000K .......... .......... .......... .......... .......... 62% 52.8M 2s 2024-08-24T21:12:09.278 INFO:tasks.workunit.client.0.smithi179.stderr:106050K .......... .......... .......... .......... .......... 62% 21.0M 2s 2024-08-24T21:12:09.279 INFO:tasks.workunit.client.0.smithi179.stderr:106100K .......... .......... .......... .......... .......... 62% 36.1M 2s 2024-08-24T21:12:09.281 INFO:tasks.workunit.client.0.smithi179.stderr:106150K .......... .......... .......... .......... .......... 63% 23.4M 2s 2024-08-24T21:12:09.282 INFO:tasks.workunit.client.0.smithi179.stderr:106200K .......... .......... .......... .......... .......... 63% 50.9M 2s 2024-08-24T21:12:09.284 INFO:tasks.workunit.client.0.smithi179.stderr:106250K .......... .......... .......... .......... .......... 63% 23.7M 2s 2024-08-24T21:12:09.286 INFO:tasks.workunit.client.0.smithi179.stderr:106300K .......... .......... .......... .......... .......... 63% 36.5M 2s 2024-08-24T21:12:09.288 INFO:tasks.workunit.client.0.smithi179.stderr:106350K .......... .......... .......... .......... .......... 63% 22.3M 2s 2024-08-24T21:12:09.290 INFO:tasks.workunit.client.0.smithi179.stderr:106400K .......... .......... .......... .......... .......... 63% 26.2M 2s 2024-08-24T21:12:09.291 INFO:tasks.workunit.client.0.smithi179.stderr:106450K .......... .......... .......... .......... .......... 63% 32.6M 2s 2024-08-24T21:12:09.293 INFO:tasks.workunit.client.0.smithi179.stderr:106500K .......... .......... .......... .......... .......... 63% 24.6M 2s 2024-08-24T21:12:09.295 INFO:tasks.workunit.client.0.smithi179.stderr:106550K .......... .......... .......... .......... .......... 63% 35.5M 2s 2024-08-24T21:12:09.297 INFO:tasks.workunit.client.0.smithi179.stderr:106600K .......... .......... .......... .......... .......... 63% 19.7M 2s 2024-08-24T21:12:09.299 INFO:tasks.workunit.client.0.smithi179.stderr:106650K .......... .......... .......... .......... .......... 63% 23.7M 2s 2024-08-24T21:12:09.300 INFO:tasks.workunit.client.0.smithi179.stderr:106700K .......... .......... .......... .......... .......... 63% 42.8M 2s 2024-08-24T21:12:09.302 INFO:tasks.workunit.client.0.smithi179.stderr:106750K .......... .......... .......... .......... .......... 63% 24.0M 2s 2024-08-24T21:12:09.304 INFO:tasks.workunit.client.0.smithi179.stderr:106800K .......... .......... .......... .......... .......... 63% 24.0M 2s 2024-08-24T21:12:09.306 INFO:tasks.workunit.client.0.smithi179.stderr:106850K .......... .......... .......... .......... .......... 63% 34.8M 2s 2024-08-24T21:12:09.308 INFO:tasks.workunit.client.0.smithi179.stderr:106900K .......... .......... .......... .......... .......... 63% 21.9M 2s 2024-08-24T21:12:09.309 INFO:tasks.workunit.client.0.smithi179.stderr:106950K .......... .......... .......... .......... .......... 63% 39.9M 2s 2024-08-24T21:12:09.311 INFO:tasks.workunit.client.0.smithi179.stderr:107000K .......... .......... .......... .......... .......... 63% 24.4M 2s 2024-08-24T21:12:09.312 INFO:tasks.workunit.client.0.smithi179.stderr:107050K .......... .......... .......... .......... .......... 63% 39.2M 2s 2024-08-24T21:12:09.315 INFO:tasks.workunit.client.0.smithi179.stderr:107100K .......... .......... .......... .......... .......... 63% 20.7M 2s 2024-08-24T21:12:09.318 INFO:tasks.workunit.client.0.smithi179.stderr:107150K .......... .......... .......... .......... .......... 63% 20.7M 2s 2024-08-24T21:12:09.319 INFO:tasks.workunit.client.0.smithi179.stderr:107200K .......... .......... .......... .......... .......... 63% 28.3M 2s 2024-08-24T21:12:09.320 INFO:tasks.workunit.client.0.smithi179.stderr:107250K .......... .......... .......... .......... .......... 63% 37.9M 2s 2024-08-24T21:12:09.322 INFO:tasks.workunit.client.0.smithi179.stderr:107300K .......... .......... .......... .......... .......... 63% 25.3M 2s 2024-08-24T21:12:09.323 INFO:tasks.workunit.client.0.smithi179.stderr:107350K .......... .......... .......... .......... .......... 63% 37.7M 2s 2024-08-24T21:12:09.334 INFO:tasks.workunit.client.0.smithi179.stderr:107400K .......... .......... .......... .......... .......... 63% 8.24M 2s 2024-08-24T21:12:09.334 INFO:tasks.workunit.client.0.smithi179.stderr:107450K .......... .......... .......... .......... .......... 63% 174M 2s 2024-08-24T21:12:09.334 INFO:tasks.workunit.client.0.smithi179.stderr:107500K .......... .......... .......... .......... .......... 63% 189M 2s 2024-08-24T21:12:09.334 INFO:tasks.workunit.client.0.smithi179.stderr:107550K .......... .......... .......... .......... .......... 63% 49.5M 2s 2024-08-24T21:12:09.334 INFO:tasks.workunit.client.0.smithi179.stderr:107600K .......... .......... .......... .......... .......... 63% 42.3M 2s 2024-08-24T21:12:09.334 INFO:tasks.workunit.client.0.smithi179.stderr:107650K .......... .......... .......... .......... .......... 63% 29.6M 2s 2024-08-24T21:12:09.336 INFO:tasks.workunit.client.0.smithi179.stderr:107700K .......... .......... .......... .......... .......... 63% 19.5M 2s 2024-08-24T21:12:09.338 INFO:tasks.workunit.client.0.smithi179.stderr:107750K .......... .......... .......... .......... .......... 63% 27.1M 2s 2024-08-24T21:12:09.340 INFO:tasks.workunit.client.0.smithi179.stderr:107800K .......... .......... .......... .......... .......... 63% 23.0M 2s 2024-08-24T21:12:09.341 INFO:tasks.workunit.client.0.smithi179.stderr:107850K .......... .......... .......... .......... .......... 64% 42.9M 2s 2024-08-24T21:12:09.343 INFO:tasks.workunit.client.0.smithi179.stderr:107900K .......... .......... .......... .......... .......... 64% 23.7M 2s 2024-08-24T21:12:09.345 INFO:tasks.workunit.client.0.smithi179.stderr:107950K .......... .......... .......... .......... .......... 64% 24.3M 2s 2024-08-24T21:12:09.346 INFO:tasks.workunit.client.0.smithi179.stderr:108000K .......... .......... .......... .......... .......... 64% 40.0M 2s 2024-08-24T21:12:09.348 INFO:tasks.workunit.client.0.smithi179.stderr:108050K .......... .......... .......... .......... .......... 64% 26.5M 2s 2024-08-24T21:12:09.350 INFO:tasks.workunit.client.0.smithi179.stderr:108100K .......... .......... .......... .......... .......... 64% 32.4M 2s 2024-08-24T21:12:09.352 INFO:tasks.workunit.client.0.smithi179.stderr:108150K .......... .......... .......... .......... .......... 64% 23.5M 2s 2024-08-24T21:12:09.354 INFO:tasks.workunit.client.0.smithi179.stderr:108200K .......... .......... .......... .......... .......... 64% 23.4M 2s 2024-08-24T21:12:09.355 INFO:tasks.workunit.client.0.smithi179.stderr:108250K .......... .......... .......... .......... .......... 64% 44.8M 2s 2024-08-24T21:12:09.356 INFO:tasks.workunit.client.0.smithi179.stderr:108300K .......... .......... .......... .......... .......... 64% 34.8M 2s 2024-08-24T21:12:09.359 INFO:tasks.workunit.client.0.smithi179.stderr:108350K .......... .......... .......... .......... .......... 64% 17.4M 2s 2024-08-24T21:12:09.361 INFO:tasks.workunit.client.0.smithi179.stderr:108400K .......... .......... .......... .......... .......... 64% 38.8M 2s 2024-08-24T21:12:09.363 INFO:tasks.workunit.client.0.smithi179.stderr:108450K .......... .......... .......... .......... .......... 64% 23.7M 2s 2024-08-24T21:12:09.364 INFO:tasks.workunit.client.0.smithi179.stderr:108500K .......... .......... .......... .......... .......... 64% 43.2M 2s 2024-08-24T21:12:09.366 INFO:tasks.workunit.client.0.smithi179.stderr:108550K .......... .......... .......... .......... .......... 64% 20.6M 2s 2024-08-24T21:12:09.367 INFO:tasks.workunit.client.0.smithi179.stderr:108600K .......... .......... .......... .......... .......... 64% 41.5M 2s 2024-08-24T21:12:09.370 INFO:tasks.workunit.client.0.smithi179.stderr:108650K .......... .......... .......... .......... .......... 64% 21.4M 2s 2024-08-24T21:12:09.371 INFO:tasks.workunit.client.0.smithi179.stderr:108700K .......... .......... .......... .......... .......... 64% 37.6M 2s 2024-08-24T21:12:09.375 INFO:tasks.workunit.client.0.smithi179.stderr:108750K .......... .......... .......... .......... .......... 64% 16.3M 2s 2024-08-24T21:12:09.375 INFO:tasks.workunit.client.0.smithi179.stderr:108800K .......... .......... .......... .......... .......... 64% 46.1M 2s 2024-08-24T21:12:09.378 INFO:tasks.workunit.client.0.smithi179.stderr:108850K .......... .......... .......... .......... .......... 64% 18.9M 2s 2024-08-24T21:12:09.379 INFO:tasks.workunit.client.0.smithi179.stderr:108900K .......... .......... .......... .......... .......... 64% 43.2M 2s 2024-08-24T21:12:09.381 INFO:tasks.workunit.client.0.smithi179.stderr:108950K .......... .......... .......... .......... .......... 64% 21.0M 2s 2024-08-24T21:12:09.382 INFO:tasks.workunit.client.0.smithi179.stderr:109000K .......... .......... .......... .......... .......... 64% 30.4M 2s 2024-08-24T21:12:09.384 INFO:tasks.workunit.client.0.smithi179.stderr:109050K .......... .......... .......... .......... .......... 64% 25.6M 2s 2024-08-24T21:12:09.385 INFO:tasks.workunit.client.0.smithi179.stderr:109100K .......... .......... .......... .......... .......... 64% 44.0M 2s 2024-08-24T21:12:09.388 INFO:tasks.workunit.client.0.smithi179.stderr:109150K .......... .......... .......... .......... .......... 64% 21.1M 2s 2024-08-24T21:12:09.390 INFO:tasks.workunit.client.0.smithi179.stderr:109200K .......... .......... .......... .......... .......... 64% 22.0M 2s 2024-08-24T21:12:09.391 INFO:tasks.workunit.client.0.smithi179.stderr:109250K .......... .......... .......... .......... .......... 64% 42.9M 2s 2024-08-24T21:12:09.393 INFO:tasks.workunit.client.0.smithi179.stderr:109300K .......... .......... .......... .......... .......... 64% 24.6M 2s 2024-08-24T21:12:09.395 INFO:tasks.workunit.client.0.smithi179.stderr:109350K .......... .......... .......... .......... .......... 64% 35.2M 2s 2024-08-24T21:12:09.397 INFO:tasks.workunit.client.0.smithi179.stderr:109400K .......... .......... .......... .......... .......... 64% 23.2M 2s 2024-08-24T21:12:09.400 INFO:tasks.workunit.client.0.smithi179.stderr:109450K .......... .......... .......... .......... .......... 64% 21.6M 2s 2024-08-24T21:12:09.400 INFO:tasks.workunit.client.0.smithi179.stderr:109500K .......... .......... .......... .......... .......... 64% 68.1M 2s 2024-08-24T21:12:09.402 INFO:tasks.workunit.client.0.smithi179.stderr:109550K .......... .......... .......... .......... .......... 65% 21.9M 2s 2024-08-24T21:12:09.404 INFO:tasks.workunit.client.0.smithi179.stderr:109600K .......... .......... .......... .......... .......... 65% 26.9M 2s 2024-08-24T21:12:09.405 INFO:tasks.workunit.client.0.smithi179.stderr:109650K .......... .......... .......... .......... .......... 65% 39.5M 2s 2024-08-24T21:12:09.408 INFO:tasks.workunit.client.0.smithi179.stderr:109700K .......... .......... .......... .......... .......... 65% 23.6M 2s 2024-08-24T21:12:09.408 INFO:tasks.workunit.client.0.smithi179.stderr:109750K .......... .......... .......... .......... .......... 65% 57.0M 2s 2024-08-24T21:12:09.410 INFO:tasks.workunit.client.0.smithi179.stderr:109800K .......... .......... .......... .......... .......... 65% 20.1M 2s 2024-08-24T21:12:09.412 INFO:tasks.workunit.client.0.smithi179.stderr:109850K .......... .......... .......... .......... .......... 65% 30.9M 2s 2024-08-24T21:12:09.413 INFO:tasks.workunit.client.0.smithi179.stderr:109900K .......... .......... .......... .......... .......... 65% 29.7M 2s 2024-08-24T21:12:09.416 INFO:tasks.workunit.client.0.smithi179.stderr:109950K .......... .......... .......... .......... .......... 65% 22.9M 2s 2024-08-24T21:12:09.418 INFO:tasks.workunit.client.0.smithi179.stderr:110000K .......... .......... .......... .......... .......... 65% 24.6M 2s 2024-08-24T21:12:09.419 INFO:tasks.workunit.client.0.smithi179.stderr:110050K .......... .......... .......... .......... .......... 65% 39.5M 2s 2024-08-24T21:12:09.421 INFO:tasks.workunit.client.0.smithi179.stderr:110100K .......... .......... .......... .......... .......... 65% 23.5M 2s 2024-08-24T21:12:09.422 INFO:tasks.workunit.client.0.smithi179.stderr:110150K .......... .......... .......... .......... .......... 65% 41.4M 2s 2024-08-24T21:12:09.424 INFO:tasks.workunit.client.0.smithi179.stderr:110200K .......... .......... .......... .......... .......... 65% 23.5M 2s 2024-08-24T21:12:09.425 INFO:tasks.workunit.client.0.smithi179.stderr:110250K .......... .......... .......... .......... .......... 65% 43.0M 2s 2024-08-24T21:12:09.427 INFO:tasks.workunit.client.0.smithi179.stderr:110300K .......... .......... .......... .......... .......... 65% 25.1M 2s 2024-08-24T21:12:09.430 INFO:tasks.workunit.client.0.smithi179.stderr:110350K .......... .......... .......... .......... .......... 65% 23.5M 2s 2024-08-24T21:12:09.431 INFO:tasks.workunit.client.0.smithi179.stderr:110400K .......... .......... .......... .......... .......... 65% 37.0M 2s 2024-08-24T21:12:09.433 INFO:tasks.workunit.client.0.smithi179.stderr:110450K .......... .......... .......... .......... .......... 65% 23.6M 2s 2024-08-24T21:12:09.436 INFO:tasks.workunit.client.0.smithi179.stderr:110500K .......... .......... .......... .......... .......... 65% 23.2M 2s 2024-08-24T21:12:09.436 INFO:tasks.workunit.client.0.smithi179.stderr:110550K .......... .......... .......... .......... .......... 65% 41.2M 2s 2024-08-24T21:12:09.438 INFO:tasks.workunit.client.0.smithi179.stderr:110600K .......... .......... .......... .......... .......... 65% 23.1M 2s 2024-08-24T21:12:09.439 INFO:tasks.workunit.client.0.smithi179.stderr:110650K .......... .......... .......... .......... .......... 65% 40.8M 2s 2024-08-24T21:12:09.442 INFO:tasks.workunit.client.0.smithi179.stderr:110700K .......... .......... .......... .......... .......... 65% 21.7M 2s 2024-08-24T21:12:09.444 INFO:tasks.workunit.client.0.smithi179.stderr:110750K .......... .......... .......... .......... .......... 65% 19.9M 2s 2024-08-24T21:12:09.445 INFO:tasks.workunit.client.0.smithi179.stderr:110800K .......... .......... .......... .......... .......... 65% 36.1M 2s 2024-08-24T21:12:09.448 INFO:tasks.workunit.client.0.smithi179.stderr:110850K .......... .......... .......... .......... .......... 65% 18.5M 2s 2024-08-24T21:12:09.449 INFO:tasks.workunit.client.0.smithi179.stderr:110900K .......... .......... .......... .......... .......... 65% 45.7M 2s 2024-08-24T21:12:09.451 INFO:tasks.workunit.client.0.smithi179.stderr:110950K .......... .......... .......... .......... .......... 65% 22.9M 2s 2024-08-24T21:12:09.452 INFO:tasks.workunit.client.0.smithi179.stderr:111000K .......... .......... .......... .......... .......... 65% 37.7M 2s 2024-08-24T21:12:09.456 INFO:tasks.workunit.client.0.smithi179.stderr:111050K .......... .......... .......... .......... .......... 65% 18.3M 2s 2024-08-24T21:12:09.457 INFO:tasks.workunit.client.0.smithi179.stderr:111100K .......... .......... .......... .......... .......... 65% 31.7M 2s 2024-08-24T21:12:09.459 INFO:tasks.workunit.client.0.smithi179.stderr:111150K .......... .......... .......... .......... .......... 65% 21.0M 2s 2024-08-24T21:12:09.461 INFO:tasks.workunit.client.0.smithi179.stderr:111200K .......... .......... .......... .......... .......... 65% 28.9M 2s 2024-08-24T21:12:09.463 INFO:tasks.workunit.client.0.smithi179.stderr:111250K .......... .......... .......... .......... .......... 66% 28.0M 2s 2024-08-24T21:12:09.464 INFO:tasks.workunit.client.0.smithi179.stderr:111300K .......... .......... .......... .......... .......... 66% 31.5M 2s 2024-08-24T21:12:09.467 INFO:tasks.workunit.client.0.smithi179.stderr:111350K .......... .......... .......... .......... .......... 66% 22.2M 2s 2024-08-24T21:12:09.470 INFO:tasks.workunit.client.0.smithi179.stderr:111400K .......... .......... .......... .......... .......... 66% 24.8M 2s 2024-08-24T21:12:09.470 INFO:tasks.workunit.client.0.smithi179.stderr:111450K .......... .......... .......... .......... .......... 66% 34.6M 2s 2024-08-24T21:12:09.471 INFO:tasks.workunit.client.0.smithi179.stderr:111500K .......... .......... .......... .......... .......... 66% 34.9M 2s 2024-08-24T21:12:09.473 INFO:tasks.workunit.client.0.smithi179.stderr:111550K .......... .......... .......... .......... .......... 66% 22.6M 2s 2024-08-24T21:12:09.476 INFO:tasks.workunit.client.0.smithi179.stderr:111600K .......... .......... .......... .......... .......... 66% 22.4M 2s 2024-08-24T21:12:09.477 INFO:tasks.workunit.client.0.smithi179.stderr:111650K .......... .......... .......... .......... .......... 66% 32.2M 2s 2024-08-24T21:12:09.479 INFO:tasks.workunit.client.0.smithi179.stderr:111700K .......... .......... .......... .......... .......... 66% 29.7M 2s 2024-08-24T21:12:09.482 INFO:tasks.workunit.client.0.smithi179.stderr:111750K .......... .......... .......... .......... .......... 66% 22.3M 2s 2024-08-24T21:12:09.482 INFO:tasks.workunit.client.0.smithi179.stderr:111800K .......... .......... .......... .......... .......... 66% 51.8M 2s 2024-08-24T21:12:09.483 INFO:tasks.workunit.client.0.smithi179.stderr:111850K .......... .......... .......... .......... .......... 66% 34.7M 2s 2024-08-24T21:12:09.485 INFO:tasks.workunit.client.0.smithi179.stderr:111900K .......... .......... .......... .......... .......... 66% 25.5M 2s 2024-08-24T21:12:09.487 INFO:tasks.workunit.client.0.smithi179.stderr:111950K .......... .......... .......... .......... .......... 66% 22.7M 2s 2024-08-24T21:12:09.489 INFO:tasks.workunit.client.0.smithi179.stderr:112000K .......... .......... .......... .......... .......... 66% 27.1M 2s 2024-08-24T21:12:09.490 INFO:tasks.workunit.client.0.smithi179.stderr:112050K .......... .......... .......... .......... .......... 66% 33.6M 2s 2024-08-24T21:12:09.492 INFO:tasks.workunit.client.0.smithi179.stderr:112100K .......... .......... .......... .......... .......... 66% 28.2M 2s 2024-08-24T21:12:09.495 INFO:tasks.workunit.client.0.smithi179.stderr:112150K .......... .......... .......... .......... .......... 66% 22.2M 2s 2024-08-24T21:12:09.495 INFO:tasks.workunit.client.0.smithi179.stderr:112200K .......... .......... .......... .......... .......... 66% 90.1M 2s 2024-08-24T21:12:09.498 INFO:tasks.workunit.client.0.smithi179.stderr:112250K .......... .......... .......... .......... .......... 66% 17.6M 2s 2024-08-24T21:12:09.499 INFO:tasks.workunit.client.0.smithi179.stderr:112300K .......... .......... .......... .......... .......... 66% 43.0M 2s 2024-08-24T21:12:09.501 INFO:tasks.workunit.client.0.smithi179.stderr:112350K .......... .......... .......... .......... .......... 66% 26.5M 2s 2024-08-24T21:12:09.504 INFO:tasks.workunit.client.0.smithi179.stderr:112400K .......... .......... .......... .......... .......... 66% 22.8M 2s 2024-08-24T21:12:09.504 INFO:tasks.workunit.client.0.smithi179.stderr:112450K .......... .......... .......... .......... .......... 66% 47.2M 2s 2024-08-24T21:12:09.505 INFO:tasks.workunit.client.0.smithi179.stderr:112500K .......... .......... .......... .......... .......... 66% 35.1M 2s 2024-08-24T21:12:09.507 INFO:tasks.workunit.client.0.smithi179.stderr:112550K .......... .......... .......... .......... .......... 66% 30.9M 2s 2024-08-24T21:12:09.509 INFO:tasks.workunit.client.0.smithi179.stderr:112600K .......... .......... .......... .......... .......... 66% 24.7M 2s 2024-08-24T21:12:09.510 INFO:tasks.workunit.client.0.smithi179.stderr:112650K .......... .......... .......... .......... .......... 66% 30.7M 2s 2024-08-24T21:12:09.512 INFO:tasks.workunit.client.0.smithi179.stderr:112700K .......... .......... .......... .......... .......... 66% 35.4M 2s 2024-08-24T21:12:09.515 INFO:tasks.workunit.client.0.smithi179.stderr:112750K .......... .......... .......... .......... .......... 66% 17.2M 2s 2024-08-24T21:12:09.517 INFO:tasks.workunit.client.0.smithi179.stderr:112800K .......... .......... .......... .......... .......... 66% 24.0M 2s 2024-08-24T21:12:09.518 INFO:tasks.workunit.client.0.smithi179.stderr:112850K .......... .......... .......... .......... .......... 66% 32.8M 2s 2024-08-24T21:12:09.520 INFO:tasks.workunit.client.0.smithi179.stderr:112900K .......... .......... .......... .......... .......... 67% 28.6M 2s 2024-08-24T21:12:09.521 INFO:tasks.workunit.client.0.smithi179.stderr:112950K .......... .......... .......... .......... .......... 67% 42.8M 2s 2024-08-24T21:12:09.523 INFO:tasks.workunit.client.0.smithi179.stderr:113000K .......... .......... .......... .......... .......... 67% 22.6M 2s 2024-08-24T21:12:09.524 INFO:tasks.workunit.client.0.smithi179.stderr:113050K .......... .......... .......... .......... .......... 67% 39.5M 2s 2024-08-24T21:12:09.526 INFO:tasks.workunit.client.0.smithi179.stderr:113100K .......... .......... .......... .......... .......... 67% 27.2M 2s 2024-08-24T21:12:09.528 INFO:tasks.workunit.client.0.smithi179.stderr:113150K .......... .......... .......... .......... .......... 67% 24.3M 2s 2024-08-24T21:12:09.529 INFO:tasks.workunit.client.0.smithi179.stderr:113200K .......... .......... .......... .......... .......... 67% 39.0M 2s 2024-08-24T21:12:09.532 INFO:tasks.workunit.client.0.smithi179.stderr:113250K .......... .......... .......... .......... .......... 67% 24.0M 2s 2024-08-24T21:12:09.533 INFO:tasks.workunit.client.0.smithi179.stderr:113300K .......... .......... .......... .......... .......... 67% 26.2M 2s 2024-08-24T21:12:09.534 INFO:tasks.workunit.client.0.smithi179.stderr:113350K .......... .......... .......... .......... .......... 67% 36.7M 2s 2024-08-24T21:12:09.537 INFO:tasks.workunit.client.0.smithi179.stderr:113400K .......... .......... .......... .......... .......... 67% 22.8M 2s 2024-08-24T21:12:09.539 INFO:tasks.workunit.client.0.smithi179.stderr:113450K .......... .......... .......... .......... .......... 67% 30.6M 2s 2024-08-24T21:12:09.540 INFO:tasks.workunit.client.0.smithi179.stderr:113500K .......... .......... .......... .......... .......... 67% 28.9M 2s 2024-08-24T21:12:09.542 INFO:tasks.workunit.client.0.smithi179.stderr:113550K .......... .......... .......... .......... .......... 67% 23.3M 2s 2024-08-24T21:12:09.543 INFO:tasks.workunit.client.0.smithi179.stderr:113600K .......... .......... .......... .......... .......... 67% 46.7M 2s 2024-08-24T21:12:09.546 INFO:tasks.workunit.client.0.smithi179.stderr:113650K .......... .......... .......... .......... .......... 67% 20.9M 2s 2024-08-24T21:12:09.547 INFO:tasks.workunit.client.0.smithi179.stderr:113700K .......... .......... .......... .......... .......... 67% 35.2M 2s 2024-08-24T21:12:09.549 INFO:tasks.workunit.client.0.smithi179.stderr:113750K .......... .......... .......... .......... .......... 67% 23.2M 2s 2024-08-24T21:12:09.550 INFO:tasks.workunit.client.0.smithi179.stderr:113800K .......... .......... .......... .......... .......... 67% 56.0M 2s 2024-08-24T21:12:09.552 INFO:tasks.workunit.client.0.smithi179.stderr:113850K .......... .......... .......... .......... .......... 67% 24.4M 2s 2024-08-24T21:12:09.554 INFO:tasks.workunit.client.0.smithi179.stderr:113900K .......... .......... .......... .......... .......... 67% 24.1M 2s 2024-08-24T21:12:09.557 INFO:tasks.workunit.client.0.smithi179.stderr:113950K .......... .......... .......... .......... .......... 67% 21.6M 2s 2024-08-24T21:12:09.558 INFO:tasks.workunit.client.0.smithi179.stderr:114000K .......... .......... .......... .......... .......... 67% 42.3M 2s 2024-08-24T21:12:09.559 INFO:tasks.workunit.client.0.smithi179.stderr:114050K .......... .......... .......... .......... .......... 67% 34.0M 2s 2024-08-24T21:12:09.560 INFO:tasks.workunit.client.0.smithi179.stderr:114100K .......... .......... .......... .......... .......... 67% 34.5M 2s 2024-08-24T21:12:09.563 INFO:tasks.workunit.client.0.smithi179.stderr:114150K .......... .......... .......... .......... .......... 67% 19.8M 2s 2024-08-24T21:12:09.564 INFO:tasks.workunit.client.0.smithi179.stderr:114200K .......... .......... .......... .......... .......... 67% 43.7M 2s 2024-08-24T21:12:09.566 INFO:tasks.workunit.client.0.smithi179.stderr:114250K .......... .......... .......... .......... .......... 67% 21.9M 2s 2024-08-24T21:12:09.567 INFO:tasks.workunit.client.0.smithi179.stderr:114300K .......... .......... .......... .......... .......... 67% 42.9M 2s 2024-08-24T21:12:09.569 INFO:tasks.workunit.client.0.smithi179.stderr:114350K .......... .......... .......... .......... .......... 67% 24.6M 2s 2024-08-24T21:12:09.571 INFO:tasks.workunit.client.0.smithi179.stderr:114400K .......... .......... .......... .......... .......... 67% 23.6M 2s 2024-08-24T21:12:09.573 INFO:tasks.workunit.client.0.smithi179.stderr:114450K .......... .......... .......... .......... .......... 67% 38.2M 2s 2024-08-24T21:12:09.575 INFO:tasks.workunit.client.0.smithi179.stderr:114500K .......... .......... .......... .......... .......... 67% 22.3M 2s 2024-08-24T21:12:09.577 INFO:tasks.workunit.client.0.smithi179.stderr:114550K .......... .......... .......... .......... .......... 67% 24.4M 2s 2024-08-24T21:12:09.578 INFO:tasks.workunit.client.0.smithi179.stderr:114600K .......... .......... .......... .......... .......... 68% 37.6M 2s 2024-08-24T21:12:09.580 INFO:tasks.workunit.client.0.smithi179.stderr:114650K .......... .......... .......... .......... .......... 68% 23.6M 2s 2024-08-24T21:12:09.581 INFO:tasks.workunit.client.0.smithi179.stderr:114700K .......... .......... .......... .......... .......... 68% 37.0M 2s 2024-08-24T21:12:09.583 INFO:tasks.workunit.client.0.smithi179.stderr:114750K .......... .......... .......... .......... .......... 68% 26.1M 2s 2024-08-24T21:12:09.585 INFO:tasks.workunit.client.0.smithi179.stderr:114800K .......... .......... .......... .......... .......... 68% 24.0M 2s 2024-08-24T21:12:09.586 INFO:tasks.workunit.client.0.smithi179.stderr:114850K .......... .......... .......... .......... .......... 68% 46.2M 2s 2024-08-24T21:12:09.589 INFO:tasks.workunit.client.0.smithi179.stderr:114900K .......... .......... .......... .......... .......... 68% 22.2M 2s 2024-08-24T21:12:09.590 INFO:tasks.workunit.client.0.smithi179.stderr:114950K .......... .......... .......... .......... .......... 68% 39.6M 2s 2024-08-24T21:12:09.592 INFO:tasks.workunit.client.0.smithi179.stderr:115000K .......... .......... .......... .......... .......... 68% 23.5M 2s 2024-08-24T21:12:09.595 INFO:tasks.workunit.client.0.smithi179.stderr:115050K .......... .......... .......... .......... .......... 68% 21.2M 2s 2024-08-24T21:12:09.595 INFO:tasks.workunit.client.0.smithi179.stderr:115100K .......... .......... .......... .......... .......... 68% 75.8M 2s 2024-08-24T21:12:09.597 INFO:tasks.workunit.client.0.smithi179.stderr:115150K .......... .......... .......... .......... .......... 68% 22.3M 2s 2024-08-24T21:12:09.599 INFO:tasks.workunit.client.0.smithi179.stderr:115200K .......... .......... .......... .......... .......... 68% 25.2M 2s 2024-08-24T21:12:09.600 INFO:tasks.workunit.client.0.smithi179.stderr:115250K .......... .......... .......... .......... .......... 68% 39.9M 2s 2024-08-24T21:12:09.602 INFO:tasks.workunit.client.0.smithi179.stderr:115300K .......... .......... .......... .......... .......... 68% 24.3M 2s 2024-08-24T21:12:09.603 INFO:tasks.workunit.client.0.smithi179.stderr:115350K .......... .......... .......... .......... .......... 68% 40.0M 2s 2024-08-24T21:12:09.606 INFO:tasks.workunit.client.0.smithi179.stderr:115400K .......... .......... .......... .......... .......... 68% 21.4M 2s 2024-08-24T21:12:09.607 INFO:tasks.workunit.client.0.smithi179.stderr:115450K .......... .......... .......... .......... .......... 68% 42.1M 2s 2024-08-24T21:12:09.608 INFO:tasks.workunit.client.0.smithi179.stderr:115500K .......... .......... .......... .......... .......... 68% 25.9M 2s 2024-08-24T21:12:09.611 INFO:tasks.workunit.client.0.smithi179.stderr:115550K .......... .......... .......... .......... .......... 68% 20.8M 2s 2024-08-24T21:12:09.614 INFO:tasks.workunit.client.0.smithi179.stderr:115600K .......... .......... .......... .......... .......... 68% 25.5M 2s 2024-08-24T21:12:09.614 INFO:tasks.workunit.client.0.smithi179.stderr:115650K .......... .......... .......... .......... .......... 68% 46.9M 2s 2024-08-24T21:12:09.617 INFO:tasks.workunit.client.0.smithi179.stderr:115700K .......... .......... .......... .......... .......... 68% 19.4M 2s 2024-08-24T21:12:09.618 INFO:tasks.workunit.client.0.smithi179.stderr:115750K .......... .......... .......... .......... .......... 68% 36.0M 2s 2024-08-24T21:12:09.620 INFO:tasks.workunit.client.0.smithi179.stderr:115800K .......... .......... .......... .......... .......... 68% 19.7M 2s 2024-08-24T21:12:09.621 INFO:tasks.workunit.client.0.smithi179.stderr:115850K .......... .......... .......... .......... .......... 68% 54.5M 2s 2024-08-24T21:12:09.623 INFO:tasks.workunit.client.0.smithi179.stderr:115900K .......... .......... .......... .......... .......... 68% 23.5M 2s 2024-08-24T21:12:09.627 INFO:tasks.workunit.client.0.smithi179.stderr:115950K .......... .......... .......... .......... .......... 68% 14.2M 2s 2024-08-24T21:12:09.628 INFO:tasks.workunit.client.0.smithi179.stderr:116000K .......... .......... .......... .......... .......... 68% 41.0M 2s 2024-08-24T21:12:09.631 INFO:tasks.workunit.client.0.smithi179.stderr:116050K .......... .......... .......... .......... .......... 68% 18.8M 2s 2024-08-24T21:12:09.632 INFO:tasks.workunit.client.0.smithi179.stderr:116100K .......... .......... .......... .......... .......... 68% 52.8M 2s 2024-08-24T21:12:09.633 INFO:tasks.workunit.client.0.smithi179.stderr:116150K .......... .......... .......... .......... .......... 68% 22.0M 2s 2024-08-24T21:12:09.635 INFO:tasks.workunit.client.0.smithi179.stderr:116200K .......... .......... .......... .......... .......... 68% 39.2M 2s 2024-08-24T21:12:09.637 INFO:tasks.workunit.client.0.smithi179.stderr:116250K .......... .......... .......... .......... .......... 68% 22.1M 2s 2024-08-24T21:12:09.640 INFO:tasks.workunit.client.0.smithi179.stderr:116300K .......... .......... .......... .......... .......... 69% 18.0M 2s 2024-08-24T21:12:09.643 INFO:tasks.workunit.client.0.smithi179.stderr:116350K .......... .......... .......... .......... .......... 69% 18.2M 2s 2024-08-24T21:12:09.644 INFO:tasks.workunit.client.0.smithi179.stderr:116400K .......... .......... .......... .......... .......... 69% 51.0M 2s 2024-08-24T21:12:09.646 INFO:tasks.workunit.client.0.smithi179.stderr:116450K .......... .......... .......... .......... .......... 69% 24.6M 2s 2024-08-24T21:12:09.648 INFO:tasks.workunit.client.0.smithi179.stderr:116500K .......... .......... .......... .......... .......... 69% 23.8M 2s 2024-08-24T21:12:09.650 INFO:tasks.workunit.client.0.smithi179.stderr:116550K .......... .......... .......... .......... .......... 69% 22.8M 2s 2024-08-24T21:12:09.651 INFO:tasks.workunit.client.0.smithi179.stderr:116600K .......... .......... .......... .......... .......... 69% 52.6M 2s 2024-08-24T21:12:09.653 INFO:tasks.workunit.client.0.smithi179.stderr:116650K .......... .......... .......... .......... .......... 69% 21.8M 2s 2024-08-24T21:12:09.656 INFO:tasks.workunit.client.0.smithi179.stderr:116700K .......... .......... .......... .......... .......... 69% 18.2M 2s 2024-08-24T21:12:09.657 INFO:tasks.workunit.client.0.smithi179.stderr:116750K .......... .......... .......... .......... .......... 69% 28.2M 2s 2024-08-24T21:12:09.659 INFO:tasks.workunit.client.0.smithi179.stderr:116800K .......... .......... .......... .......... .......... 69% 23.0M 2s 2024-08-24T21:12:09.661 INFO:tasks.workunit.client.0.smithi179.stderr:116850K .......... .......... .......... .......... .......... 69% 25.9M 2s 2024-08-24T21:12:09.663 INFO:tasks.workunit.client.0.smithi179.stderr:116900K .......... .......... .......... .......... .......... 69% 28.7M 2s 2024-08-24T21:12:09.665 INFO:tasks.workunit.client.0.smithi179.stderr:116950K .......... .......... .......... .......... .......... 69% 23.8M 2s 2024-08-24T21:12:09.666 INFO:tasks.workunit.client.0.smithi179.stderr:117000K .......... .......... .......... .......... .......... 69% 38.4M 2s 2024-08-24T21:12:09.668 INFO:tasks.workunit.client.0.smithi179.stderr:117050K .......... .......... .......... .......... .......... 69% 22.9M 2s 2024-08-24T21:12:09.669 INFO:tasks.workunit.client.0.smithi179.stderr:117100K .......... .......... .......... .......... .......... 69% 46.2M 2s 2024-08-24T21:12:09.672 INFO:tasks.workunit.client.0.smithi179.stderr:117150K .......... .......... .......... .......... .......... 69% 22.8M 2s 2024-08-24T21:12:09.674 INFO:tasks.workunit.client.0.smithi179.stderr:117200K .......... .......... .......... .......... .......... 69% 21.2M 2s 2024-08-24T21:12:09.675 INFO:tasks.workunit.client.0.smithi179.stderr:117250K .......... .......... .......... .......... .......... 69% 40.0M 2s 2024-08-24T21:12:09.678 INFO:tasks.workunit.client.0.smithi179.stderr:117300K .......... .......... .......... .......... .......... 69% 23.0M 2s 2024-08-24T21:12:09.679 INFO:tasks.workunit.client.0.smithi179.stderr:117350K .......... .......... .......... .......... .......... 69% 23.5M 2s 2024-08-24T21:12:09.680 INFO:tasks.workunit.client.0.smithi179.stderr:117400K .......... .......... .......... .......... .......... 69% 38.5M 2s 2024-08-24T21:12:09.682 INFO:tasks.workunit.client.0.smithi179.stderr:117450K .......... .......... .......... .......... .......... 69% 28.6M 2s 2024-08-24T21:12:09.683 INFO:tasks.workunit.client.0.smithi179.stderr:117500K .......... .......... .......... .......... .......... 69% 39.9M 2s 2024-08-24T21:12:09.686 INFO:tasks.workunit.client.0.smithi179.stderr:117550K .......... .......... .......... .......... .......... 69% 24.4M 2s 2024-08-24T21:12:09.688 INFO:tasks.workunit.client.0.smithi179.stderr:117600K .......... .......... .......... .......... .......... 69% 23.9M 2s 2024-08-24T21:12:09.689 INFO:tasks.workunit.client.0.smithi179.stderr:117650K .......... .......... .......... .......... .......... 69% 36.6M 2s 2024-08-24T21:12:09.692 INFO:tasks.workunit.client.0.smithi179.stderr:117700K .......... .......... .......... .......... .......... 69% 21.8M 2s 2024-08-24T21:12:09.692 INFO:tasks.workunit.client.0.smithi179.stderr:117750K .......... .......... .......... .......... .......... 69% 36.3M 2s 2024-08-24T21:12:09.694 INFO:tasks.workunit.client.0.smithi179.stderr:117800K .......... .......... .......... .......... .......... 69% 27.4M 2s 2024-08-24T21:12:09.697 INFO:tasks.workunit.client.0.smithi179.stderr:117850K .......... .......... .......... .......... .......... 69% 22.6M 2s 2024-08-24T21:12:09.698 INFO:tasks.workunit.client.0.smithi179.stderr:117900K .......... .......... .......... .......... .......... 69% 40.1M 2s 2024-08-24T21:12:09.699 INFO:tasks.workunit.client.0.smithi179.stderr:117950K .......... .......... .......... .......... .......... 70% 26.6M 2s 2024-08-24T21:12:09.702 INFO:tasks.workunit.client.0.smithi179.stderr:118000K .......... .......... .......... .......... .......... 70% 23.5M 2s 2024-08-24T21:12:09.703 INFO:tasks.workunit.client.0.smithi179.stderr:118050K .......... .......... .......... .......... .......... 70% 42.0M 2s 2024-08-24T21:12:09.704 INFO:tasks.workunit.client.0.smithi179.stderr:118100K .......... .......... .......... .......... .......... 70% 25.9M 2s 2024-08-24T21:12:09.707 INFO:tasks.workunit.client.0.smithi179.stderr:118150K .......... .......... .......... .......... .......... 70% 33.3M 2s 2024-08-24T21:12:09.708 INFO:tasks.workunit.client.0.smithi179.stderr:118200K .......... .......... .......... .......... .......... 70% 30.1M 2s 2024-08-24T21:12:09.709 INFO:tasks.workunit.client.0.smithi179.stderr:118250K .......... .......... .......... .......... .......... 70% 28.9M 2s 2024-08-24T21:12:09.712 INFO:tasks.workunit.client.0.smithi179.stderr:118300K .......... .......... .......... .......... .......... 70% 23.3M 2s 2024-08-24T21:12:09.714 INFO:tasks.workunit.client.0.smithi179.stderr:118350K .......... .......... .......... .......... .......... 70% 24.6M 2s 2024-08-24T21:12:09.716 INFO:tasks.workunit.client.0.smithi179.stderr:118400K .......... .......... .......... .......... .......... 70% 20.9M 2s 2024-08-24T21:12:09.717 INFO:tasks.workunit.client.0.smithi179.stderr:118450K .......... .......... .......... .......... .......... 70% 41.2M 2s 2024-08-24T21:12:09.720 INFO:tasks.workunit.client.0.smithi179.stderr:118500K .......... .......... .......... .......... .......... 70% 20.9M 2s 2024-08-24T21:12:09.720 INFO:tasks.workunit.client.0.smithi179.stderr:118550K .......... .......... .......... .......... .......... 70% 44.4M 2s 2024-08-24T21:12:09.723 INFO:tasks.workunit.client.0.smithi179.stderr:118600K .......... .......... .......... .......... .......... 70% 23.4M 2s 2024-08-24T21:12:09.724 INFO:tasks.workunit.client.0.smithi179.stderr:118650K .......... .......... .......... .......... .......... 70% 42.5M 2s 2024-08-24T21:12:09.726 INFO:tasks.workunit.client.0.smithi179.stderr:118700K .......... .......... .......... .......... .......... 70% 24.5M 2s 2024-08-24T21:12:09.727 INFO:tasks.workunit.client.0.smithi179.stderr:118750K .......... .......... .......... .......... .......... 70% 33.3M 2s 2024-08-24T21:12:09.730 INFO:tasks.workunit.client.0.smithi179.stderr:118800K .......... .......... .......... .......... .......... 70% 22.7M 2s 2024-08-24T21:12:09.731 INFO:tasks.workunit.client.0.smithi179.stderr:118850K .......... .......... .......... .......... .......... 70% 32.4M 2s 2024-08-24T21:12:09.732 INFO:tasks.workunit.client.0.smithi179.stderr:118900K .......... .......... .......... .......... .......... 70% 43.6M 2s 2024-08-24T21:12:09.734 INFO:tasks.workunit.client.0.smithi179.stderr:118950K .......... .......... .......... .......... .......... 70% 21.9M 2s 2024-08-24T21:12:09.736 INFO:tasks.workunit.client.0.smithi179.stderr:119000K .......... .......... .......... .......... .......... 70% 23.7M 2s 2024-08-24T21:12:09.737 INFO:tasks.workunit.client.0.smithi179.stderr:119050K .......... .......... .......... .......... .......... 70% 47.1M 2s 2024-08-24T21:12:09.740 INFO:tasks.workunit.client.0.smithi179.stderr:119100K .......... .......... .......... .......... .......... 70% 22.7M 2s 2024-08-24T21:12:09.742 INFO:tasks.workunit.client.0.smithi179.stderr:119150K .......... .......... .......... .......... .......... 70% 23.7M 2s 2024-08-24T21:12:09.743 INFO:tasks.workunit.client.0.smithi179.stderr:119200K .......... .......... .......... .......... .......... 70% 36.1M 2s 2024-08-24T21:12:09.744 INFO:tasks.workunit.client.0.smithi179.stderr:119250K .......... .......... .......... .......... .......... 70% 39.6M 2s 2024-08-24T21:12:09.746 INFO:tasks.workunit.client.0.smithi179.stderr:119300K .......... .......... .......... .......... .......... 70% 29.0M 2s 2024-08-24T21:12:09.748 INFO:tasks.workunit.client.0.smithi179.stderr:119350K .......... .......... .......... .......... .......... 70% 24.6M 2s 2024-08-24T21:12:09.748 INFO:tasks.workunit.client.0.smithi179.stderr:119400K .......... .......... .......... .......... .......... 70% 50.4M 2s 2024-08-24T21:12:09.751 INFO:tasks.workunit.client.0.smithi179.stderr:119450K .......... .......... .......... .......... .......... 70% 22.4M 2s 2024-08-24T21:12:09.753 INFO:tasks.workunit.client.0.smithi179.stderr:119500K .......... .......... .......... .......... .......... 70% 27.0M 2s 2024-08-24T21:12:09.756 INFO:tasks.workunit.client.0.smithi179.stderr:119550K .......... .......... .......... .......... .......... 70% 18.6M 2s 2024-08-24T21:12:09.757 INFO:tasks.workunit.client.0.smithi179.stderr:119600K .......... .......... .......... .......... .......... 70% 42.7M 2s 2024-08-24T21:12:09.758 INFO:tasks.workunit.client.0.smithi179.stderr:119650K .......... .......... .......... .......... .......... 71% 24.9M 2s 2024-08-24T21:12:09.759 INFO:tasks.workunit.client.0.smithi179.stderr:119700K .......... .......... .......... .......... .......... 71% 43.5M 2s 2024-08-24T21:12:09.762 INFO:tasks.workunit.client.0.smithi179.stderr:119750K .......... .......... .......... .......... .......... 71% 21.8M 2s 2024-08-24T21:12:09.763 INFO:tasks.workunit.client.0.smithi179.stderr:119800K .......... .......... .......... .......... .......... 71% 38.8M 2s 2024-08-24T21:12:09.765 INFO:tasks.workunit.client.0.smithi179.stderr:119850K .......... .......... .......... .......... .......... 71% 23.2M 2s 2024-08-24T21:12:09.766 INFO:tasks.workunit.client.0.smithi179.stderr:119900K .......... .......... .......... .......... .......... 71% 42.0M 2s 2024-08-24T21:12:09.768 INFO:tasks.workunit.client.0.smithi179.stderr:119950K .......... .......... .......... .......... .......... 71% 24.7M 2s 2024-08-24T21:12:09.771 INFO:tasks.workunit.client.0.smithi179.stderr:120000K .......... .......... .......... .......... .......... 71% 20.3M 2s 2024-08-24T21:12:09.772 INFO:tasks.workunit.client.0.smithi179.stderr:120050K .......... .......... .......... .......... .......... 71% 39.5M 2s 2024-08-24T21:12:09.775 INFO:tasks.workunit.client.0.smithi179.stderr:120100K .......... .......... .......... .......... .......... 71% 21.5M 2s 2024-08-24T21:12:09.776 INFO:tasks.workunit.client.0.smithi179.stderr:120150K .......... .......... .......... .......... .......... 71% 23.0M 2s 2024-08-24T21:12:09.777 INFO:tasks.workunit.client.0.smithi179.stderr:120200K .......... .......... .......... .......... .......... 71% 45.9M 2s 2024-08-24T21:12:09.780 INFO:tasks.workunit.client.0.smithi179.stderr:120250K .......... .......... .......... .......... .......... 71% 21.0M 2s 2024-08-24T21:12:09.781 INFO:tasks.workunit.client.0.smithi179.stderr:120300K .......... .......... .......... .......... .......... 71% 48.2M 2s 2024-08-24T21:12:09.783 INFO:tasks.workunit.client.0.smithi179.stderr:120350K .......... .......... .......... .......... .......... 71% 22.1M 2s 2024-08-24T21:12:09.785 INFO:tasks.workunit.client.0.smithi179.stderr:120400K .......... .......... .......... .......... .......... 71% 26.6M 2s 2024-08-24T21:12:09.786 INFO:tasks.workunit.client.0.smithi179.stderr:120450K .......... .......... .......... .......... .......... 71% 43.3M 2s 2024-08-24T21:12:09.788 INFO:tasks.workunit.client.0.smithi179.stderr:120500K .......... .......... .......... .......... .......... 71% 21.8M 2s 2024-08-24T21:12:09.789 INFO:tasks.workunit.client.0.smithi179.stderr:120550K .......... .......... .......... .......... .......... 71% 39.6M 2s 2024-08-24T21:12:09.792 INFO:tasks.workunit.client.0.smithi179.stderr:120600K .......... .......... .......... .......... .......... 71% 23.6M 2s 2024-08-24T21:12:09.794 INFO:tasks.workunit.client.0.smithi179.stderr:120650K .......... .......... .......... .......... .......... 71% 24.9M 2s 2024-08-24T21:12:09.794 INFO:tasks.workunit.client.0.smithi179.stderr:120700K .......... .......... .......... .......... .......... 71% 45.9M 2s 2024-08-24T21:12:09.797 INFO:tasks.workunit.client.0.smithi179.stderr:120750K .......... .......... .......... .......... .......... 71% 20.3M 2s 2024-08-24T21:12:09.799 INFO:tasks.workunit.client.0.smithi179.stderr:120800K .......... .......... .......... .......... .......... 71% 28.8M 2s 2024-08-24T21:12:09.801 INFO:tasks.workunit.client.0.smithi179.stderr:120850K .......... .......... .......... .......... .......... 71% 31.2M 2s 2024-08-24T21:12:09.803 INFO:tasks.workunit.client.0.smithi179.stderr:120900K .......... .......... .......... .......... .......... 71% 29.1M 2s 2024-08-24T21:12:09.803 INFO:tasks.workunit.client.0.smithi179.stderr:120950K .......... .......... .......... .......... .......... 71% 51.8M 2s 2024-08-24T21:12:09.806 INFO:tasks.workunit.client.0.smithi179.stderr:121000K .......... .......... .......... .......... .......... 71% 18.0M 2s 2024-08-24T21:12:09.807 INFO:tasks.workunit.client.0.smithi179.stderr:121050K .......... .......... .......... .......... .......... 71% 37.3M 2s 2024-08-24T21:12:09.809 INFO:tasks.workunit.client.0.smithi179.stderr:121100K .......... .......... .......... .......... .......... 71% 24.5M 2s 2024-08-24T21:12:09.811 INFO:tasks.workunit.client.0.smithi179.stderr:121150K .......... .......... .......... .......... .......... 71% 23.8M 2s 2024-08-24T21:12:09.814 INFO:tasks.workunit.client.0.smithi179.stderr:121200K .......... .......... .......... .......... .......... 71% 21.2M 2s 2024-08-24T21:12:09.814 INFO:tasks.workunit.client.0.smithi179.stderr:121250K .......... .......... .......... .......... .......... 71% 81.2M 2s 2024-08-24T21:12:09.816 INFO:tasks.workunit.client.0.smithi179.stderr:121300K .......... .......... .......... .......... .......... 71% 23.7M 2s 2024-08-24T21:12:09.818 INFO:tasks.workunit.client.0.smithi179.stderr:121350K .......... .......... .......... .......... .......... 72% 27.6M 2s 2024-08-24T21:12:09.820 INFO:tasks.workunit.client.0.smithi179.stderr:121400K .......... .......... .......... .......... .......... 72% 23.5M 2s 2024-08-24T21:12:09.821 INFO:tasks.workunit.client.0.smithi179.stderr:121450K .......... .......... .......... .......... .......... 72% 40.9M 2s 2024-08-24T21:12:09.823 INFO:tasks.workunit.client.0.smithi179.stderr:121500K .......... .......... .......... .......... .......... 72% 21.1M 2s 2024-08-24T21:12:09.826 INFO:tasks.workunit.client.0.smithi179.stderr:121550K .......... .......... .......... .......... .......... 72% 19.0M 2s 2024-08-24T21:12:09.827 INFO:tasks.workunit.client.0.smithi179.stderr:121600K .......... .......... .......... .......... .......... 72% 46.7M 2s 2024-08-24T21:12:09.829 INFO:tasks.workunit.client.0.smithi179.stderr:121650K .......... .......... .......... .......... .......... 72% 26.4M 2s 2024-08-24T21:12:09.830 INFO:tasks.workunit.client.0.smithi179.stderr:121700K .......... .......... .......... .......... .......... 72% 36.6M 2s 2024-08-24T21:12:09.832 INFO:tasks.workunit.client.0.smithi179.stderr:121750K .......... .......... .......... .......... .......... 72% 23.2M 2s 2024-08-24T21:12:09.833 INFO:tasks.workunit.client.0.smithi179.stderr:121800K .......... .......... .......... .......... .......... 72% 40.9M 2s 2024-08-24T21:12:09.836 INFO:tasks.workunit.client.0.smithi179.stderr:121850K .......... .......... .......... .......... .......... 72% 21.0M 2s 2024-08-24T21:12:09.838 INFO:tasks.workunit.client.0.smithi179.stderr:121900K .......... .......... .......... .......... .......... 72% 23.7M 2s 2024-08-24T21:12:09.840 INFO:tasks.workunit.client.0.smithi179.stderr:121950K .......... .......... .......... .......... .......... 72% 21.4M 2s 2024-08-24T21:12:09.841 INFO:tasks.workunit.client.0.smithi179.stderr:122000K .......... .......... .......... .......... .......... 72% 40.0M 2s 2024-08-24T21:12:09.843 INFO:tasks.workunit.client.0.smithi179.stderr:122050K .......... .......... .......... .......... .......... 72% 22.5M 2s 2024-08-24T21:12:09.845 INFO:tasks.workunit.client.0.smithi179.stderr:122100K .......... .......... .......... .......... .......... 72% 31.2M 2s 2024-08-24T21:12:09.848 INFO:tasks.workunit.client.0.smithi179.stderr:122150K .......... .......... .......... .......... .......... 72% 23.2M 2s 2024-08-24T21:12:09.848 INFO:tasks.workunit.client.0.smithi179.stderr:122200K .......... .......... .......... .......... .......... 72% 56.3M 2s 2024-08-24T21:12:09.850 INFO:tasks.workunit.client.0.smithi179.stderr:122250K .......... .......... .......... .......... .......... 72% 21.9M 2s 2024-08-24T21:12:09.851 INFO:tasks.workunit.client.0.smithi179.stderr:122300K .......... .......... .......... .......... .......... 72% 31.6M 2s 2024-08-24T21:12:09.854 INFO:tasks.workunit.client.0.smithi179.stderr:122350K .......... .......... .......... .......... .......... 72% 23.3M 2s 2024-08-24T21:12:09.856 INFO:tasks.workunit.client.0.smithi179.stderr:122400K .......... .......... .......... .......... .......... 72% 22.8M 2s 2024-08-24T21:12:09.859 INFO:tasks.workunit.client.0.smithi179.stderr:122450K .......... .......... .......... .......... .......... 72% 24.5M 2s 2024-08-24T21:12:09.859 INFO:tasks.workunit.client.0.smithi179.stderr:122500K .......... .......... .......... .......... .......... 72% 51.0M 2s 2024-08-24T21:12:09.861 INFO:tasks.workunit.client.0.smithi179.stderr:122550K .......... .......... .......... .......... .......... 72% 21.4M 2s 2024-08-24T21:12:09.862 INFO:tasks.workunit.client.0.smithi179.stderr:122600K .......... .......... .......... .......... .......... 72% 42.6M 2s 2024-08-24T21:12:09.864 INFO:tasks.workunit.client.0.smithi179.stderr:122650K .......... .......... .......... .......... .......... 72% 23.4M 2s 2024-08-24T21:12:09.866 INFO:tasks.workunit.client.0.smithi179.stderr:122700K .......... .......... .......... .......... .......... 72% 44.2M 2s 2024-08-24T21:12:09.867 INFO:tasks.workunit.client.0.smithi179.stderr:122750K .......... .......... .......... .......... .......... 72% 28.0M 2s 2024-08-24T21:12:09.870 INFO:tasks.workunit.client.0.smithi179.stderr:122800K .......... .......... .......... .......... .......... 72% 19.9M 2s 2024-08-24T21:12:09.872 INFO:tasks.workunit.client.0.smithi179.stderr:122850K .......... .......... .......... .......... .......... 72% 31.5M 2s 2024-08-24T21:12:09.872 INFO:tasks.workunit.client.0.smithi179.stderr:122900K .......... .......... .......... .......... .......... 72% 38.2M 2s 2024-08-24T21:12:09.874 INFO:tasks.workunit.client.0.smithi179.stderr:122950K .......... .......... .......... .......... .......... 72% 32.7M 2s 2024-08-24T21:12:09.876 INFO:tasks.workunit.client.0.smithi179.stderr:123000K .......... .......... .......... .......... .......... 72% 23.8M 2s 2024-08-24T21:12:09.879 INFO:tasks.workunit.client.0.smithi179.stderr:123050K .......... .......... .......... .......... .......... 73% 25.3M 2s 2024-08-24T21:12:09.879 INFO:tasks.workunit.client.0.smithi179.stderr:123100K .......... .......... .......... .......... .......... 73% 49.8M 2s 2024-08-24T21:12:09.881 INFO:tasks.workunit.client.0.smithi179.stderr:123150K .......... .......... .......... .......... .......... 73% 21.2M 2s 2024-08-24T21:12:09.884 INFO:tasks.workunit.client.0.smithi179.stderr:123200K .......... .......... .......... .......... .......... 73% 21.4M 2s 2024-08-24T21:12:09.885 INFO:tasks.workunit.client.0.smithi179.stderr:123250K .......... .......... .......... .......... .......... 73% 39.1M 2s 2024-08-24T21:12:09.887 INFO:tasks.workunit.client.0.smithi179.stderr:123300K .......... .......... .......... .......... .......... 73% 27.6M 2s 2024-08-24T21:12:09.889 INFO:tasks.workunit.client.0.smithi179.stderr:123350K .......... .......... .......... .......... .......... 73% 23.4M 2s 2024-08-24T21:12:09.890 INFO:tasks.workunit.client.0.smithi179.stderr:123400K .......... .......... .......... .......... .......... 73% 38.8M 2s 2024-08-24T21:12:09.892 INFO:tasks.workunit.client.0.smithi179.stderr:123450K .......... .......... .......... .......... .......... 73% 32.0M 2s 2024-08-24T21:12:09.894 INFO:tasks.workunit.client.0.smithi179.stderr:123500K .......... .......... .......... .......... .......... 73% 18.4M 2s 2024-08-24T21:12:09.896 INFO:tasks.workunit.client.0.smithi179.stderr:123550K .......... .......... .......... .......... .......... 73% 23.5M 2s 2024-08-24T21:12:09.898 INFO:tasks.workunit.client.0.smithi179.stderr:123600K .......... .......... .......... .......... .......... 73% 24.2M 2s 2024-08-24T21:12:09.900 INFO:tasks.workunit.client.0.smithi179.stderr:123650K .......... .......... .......... .......... .......... 73% 33.6M 2s 2024-08-24T21:12:09.901 INFO:tasks.workunit.client.0.smithi179.stderr:123700K .......... .......... .......... .......... .......... 73% 27.8M 2s 2024-08-24T21:12:09.903 INFO:tasks.workunit.client.0.smithi179.stderr:123750K .......... .......... .......... .......... .......... 73% 29.9M 2s 2024-08-24T21:12:09.905 INFO:tasks.workunit.client.0.smithi179.stderr:123800K .......... .......... .......... .......... .......... 73% 26.7M 2s 2024-08-24T21:12:09.906 INFO:tasks.workunit.client.0.smithi179.stderr:123850K .......... .......... .......... .......... .......... 73% 32.0M 2s 2024-08-24T21:12:09.908 INFO:tasks.workunit.client.0.smithi179.stderr:123900K .......... .......... .......... .......... .......... 73% 26.1M 2s 2024-08-24T21:12:09.910 INFO:tasks.workunit.client.0.smithi179.stderr:123950K .......... .......... .......... .......... .......... 73% 23.0M 2s 2024-08-24T21:12:09.911 INFO:tasks.workunit.client.0.smithi179.stderr:124000K .......... .......... .......... .......... .......... 73% 48.9M 2s 2024-08-24T21:12:09.913 INFO:tasks.workunit.client.0.smithi179.stderr:124050K .......... .......... .......... .......... .......... 73% 22.4M 2s 2024-08-24T21:12:09.916 INFO:tasks.workunit.client.0.smithi179.stderr:124100K .......... .......... .......... .......... .......... 73% 22.7M 2s 2024-08-24T21:12:09.917 INFO:tasks.workunit.client.0.smithi179.stderr:124150K .......... .......... .......... .......... .......... 73% 31.1M 2s 2024-08-24T21:12:09.919 INFO:tasks.workunit.client.0.smithi179.stderr:124200K .......... .......... .......... .......... .......... 73% 24.3M 2s 2024-08-24T21:12:09.920 INFO:tasks.workunit.client.0.smithi179.stderr:124250K .......... .......... .......... .......... .......... 73% 37.2M 2s 2024-08-24T21:12:09.923 INFO:tasks.workunit.client.0.smithi179.stderr:124300K .......... .......... .......... .......... .......... 73% 24.1M 2s 2024-08-24T21:12:09.925 INFO:tasks.workunit.client.0.smithi179.stderr:124350K .......... .......... .......... .......... .......... 73% 20.5M 2s 2024-08-24T21:12:09.927 INFO:tasks.workunit.client.0.smithi179.stderr:124400K .......... .......... .......... .......... .......... 73% 35.9M 2s 2024-08-24T21:12:09.928 INFO:tasks.workunit.client.0.smithi179.stderr:124450K .......... .......... .......... .......... .......... 73% 27.8M 2s 2024-08-24T21:12:09.930 INFO:tasks.workunit.client.0.smithi179.stderr:124500K .......... .......... .......... .......... .......... 73% 28.7M 2s 2024-08-24T21:12:09.932 INFO:tasks.workunit.client.0.smithi179.stderr:124550K .......... .......... .......... .......... .......... 73% 25.5M 2s 2024-08-24T21:12:09.933 INFO:tasks.workunit.client.0.smithi179.stderr:124600K .......... .......... .......... .......... .......... 73% 37.9M 2s 2024-08-24T21:12:09.935 INFO:tasks.workunit.client.0.smithi179.stderr:124650K .......... .......... .......... .......... .......... 73% 19.5M 2s 2024-08-24T21:12:09.938 INFO:tasks.workunit.client.0.smithi179.stderr:124700K .......... .......... .......... .......... .......... 74% 22.2M 2s 2024-08-24T21:12:09.940 INFO:tasks.workunit.client.0.smithi179.stderr:124750K .......... .......... .......... .......... .......... 74% 25.3M 2s 2024-08-24T21:12:09.941 INFO:tasks.workunit.client.0.smithi179.stderr:124800K .......... .......... .......... .......... .......... 74% 38.3M 2s 2024-08-24T21:12:09.943 INFO:tasks.workunit.client.0.smithi179.stderr:124850K .......... .......... .......... .......... .......... 74% 21.1M 2s 2024-08-24T21:12:09.944 INFO:tasks.workunit.client.0.smithi179.stderr:124900K .......... .......... .......... .......... .......... 74% 41.4M 2s 2024-08-24T21:12:09.947 INFO:tasks.workunit.client.0.smithi179.stderr:124950K .......... .......... .......... .......... .......... 74% 21.9M 2s 2024-08-24T21:12:09.948 INFO:tasks.workunit.client.0.smithi179.stderr:125000K .......... .......... .......... .......... .......... 74% 49.7M 2s 2024-08-24T21:12:09.949 INFO:tasks.workunit.client.0.smithi179.stderr:125050K .......... .......... .......... .......... .......... 74% 33.1M 2s 2024-08-24T21:12:09.952 INFO:tasks.workunit.client.0.smithi179.stderr:125100K .......... .......... .......... .......... .......... 74% 24.6M 2s 2024-08-24T21:12:09.953 INFO:tasks.workunit.client.0.smithi179.stderr:125150K .......... .......... .......... .......... .......... 74% 25.9M 2s 2024-08-24T21:12:09.955 INFO:tasks.workunit.client.0.smithi179.stderr:125200K .......... .......... .......... .......... .......... 74% 21.7M 2s 2024-08-24T21:12:09.957 INFO:tasks.workunit.client.0.smithi179.stderr:125250K .......... .......... .......... .......... .......... 74% 24.2M 2s 2024-08-24T21:12:09.958 INFO:tasks.workunit.client.0.smithi179.stderr:125300K .......... .......... .......... .......... .......... 74% 38.1M 2s 2024-08-24T21:12:09.960 INFO:tasks.workunit.client.0.smithi179.stderr:125350K .......... .......... .......... .......... .......... 74% 27.5M 2s 2024-08-24T21:12:09.961 INFO:tasks.workunit.client.0.smithi179.stderr:125400K .......... .......... .......... .......... .......... 74% 38.1M 2s 2024-08-24T21:12:09.964 INFO:tasks.workunit.client.0.smithi179.stderr:125450K .......... .......... .......... .......... .......... 74% 25.1M 2s 2024-08-24T21:12:09.965 INFO:tasks.workunit.client.0.smithi179.stderr:125500K .......... .......... .......... .......... .......... 74% 37.7M 2s 2024-08-24T21:12:09.967 INFO:tasks.workunit.client.0.smithi179.stderr:125550K .......... .......... .......... .......... .......... 74% 23.2M 2s 2024-08-24T21:12:09.968 INFO:tasks.workunit.client.0.smithi179.stderr:125600K .......... .......... .......... .......... .......... 74% 38.1M 2s 2024-08-24T21:12:09.970 INFO:tasks.workunit.client.0.smithi179.stderr:125650K .......... .......... .......... .......... .......... 74% 29.6M 2s 2024-08-24T21:12:09.972 INFO:tasks.workunit.client.0.smithi179.stderr:125700K .......... .......... .......... .......... .......... 74% 22.8M 2s 2024-08-24T21:12:09.974 INFO:tasks.workunit.client.0.smithi179.stderr:125750K .......... .......... .......... .......... .......... 74% 29.2M 2s 2024-08-24T21:12:09.975 INFO:tasks.workunit.client.0.smithi179.stderr:125800K .......... .......... .......... .......... .......... 74% 31.1M 2s 2024-08-24T21:12:09.978 INFO:tasks.workunit.client.0.smithi179.stderr:125850K .......... .......... .......... .......... .......... 74% 24.4M 2s 2024-08-24T21:12:09.978 INFO:tasks.workunit.client.0.smithi179.stderr:125900K .......... .......... .......... .......... .......... 74% 70.5M 2s 2024-08-24T21:12:09.980 INFO:tasks.workunit.client.0.smithi179.stderr:125950K .......... .......... .......... .......... .......... 74% 18.6M 2s 2024-08-24T21:12:09.982 INFO:tasks.workunit.client.0.smithi179.stderr:126000K .......... .......... .......... .......... .......... 74% 28.3M 2s 2024-08-24T21:12:09.984 INFO:tasks.workunit.client.0.smithi179.stderr:126050K .......... .......... .......... .......... .......... 74% 37.6M 2s 2024-08-24T21:12:09.986 INFO:tasks.workunit.client.0.smithi179.stderr:126100K .......... .......... .......... .......... .......... 74% 26.9M 2s 2024-08-24T21:12:09.987 INFO:tasks.workunit.client.0.smithi179.stderr:126150K .......... .......... .......... .......... .......... 74% 29.3M 2s 2024-08-24T21:12:09.990 INFO:tasks.workunit.client.0.smithi179.stderr:126200K .......... .......... .......... .......... .......... 74% 23.8M 2s 2024-08-24T21:12:09.990 INFO:tasks.workunit.client.0.smithi179.stderr:126250K .......... .......... .......... .......... .......... 74% 54.6M 2s 2024-08-24T21:12:09.992 INFO:tasks.workunit.client.0.smithi179.stderr:126300K .......... .......... .......... .......... .......... 74% 24.3M 2s 2024-08-24T21:12:09.994 INFO:tasks.workunit.client.0.smithi179.stderr:126350K .......... .......... .......... .......... .......... 74% 19.9M 2s 2024-08-24T21:12:09.997 INFO:tasks.workunit.client.0.smithi179.stderr:126400K .......... .......... .......... .......... .......... 75% 16.8M 2s 2024-08-24T21:12:09.999 INFO:tasks.workunit.client.0.smithi179.stderr:126450K .......... .......... .......... .......... .......... 75% 24.3M 2s 2024-08-24T21:12:10.001 INFO:tasks.workunit.client.0.smithi179.stderr:126500K .......... .......... .......... .......... .......... 75% 26.6M 2s 2024-08-24T21:12:10.002 INFO:tasks.workunit.client.0.smithi179.stderr:126550K .......... .......... .......... .......... .......... 75% 44.7M 2s 2024-08-24T21:12:10.004 INFO:tasks.workunit.client.0.smithi179.stderr:126600K .......... .......... .......... .......... .......... 75% 24.1M 2s 2024-08-24T21:12:10.005 INFO:tasks.workunit.client.0.smithi179.stderr:126650K .......... .......... .......... .......... .......... 75% 44.4M 2s 2024-08-24T21:12:10.009 INFO:tasks.workunit.client.0.smithi179.stderr:126700K .......... .......... .......... .......... .......... 75% 15.8M 2s 2024-08-24T21:12:10.010 INFO:tasks.workunit.client.0.smithi179.stderr:126750K .......... .......... .......... .......... .......... 75% 31.2M 2s 2024-08-24T21:12:10.012 INFO:tasks.workunit.client.0.smithi179.stderr:126800K .......... .......... .......... .......... .......... 75% 39.2M 2s 2024-08-24T21:12:10.014 INFO:tasks.workunit.client.0.smithi179.stderr:126850K .......... .......... .......... .......... .......... 75% 20.7M 2s 2024-08-24T21:12:10.015 INFO:tasks.workunit.client.0.smithi179.stderr:126900K .......... .......... .......... .......... .......... 75% 42.5M 2s 2024-08-24T21:12:10.017 INFO:tasks.workunit.client.0.smithi179.stderr:126950K .......... .......... .......... .......... .......... 75% 19.4M 2s 2024-08-24T21:12:10.019 INFO:tasks.workunit.client.0.smithi179.stderr:127000K .......... .......... .......... .......... .......... 75% 26.7M 2s 2024-08-24T21:12:10.020 INFO:tasks.workunit.client.0.smithi179.stderr:127050K .......... .......... .......... .......... .......... 75% 44.5M 2s 2024-08-24T21:12:10.023 INFO:tasks.workunit.client.0.smithi179.stderr:127100K .......... .......... .......... .......... .......... 75% 18.4M 2s 2024-08-24T21:12:10.026 INFO:tasks.workunit.client.0.smithi179.stderr:127150K .......... .......... .......... .......... .......... 75% 18.9M 2s 2024-08-24T21:12:10.027 INFO:tasks.workunit.client.0.smithi179.stderr:127200K .......... .......... .......... .......... .......... 75% 46.8M 1s 2024-08-24T21:12:10.033 INFO:tasks.workunit.client.0.smithi179.stderr:127250K .......... .......... .......... .......... .......... 75% 22.8M 1s 2024-08-24T21:12:10.033 INFO:tasks.workunit.client.0.smithi179.stderr:127300K .......... .......... .......... .......... .......... 75% 43.4M 1s 2024-08-24T21:12:10.033 INFO:tasks.workunit.client.0.smithi179.stderr:127350K .......... .......... .......... .......... .......... 75% 21.3M 1s 2024-08-24T21:12:10.033 INFO:tasks.workunit.client.0.smithi179.stderr:127400K .......... .......... .......... .......... .......... 75% 45.5M 1s 2024-08-24T21:12:10.035 INFO:tasks.workunit.client.0.smithi179.stderr:127450K .......... .......... .......... .......... .......... 75% 22.3M 1s 2024-08-24T21:12:10.037 INFO:tasks.workunit.client.0.smithi179.stderr:127500K .......... .......... .......... .......... .......... 75% 23.4M 1s 2024-08-24T21:12:10.039 INFO:tasks.workunit.client.0.smithi179.stderr:127550K .......... .......... .......... .......... .......... 75% 25.2M 1s 2024-08-24T21:12:10.041 INFO:tasks.workunit.client.0.smithi179.stderr:127600K .......... .......... .......... .......... .......... 75% 36.8M 1s 2024-08-24T21:12:10.042 INFO:tasks.workunit.client.0.smithi179.stderr:127650K .......... .......... .......... .......... .......... 75% 28.5M 1s 2024-08-24T21:12:10.044 INFO:tasks.workunit.client.0.smithi179.stderr:127700K .......... .......... .......... .......... .......... 75% 32.8M 1s 2024-08-24T21:12:10.047 INFO:tasks.workunit.client.0.smithi179.stderr:127750K .......... .......... .......... .......... .......... 75% 22.9M 1s 2024-08-24T21:12:10.047 INFO:tasks.workunit.client.0.smithi179.stderr:127800K .......... .......... .......... .......... .......... 75% 66.7M 1s 2024-08-24T21:12:10.049 INFO:tasks.workunit.client.0.smithi179.stderr:127850K .......... .......... .......... .......... .......... 75% 23.2M 1s 2024-08-24T21:12:10.050 INFO:tasks.workunit.client.0.smithi179.stderr:127900K .......... .......... .......... .......... .......... 75% 33.5M 1s 2024-08-24T21:12:10.053 INFO:tasks.workunit.client.0.smithi179.stderr:127950K .......... .......... .......... .......... .......... 75% 22.3M 1s 2024-08-24T21:12:10.054 INFO:tasks.workunit.client.0.smithi179.stderr:128000K .......... .......... .......... .......... .......... 75% 29.5M 1s 2024-08-24T21:12:10.057 INFO:tasks.workunit.client.0.smithi179.stderr:128050K .......... .......... .......... .......... .......... 75% 23.1M 1s 2024-08-24T21:12:10.057 INFO:tasks.workunit.client.0.smithi179.stderr:128100K .......... .......... .......... .......... .......... 76% 46.7M 1s 2024-08-24T21:12:10.059 INFO:tasks.workunit.client.0.smithi179.stderr:128150K .......... .......... .......... .......... .......... 76% 23.9M 1s 2024-08-24T21:12:10.060 INFO:tasks.workunit.client.0.smithi179.stderr:128200K .......... .......... .......... .......... .......... 76% 40.7M 1s 2024-08-24T21:12:10.063 INFO:tasks.workunit.client.0.smithi179.stderr:128250K .......... .......... .......... .......... .......... 76% 22.7M 1s 2024-08-24T21:12:10.064 INFO:tasks.workunit.client.0.smithi179.stderr:128300K .......... .......... .......... .......... .......... 76% 52.1M 1s 2024-08-24T21:12:10.066 INFO:tasks.workunit.client.0.smithi179.stderr:128350K .......... .......... .......... .......... .......... 76% 19.9M 1s 2024-08-24T21:12:10.068 INFO:tasks.workunit.client.0.smithi179.stderr:128400K .......... .......... .......... .......... .......... 76% 25.9M 1s 2024-08-24T21:12:10.069 INFO:tasks.workunit.client.0.smithi179.stderr:128450K .......... .......... .......... .......... .......... 76% 37.2M 1s 2024-08-24T21:12:10.071 INFO:tasks.workunit.client.0.smithi179.stderr:128500K .......... .......... .......... .......... .......... 76% 25.6M 1s 2024-08-24T21:12:10.072 INFO:tasks.workunit.client.0.smithi179.stderr:128550K .......... .......... .......... .......... .......... 76% 36.9M 1s 2024-08-24T21:12:10.074 INFO:tasks.workunit.client.0.smithi179.stderr:128600K .......... .......... .......... .......... .......... 76% 29.0M 1s 2024-08-24T21:12:10.076 INFO:tasks.workunit.client.0.smithi179.stderr:128650K .......... .......... .......... .......... .......... 76% 23.3M 1s 2024-08-24T21:12:10.078 INFO:tasks.workunit.client.0.smithi179.stderr:128700K .......... .......... .......... .......... .......... 76% 31.9M 1s 2024-08-24T21:12:10.079 INFO:tasks.workunit.client.0.smithi179.stderr:128750K .......... .......... .......... .......... .......... 76% 27.7M 1s 2024-08-24T21:12:10.082 INFO:tasks.workunit.client.0.smithi179.stderr:128800K .......... .......... .......... .......... .......... 76% 22.0M 1s 2024-08-24T21:12:10.083 INFO:tasks.workunit.client.0.smithi179.stderr:128850K .......... .......... .......... .......... .......... 76% 38.6M 1s 2024-08-24T21:12:10.085 INFO:tasks.workunit.client.0.smithi179.stderr:128900K .......... .......... .......... .......... .......... 76% 26.3M 1s 2024-08-24T21:12:10.086 INFO:tasks.workunit.client.0.smithi179.stderr:128950K .......... .......... .......... .......... .......... 76% 38.6M 1s 2024-08-24T21:12:10.089 INFO:tasks.workunit.client.0.smithi179.stderr:129000K .......... .......... .......... .......... .......... 76% 19.7M 1s 2024-08-24T21:12:10.090 INFO:tasks.workunit.client.0.smithi179.stderr:129050K .......... .......... .......... .......... .......... 76% 50.7M 1s 2024-08-24T21:12:10.092 INFO:tasks.workunit.client.0.smithi179.stderr:129100K .......... .......... .......... .......... .......... 76% 27.0M 1s 2024-08-24T21:12:10.093 INFO:tasks.workunit.client.0.smithi179.stderr:129150K .......... .......... .......... .......... .......... 76% 25.3M 1s 2024-08-24T21:12:10.096 INFO:tasks.workunit.client.0.smithi179.stderr:129200K .......... .......... .......... .......... .......... 76% 18.6M 1s 2024-08-24T21:12:10.097 INFO:tasks.workunit.client.0.smithi179.stderr:129250K .......... .......... .......... .......... .......... 76% 32.7M 1s 2024-08-24T21:12:10.100 INFO:tasks.workunit.client.0.smithi179.stderr:129300K .......... .......... .......... .......... .......... 76% 24.0M 1s 2024-08-24T21:12:10.100 INFO:tasks.workunit.client.0.smithi179.stderr:129350K .......... .......... .......... .......... .......... 76% 61.8M 1s 2024-08-24T21:12:10.103 INFO:tasks.workunit.client.0.smithi179.stderr:129400K .......... .......... .......... .......... .......... 76% 20.9M 1s 2024-08-24T21:12:10.104 INFO:tasks.workunit.client.0.smithi179.stderr:129450K .......... .......... .......... .......... .......... 76% 39.9M 1s 2024-08-24T21:12:10.106 INFO:tasks.workunit.client.0.smithi179.stderr:129500K .......... .......... .......... .......... .......... 76% 24.1M 1s 2024-08-24T21:12:10.108 INFO:tasks.workunit.client.0.smithi179.stderr:129550K .......... .......... .......... .......... .......... 76% 24.9M 1s 2024-08-24T21:12:10.109 INFO:tasks.workunit.client.0.smithi179.stderr:129600K .......... .......... .......... .......... .......... 76% 43.0M 1s 2024-08-24T21:12:10.111 INFO:tasks.workunit.client.0.smithi179.stderr:129650K .......... .......... .......... .......... .......... 76% 23.9M 1s 2024-08-24T21:12:10.112 INFO:tasks.workunit.client.0.smithi179.stderr:129700K .......... .......... .......... .......... .......... 76% 39.0M 1s 2024-08-24T21:12:10.114 INFO:tasks.workunit.client.0.smithi179.stderr:129750K .......... .......... .......... .......... .......... 77% 25.5M 1s 2024-08-24T21:12:10.117 INFO:tasks.workunit.client.0.smithi179.stderr:129800K .......... .......... .......... .......... .......... 77% 22.0M 1s 2024-08-24T21:12:10.118 INFO:tasks.workunit.client.0.smithi179.stderr:129850K .......... .......... .......... .......... .......... 77% 50.1M 1s 2024-08-24T21:12:10.120 INFO:tasks.workunit.client.0.smithi179.stderr:129900K .......... .......... .......... .......... .......... 77% 23.7M 1s 2024-08-24T21:12:10.121 INFO:tasks.workunit.client.0.smithi179.stderr:129950K .......... .......... .......... .......... .......... 77% 31.8M 1s 2024-08-24T21:12:10.123 INFO:tasks.workunit.client.0.smithi179.stderr:130000K .......... .......... .......... .......... .......... 77% 27.3M 1s 2024-08-24T21:12:10.125 INFO:tasks.workunit.client.0.smithi179.stderr:130050K .......... .......... .......... .......... .......... 77% 25.1M 1s 2024-08-24T21:12:10.126 INFO:tasks.workunit.client.0.smithi179.stderr:130100K .......... .......... .......... .......... .......... 77% 38.8M 1s 2024-08-24T21:12:10.128 INFO:tasks.workunit.client.0.smithi179.stderr:130150K .......... .......... .......... .......... .......... 77% 23.8M 1s 2024-08-24T21:12:10.129 INFO:tasks.workunit.client.0.smithi179.stderr:130200K .......... .......... .......... .......... .......... 77% 47.8M 1s 2024-08-24T21:12:10.131 INFO:tasks.workunit.client.0.smithi179.stderr:130250K .......... .......... .......... .......... .......... 77% 22.4M 1s 2024-08-24T21:12:10.133 INFO:tasks.workunit.client.0.smithi179.stderr:130300K .......... .......... .......... .......... .......... 77% 22.6M 1s 2024-08-24T21:12:10.135 INFO:tasks.workunit.client.0.smithi179.stderr:130350K .......... .......... .......... .......... .......... 77% 26.9M 1s 2024-08-24T21:12:10.136 INFO:tasks.workunit.client.0.smithi179.stderr:130400K .......... .......... .......... .......... .......... 77% 45.6M 1s 2024-08-24T21:12:10.139 INFO:tasks.workunit.client.0.smithi179.stderr:130450K .......... .......... .......... .......... .......... 77% 24.9M 1s 2024-08-24T21:12:10.141 INFO:tasks.workunit.client.0.smithi179.stderr:130500K .......... .......... .......... .......... .......... 77% 30.0M 1s 2024-08-24T21:12:10.143 INFO:tasks.workunit.client.0.smithi179.stderr:130550K .......... .......... .......... .......... .......... 77% 24.1M 1s 2024-08-24T21:12:10.143 INFO:tasks.workunit.client.0.smithi179.stderr:130600K .......... .......... .......... .......... .......... 77% 59.4M 1s 2024-08-24T21:12:10.145 INFO:tasks.workunit.client.0.smithi179.stderr:130650K .......... .......... .......... .......... .......... 77% 22.9M 1s 2024-08-24T21:12:10.146 INFO:tasks.workunit.client.0.smithi179.stderr:130700K .......... .......... .......... .......... .......... 77% 39.3M 1s 2024-08-24T21:12:10.148 INFO:tasks.workunit.client.0.smithi179.stderr:130750K .......... .......... .......... .......... .......... 77% 22.4M 1s 2024-08-24T21:12:10.150 INFO:tasks.workunit.client.0.smithi179.stderr:130800K .......... .......... .......... .......... .......... 77% 25.5M 1s 2024-08-24T21:12:10.153 INFO:tasks.workunit.client.0.smithi179.stderr:130850K .......... .......... .......... .......... .......... 77% 22.8M 1s 2024-08-24T21:12:10.153 INFO:tasks.workunit.client.0.smithi179.stderr:130900K .......... .......... .......... .......... .......... 77% 55.6M 1s 2024-08-24T21:12:10.156 INFO:tasks.workunit.client.0.smithi179.stderr:130950K .......... .......... .......... .......... .......... 77% 20.3M 1s 2024-08-24T21:12:10.157 INFO:tasks.workunit.client.0.smithi179.stderr:131000K .......... .......... .......... .......... .......... 77% 37.9M 1s 2024-08-24T21:12:10.159 INFO:tasks.workunit.client.0.smithi179.stderr:131050K .......... .......... .......... .......... .......... 77% 22.3M 1s 2024-08-24T21:12:10.160 INFO:tasks.workunit.client.0.smithi179.stderr:131100K .......... .......... .......... .......... .......... 77% 44.2M 1s 2024-08-24T21:12:10.162 INFO:tasks.workunit.client.0.smithi179.stderr:131150K .......... .......... .......... .......... .......... 77% 24.3M 1s 2024-08-24T21:12:10.164 INFO:tasks.workunit.client.0.smithi179.stderr:131200K .......... .......... .......... .......... .......... 77% 29.7M 1s 2024-08-24T21:12:10.166 INFO:tasks.workunit.client.0.smithi179.stderr:131250K .......... .......... .......... .......... .......... 77% 22.8M 1s 2024-08-24T21:12:10.168 INFO:tasks.workunit.client.0.smithi179.stderr:131300K .......... .......... .......... .......... .......... 77% 22.9M 1s 2024-08-24T21:12:10.169 INFO:tasks.workunit.client.0.smithi179.stderr:131350K .......... .......... .......... .......... .......... 77% 38.4M 1s 2024-08-24T21:12:10.171 INFO:tasks.workunit.client.0.smithi179.stderr:131400K .......... .......... .......... .......... .......... 77% 28.4M 1s 2024-08-24T21:12:10.173 INFO:tasks.workunit.client.0.smithi179.stderr:131450K .......... .......... .......... .......... .......... 78% 38.2M 1s 2024-08-24T21:12:10.175 INFO:tasks.workunit.client.0.smithi179.stderr:131500K .......... .......... .......... .......... .......... 78% 18.2M 1s 2024-08-24T21:12:10.177 INFO:tasks.workunit.client.0.smithi179.stderr:131550K .......... .......... .......... .......... .......... 78% 23.1M 1s 2024-08-24T21:12:10.180 INFO:tasks.workunit.client.0.smithi179.stderr:131600K .......... .......... .......... .......... .......... 78% 16.8M 1s 2024-08-24T21:12:10.182 INFO:tasks.workunit.client.0.smithi179.stderr:131650K .......... .......... .......... .......... .......... 78% 32.8M 1s 2024-08-24T21:12:10.184 INFO:tasks.workunit.client.0.smithi179.stderr:131700K .......... .......... .......... .......... .......... 78% 22.3M 1s 2024-08-24T21:12:10.185 INFO:tasks.workunit.client.0.smithi179.stderr:131750K .......... .......... .......... .......... .......... 78% 27.6M 1s 2024-08-24T21:12:10.188 INFO:tasks.workunit.client.0.smithi179.stderr:131800K .......... .......... .......... .......... .......... 78% 25.4M 1s 2024-08-24T21:12:10.188 INFO:tasks.workunit.client.0.smithi179.stderr:131850K .......... .......... .......... .......... .......... 78% 51.4M 1s 2024-08-24T21:12:10.191 INFO:tasks.workunit.client.0.smithi179.stderr:131900K .......... .......... .......... .......... .......... 78% 21.7M 1s 2024-08-24T21:12:10.192 INFO:tasks.workunit.client.0.smithi179.stderr:131950K .......... .......... .......... .......... .......... 78% 25.6M 1s 2024-08-24T21:12:10.195 INFO:tasks.workunit.client.0.smithi179.stderr:132000K .......... .......... .......... .......... .......... 78% 24.2M 1s 2024-08-24T21:12:10.197 INFO:tasks.workunit.client.0.smithi179.stderr:132050K .......... .......... .......... .......... .......... 78% 21.5M 1s 2024-08-24T21:12:10.200 INFO:tasks.workunit.client.0.smithi179.stderr:132100K .......... .......... .......... .......... .......... 78% 18.4M 1s 2024-08-24T21:12:10.201 INFO:tasks.workunit.client.0.smithi179.stderr:132150K .......... .......... .......... .......... .......... 78% 61.5M 1s 2024-08-24T21:12:10.203 INFO:tasks.workunit.client.0.smithi179.stderr:132200K .......... .......... .......... .......... .......... 78% 17.1M 1s 2024-08-24T21:12:10.205 INFO:tasks.workunit.client.0.smithi179.stderr:132250K .......... .......... .......... .......... .......... 78% 34.4M 1s 2024-08-24T21:12:10.207 INFO:tasks.workunit.client.0.smithi179.stderr:132300K .......... .......... .......... .......... .......... 78% 23.7M 1s 2024-08-24T21:12:10.209 INFO:tasks.workunit.client.0.smithi179.stderr:132350K .......... .......... .......... .......... .......... 78% 21.5M 1s 2024-08-24T21:12:10.210 INFO:tasks.workunit.client.0.smithi179.stderr:132400K .......... .......... .......... .......... .......... 78% 42.8M 1s 2024-08-24T21:12:10.212 INFO:tasks.workunit.client.0.smithi179.stderr:132450K .......... .......... .......... .......... .......... 78% 24.8M 1s 2024-08-24T21:12:10.214 INFO:tasks.workunit.client.0.smithi179.stderr:132500K .......... .......... .......... .......... .......... 78% 24.8M 1s 2024-08-24T21:12:10.217 INFO:tasks.workunit.client.0.smithi179.stderr:132550K .......... .......... .......... .......... .......... 78% 17.9M 1s 2024-08-24T21:12:10.220 INFO:tasks.workunit.client.0.smithi179.stderr:132600K .......... .......... .......... .......... .......... 78% 28.1M 1s 2024-08-24T21:12:10.220 INFO:tasks.workunit.client.0.smithi179.stderr:132650K .......... .......... .......... .......... .......... 78% 82.4M 1s 2024-08-24T21:12:10.222 INFO:tasks.workunit.client.0.smithi179.stderr:132700K .......... .......... .......... .......... .......... 78% 15.9M 1s 2024-08-24T21:12:10.224 INFO:tasks.workunit.client.0.smithi179.stderr:132750K .......... .......... .......... .......... .......... 78% 31.9M 1s 2024-08-24T21:12:10.226 INFO:tasks.workunit.client.0.smithi179.stderr:132800K .......... .......... .......... .......... .......... 78% 24.5M 1s 2024-08-24T21:12:10.228 INFO:tasks.workunit.client.0.smithi179.stderr:132850K .......... .......... .......... .......... .......... 78% 24.0M 1s 2024-08-24T21:12:10.229 INFO:tasks.workunit.client.0.smithi179.stderr:132900K .......... .......... .......... .......... .......... 78% 47.9M 1s 2024-08-24T21:12:10.231 INFO:tasks.workunit.client.0.smithi179.stderr:132950K .......... .......... .......... .......... .......... 78% 24.3M 1s 2024-08-24T21:12:10.232 INFO:tasks.workunit.client.0.smithi179.stderr:133000K .......... .......... .......... .......... .......... 78% 36.9M 1s 2024-08-24T21:12:10.234 INFO:tasks.workunit.client.0.smithi179.stderr:133050K .......... .......... .......... .......... .......... 78% 24.2M 1s 2024-08-24T21:12:10.235 INFO:tasks.workunit.client.0.smithi179.stderr:133100K .......... .......... .......... .......... .......... 78% 40.6M 1s 2024-08-24T21:12:10.238 INFO:tasks.workunit.client.0.smithi179.stderr:133150K .......... .......... .......... .......... .......... 79% 17.7M 1s 2024-08-24T21:12:10.239 INFO:tasks.workunit.client.0.smithi179.stderr:133200K .......... .......... .......... .......... .......... 79% 44.2M 1s 2024-08-24T21:12:10.241 INFO:tasks.workunit.client.0.smithi179.stderr:133250K .......... .......... .......... .......... .......... 79% 24.9M 1s 2024-08-24T21:12:10.243 INFO:tasks.workunit.client.0.smithi179.stderr:133300K .......... .......... .......... .......... .......... 79% 37.7M 1s 2024-08-24T21:12:10.244 INFO:tasks.workunit.client.0.smithi179.stderr:133350K .......... .......... .......... .......... .......... 79% 24.3M 1s 2024-08-24T21:12:10.245 INFO:tasks.workunit.client.0.smithi179.stderr:133400K .......... .......... .......... .......... .......... 79% 45.1M 1s 2024-08-24T21:12:10.248 INFO:tasks.workunit.client.0.smithi179.stderr:133450K .......... .......... .......... .......... .......... 79% 19.1M 1s 2024-08-24T21:12:10.249 INFO:tasks.workunit.client.0.smithi179.stderr:133500K .......... .......... .......... .......... .......... 79% 46.2M 1s 2024-08-24T21:12:10.251 INFO:tasks.workunit.client.0.smithi179.stderr:133550K .......... .......... .......... .......... .......... 79% 24.4M 1s 2024-08-24T21:12:10.253 INFO:tasks.workunit.client.0.smithi179.stderr:133600K .......... .......... .......... .......... .......... 79% 24.6M 1s 2024-08-24T21:12:10.254 INFO:tasks.workunit.client.0.smithi179.stderr:133650K .......... .......... .......... .......... .......... 79% 38.2M 1s 2024-08-24T21:12:10.256 INFO:tasks.workunit.client.0.smithi179.stderr:133700K .......... .......... .......... .......... .......... 79% 25.3M 1s 2024-08-24T21:12:10.259 INFO:tasks.workunit.client.0.smithi179.stderr:133750K .......... .......... .......... .......... .......... 79% 21.1M 1s 2024-08-24T21:12:10.260 INFO:tasks.workunit.client.0.smithi179.stderr:133800K .......... .......... .......... .......... .......... 79% 41.6M 1s 2024-08-24T21:12:10.262 INFO:tasks.workunit.client.0.smithi179.stderr:133850K .......... .......... .......... .......... .......... 79% 25.1M 1s 2024-08-24T21:12:10.263 INFO:tasks.workunit.client.0.smithi179.stderr:133900K .......... .......... .......... .......... .......... 79% 39.6M 1s 2024-08-24T21:12:10.265 INFO:tasks.workunit.client.0.smithi179.stderr:133950K .......... .......... .......... .......... .......... 79% 25.1M 1s 2024-08-24T21:12:10.267 INFO:tasks.workunit.client.0.smithi179.stderr:134000K .......... .......... .......... .......... .......... 79% 24.1M 1s 2024-08-24T21:12:10.268 INFO:tasks.workunit.client.0.smithi179.stderr:134050K .......... .......... .......... .......... .......... 79% 37.1M 1s 2024-08-24T21:12:10.270 INFO:tasks.workunit.client.0.smithi179.stderr:134100K .......... .......... .......... .......... .......... 79% 26.4M 1s 2024-08-24T21:12:10.272 INFO:tasks.workunit.client.0.smithi179.stderr:134150K .......... .......... .......... .......... .......... 79% 36.9M 1s 2024-08-24T21:12:10.274 INFO:tasks.workunit.client.0.smithi179.stderr:134200K .......... .......... .......... .......... .......... 79% 23.0M 1s 2024-08-24T21:12:10.276 INFO:tasks.workunit.client.0.smithi179.stderr:134250K .......... .......... .......... .......... .......... 79% 19.6M 1s 2024-08-24T21:12:10.277 INFO:tasks.workunit.client.0.smithi179.stderr:134300K .......... .......... .......... .......... .......... 79% 51.9M 1s 2024-08-24T21:12:10.279 INFO:tasks.workunit.client.0.smithi179.stderr:134350K .......... .......... .......... .......... .......... 79% 23.1M 1s 2024-08-24T21:12:10.281 INFO:tasks.workunit.client.0.smithi179.stderr:134400K .......... .......... .......... .......... .......... 79% 23.3M 1s 2024-08-24T21:12:10.282 INFO:tasks.workunit.client.0.smithi179.stderr:134450K .......... .......... .......... .......... .......... 79% 38.0M 1s 2024-08-24T21:12:10.284 INFO:tasks.workunit.client.0.smithi179.stderr:134500K .......... .......... .......... .......... .......... 79% 27.0M 1s 2024-08-24T21:12:10.285 INFO:tasks.workunit.client.0.smithi179.stderr:134550K .......... .......... .......... .......... .......... 79% 39.9M 1s 2024-08-24T21:12:10.288 INFO:tasks.workunit.client.0.smithi179.stderr:134600K .......... .......... .......... .......... .......... 79% 22.0M 1s 2024-08-24T21:12:10.289 INFO:tasks.workunit.client.0.smithi179.stderr:134650K .......... .......... .......... .......... .......... 79% 50.2M 1s 2024-08-24T21:12:10.291 INFO:tasks.workunit.client.0.smithi179.stderr:134700K .......... .......... .......... .......... .......... 79% 24.6M 1s 2024-08-24T21:12:10.293 INFO:tasks.workunit.client.0.smithi179.stderr:134750K .......... .......... .......... .......... .......... 79% 23.0M 1s 2024-08-24T21:12:10.295 INFO:tasks.workunit.client.0.smithi179.stderr:134800K .......... .......... .......... .......... .......... 79% 24.3M 1s 2024-08-24T21:12:10.296 INFO:tasks.workunit.client.0.smithi179.stderr:134850K .......... .......... .......... .......... .......... 80% 43.7M 1s 2024-08-24T21:12:10.298 INFO:tasks.workunit.client.0.smithi179.stderr:134900K .......... .......... .......... .......... .......... 80% 24.7M 1s 2024-08-24T21:12:10.299 INFO:tasks.workunit.client.0.smithi179.stderr:134950K .......... .......... .......... .......... .......... 80% 37.3M 1s 2024-08-24T21:12:10.301 INFO:tasks.workunit.client.0.smithi179.stderr:135000K .......... .......... .......... .......... .......... 80% 22.8M 1s 2024-08-24T21:12:10.302 INFO:tasks.workunit.client.0.smithi179.stderr:135050K .......... .......... .......... .......... .......... 80% 49.1M 1s 2024-08-24T21:12:10.305 INFO:tasks.workunit.client.0.smithi179.stderr:135100K .......... .......... .......... .......... .......... 80% 22.9M 1s 2024-08-24T21:12:10.307 INFO:tasks.workunit.client.0.smithi179.stderr:135150K .......... .......... .......... .......... .......... 80% 24.2M 1s 2024-08-24T21:12:10.308 INFO:tasks.workunit.client.0.smithi179.stderr:135200K .......... .......... .......... .......... .......... 80% 40.3M 1s 2024-08-24T21:12:10.310 INFO:tasks.workunit.client.0.smithi179.stderr:135250K .......... .......... .......... .......... .......... 80% 20.9M 1s 2024-08-24T21:12:10.311 INFO:tasks.workunit.client.0.smithi179.stderr:135300K .......... .......... .......... .......... .......... 80% 44.7M 1s 2024-08-24T21:12:10.313 INFO:tasks.workunit.client.0.smithi179.stderr:135350K .......... .......... .......... .......... .......... 80% 22.3M 1s 2024-08-24T21:12:10.315 INFO:tasks.workunit.client.0.smithi179.stderr:135400K .......... .......... .......... .......... .......... 80% 32.6M 1s 2024-08-24T21:12:10.316 INFO:tasks.workunit.client.0.smithi179.stderr:135450K .......... .......... .......... .......... .......... 80% 31.0M 1s 2024-08-24T21:12:10.319 INFO:tasks.workunit.client.0.smithi179.stderr:135500K .......... .......... .......... .......... .......... 80% 22.3M 1s 2024-08-24T21:12:10.321 INFO:tasks.workunit.client.0.smithi179.stderr:135550K .......... .......... .......... .......... .......... 80% 23.3M 1s 2024-08-24T21:12:10.322 INFO:tasks.workunit.client.0.smithi179.stderr:135600K .......... .......... .......... .......... .......... 80% 46.5M 1s 2024-08-24T21:12:10.325 INFO:tasks.workunit.client.0.smithi179.stderr:135650K .......... .......... .......... .......... .......... 80% 18.0M 1s 2024-08-24T21:12:10.333 INFO:tasks.workunit.client.0.smithi179.stderr:135700K .......... .......... .......... .......... .......... 80% 11.2M 1s 2024-08-24T21:12:10.333 INFO:tasks.workunit.client.0.smithi179.stderr:135750K .......... .......... .......... .......... .......... 80% 158M 1s 2024-08-24T21:12:10.333 INFO:tasks.workunit.client.0.smithi179.stderr:135800K .......... .......... .......... .......... .......... 80% 198M 1s 2024-08-24T21:12:10.333 INFO:tasks.workunit.client.0.smithi179.stderr:135850K .......... .......... .......... .......... .......... 80% 41.6M 1s 2024-08-24T21:12:10.333 INFO:tasks.workunit.client.0.smithi179.stderr:135900K .......... .......... .......... .......... .......... 80% 39.1M 1s 2024-08-24T21:12:10.336 INFO:tasks.workunit.client.0.smithi179.stderr:135950K .......... .......... .......... .......... .......... 80% 13.6M 1s 2024-08-24T21:12:10.337 INFO:tasks.workunit.client.0.smithi179.stderr:136000K .......... .......... .......... .......... .......... 80% 46.7M 1s 2024-08-24T21:12:10.338 INFO:tasks.workunit.client.0.smithi179.stderr:136050K .......... .......... .......... .......... .......... 80% 34.9M 1s 2024-08-24T21:12:10.340 INFO:tasks.workunit.client.0.smithi179.stderr:136100K .......... .......... .......... .......... .......... 80% 28.1M 1s 2024-08-24T21:12:10.342 INFO:tasks.workunit.client.0.smithi179.stderr:136150K .......... .......... .......... .......... .......... 80% 22.7M 1s 2024-08-24T21:12:10.343 INFO:tasks.workunit.client.0.smithi179.stderr:136200K .......... .......... .......... .......... .......... 80% 45.7M 1s 2024-08-24T21:12:10.345 INFO:tasks.workunit.client.0.smithi179.stderr:136250K .......... .......... .......... .......... .......... 80% 21.9M 1s 2024-08-24T21:12:10.346 INFO:tasks.workunit.client.0.smithi179.stderr:136300K .......... .......... .......... .......... .......... 80% 46.9M 1s 2024-08-24T21:12:10.348 INFO:tasks.workunit.client.0.smithi179.stderr:136350K .......... .......... .......... .......... .......... 80% 20.5M 1s 2024-08-24T21:12:10.351 INFO:tasks.workunit.client.0.smithi179.stderr:136400K .......... .......... .......... .......... .......... 80% 24.7M 1s 2024-08-24T21:12:10.352 INFO:tasks.workunit.client.0.smithi179.stderr:136450K .......... .......... .......... .......... .......... 80% 43.0M 1s 2024-08-24T21:12:10.353 INFO:tasks.workunit.client.0.smithi179.stderr:136500K .......... .......... .......... .......... .......... 81% 27.2M 1s 2024-08-24T21:12:10.356 INFO:tasks.workunit.client.0.smithi179.stderr:136550K .......... .......... .......... .......... .......... 81% 30.3M 1s 2024-08-24T21:12:10.358 INFO:tasks.workunit.client.0.smithi179.stderr:136600K .......... .......... .......... .......... .......... 81% 23.7M 1s 2024-08-24T21:12:10.359 INFO:tasks.workunit.client.0.smithi179.stderr:136650K .......... .......... .......... .......... .......... 81% 23.2M 1s 2024-08-24T21:12:10.361 INFO:tasks.workunit.client.0.smithi179.stderr:136700K .......... .......... .......... .......... .......... 81% 27.5M 1s 2024-08-24T21:12:10.363 INFO:tasks.workunit.client.0.smithi179.stderr:136750K .......... .......... .......... .......... .......... 81% 24.6M 1s 2024-08-24T21:12:10.365 INFO:tasks.workunit.client.0.smithi179.stderr:136800K .......... .......... .......... .......... .......... 81% 23.7M 1s 2024-08-24T21:12:10.366 INFO:tasks.workunit.client.0.smithi179.stderr:136850K .......... .......... .......... .......... .......... 81% 38.8M 1s 2024-08-24T21:12:10.369 INFO:tasks.workunit.client.0.smithi179.stderr:136900K .......... .......... .......... .......... .......... 81% 24.1M 1s 2024-08-24T21:12:10.370 INFO:tasks.workunit.client.0.smithi179.stderr:136950K .......... .......... .......... .......... .......... 81% 34.7M 1s 2024-08-24T21:12:10.372 INFO:tasks.workunit.client.0.smithi179.stderr:137000K .......... .......... .......... .......... .......... 81% 22.3M 1s 2024-08-24T21:12:10.373 INFO:tasks.workunit.client.0.smithi179.stderr:137050K .......... .......... .......... .......... .......... 81% 34.8M 1s 2024-08-24T21:12:10.375 INFO:tasks.workunit.client.0.smithi179.stderr:137100K .......... .......... .......... .......... .......... 81% 25.0M 1s 2024-08-24T21:12:10.378 INFO:tasks.workunit.client.0.smithi179.stderr:137150K .......... .......... .......... .......... .......... 81% 18.5M 1s 2024-08-24T21:12:10.380 INFO:tasks.workunit.client.0.smithi179.stderr:137200K .......... .......... .......... .......... .......... 81% 28.9M 1s 2024-08-24T21:12:10.381 INFO:tasks.workunit.client.0.smithi179.stderr:137250K .......... .......... .......... .......... .......... 81% 33.4M 1s 2024-08-24T21:12:10.383 INFO:tasks.workunit.client.0.smithi179.stderr:137300K .......... .......... .......... .......... .......... 81% 27.9M 1s 2024-08-24T21:12:10.384 INFO:tasks.workunit.client.0.smithi179.stderr:137350K .......... .......... .......... .......... .......... 81% 33.3M 1s 2024-08-24T21:12:10.386 INFO:tasks.workunit.client.0.smithi179.stderr:137400K .......... .......... .......... .......... .......... 81% 25.0M 1s 2024-08-24T21:12:10.387 INFO:tasks.workunit.client.0.smithi179.stderr:137450K .......... .......... .......... .......... .......... 81% 47.5M 1s 2024-08-24T21:12:10.389 INFO:tasks.workunit.client.0.smithi179.stderr:137500K .......... .......... .......... .......... .......... 81% 31.4M 1s 2024-08-24T21:12:10.392 INFO:tasks.workunit.client.0.smithi179.stderr:137550K .......... .......... .......... .......... .......... 81% 18.0M 1s 2024-08-24T21:12:10.393 INFO:tasks.workunit.client.0.smithi179.stderr:137600K .......... .......... .......... .......... .......... 81% 31.4M 1s 2024-08-24T21:12:10.396 INFO:tasks.workunit.client.0.smithi179.stderr:137650K .......... .......... .......... .......... .......... 81% 22.4M 1s 2024-08-24T21:12:10.397 INFO:tasks.workunit.client.0.smithi179.stderr:137700K .......... .......... .......... .......... .......... 81% 27.2M 1s 2024-08-24T21:12:10.398 INFO:tasks.workunit.client.0.smithi179.stderr:137750K .......... .......... .......... .......... .......... 81% 39.3M 1s 2024-08-24T21:12:10.401 INFO:tasks.workunit.client.0.smithi179.stderr:137800K .......... .......... .......... .......... .......... 81% 20.8M 1s 2024-08-24T21:12:10.402 INFO:tasks.workunit.client.0.smithi179.stderr:137850K .......... .......... .......... .......... .......... 81% 30.3M 1s 2024-08-24T21:12:10.404 INFO:tasks.workunit.client.0.smithi179.stderr:137900K .......... .......... .......... .......... .......... 81% 25.4M 1s 2024-08-24T21:12:10.406 INFO:tasks.workunit.client.0.smithi179.stderr:137950K .......... .......... .......... .......... .......... 81% 24.0M 1s 2024-08-24T21:12:10.408 INFO:tasks.workunit.client.0.smithi179.stderr:138000K .......... .......... .......... .......... .......... 81% 27.6M 1s 2024-08-24T21:12:10.410 INFO:tasks.workunit.client.0.smithi179.stderr:138050K .......... .......... .......... .......... .......... 81% 27.9M 1s 2024-08-24T21:12:10.411 INFO:tasks.workunit.client.0.smithi179.stderr:138100K .......... .......... .......... .......... .......... 81% 33.1M 1s 2024-08-24T21:12:10.413 INFO:tasks.workunit.client.0.smithi179.stderr:138150K .......... .......... .......... .......... .......... 81% 26.9M 1s 2024-08-24T21:12:10.416 INFO:tasks.workunit.client.0.smithi179.stderr:138200K .......... .......... .......... .......... .......... 82% 23.1M 1s 2024-08-24T21:12:10.416 INFO:tasks.workunit.client.0.smithi179.stderr:138250K .......... .......... .......... .......... .......... 82% 50.4M 1s 2024-08-24T21:12:10.418 INFO:tasks.workunit.client.0.smithi179.stderr:138300K .......... .......... .......... .......... .......... 82% 22.1M 1s 2024-08-24T21:12:10.420 INFO:tasks.workunit.client.0.smithi179.stderr:138350K .......... .......... .......... .......... .......... 82% 22.9M 1s 2024-08-24T21:12:10.422 INFO:tasks.workunit.client.0.smithi179.stderr:138400K .......... .......... .......... .......... .......... 82% 32.7M 1s 2024-08-24T21:12:10.425 INFO:tasks.workunit.client.0.smithi179.stderr:138450K .......... .......... .......... .......... .......... 82% 21.4M 1s 2024-08-24T21:12:10.425 INFO:tasks.workunit.client.0.smithi179.stderr:138500K .......... .......... .......... .......... .......... 82% 54.0M 1s 2024-08-24T21:12:10.427 INFO:tasks.workunit.client.0.smithi179.stderr:138550K .......... .......... .......... .......... .......... 82% 22.0M 1s 2024-08-24T21:12:10.428 INFO:tasks.workunit.client.0.smithi179.stderr:138600K .......... .......... .......... .......... .......... 82% 37.0M 1s 2024-08-24T21:12:10.431 INFO:tasks.workunit.client.0.smithi179.stderr:138650K .......... .......... .......... .......... .......... 82% 24.4M 1s 2024-08-24T21:12:10.432 INFO:tasks.workunit.client.0.smithi179.stderr:138700K .......... .......... .......... .......... .......... 82% 51.2M 1s 2024-08-24T21:12:10.434 INFO:tasks.workunit.client.0.smithi179.stderr:138750K .......... .......... .......... .......... .......... 82% 22.4M 1s 2024-08-24T21:12:10.436 INFO:tasks.workunit.client.0.smithi179.stderr:138800K .......... .......... .......... .......... .......... 82% 24.2M 1s 2024-08-24T21:12:10.438 INFO:tasks.workunit.client.0.smithi179.stderr:138850K .......... .......... .......... .......... .......... 82% 24.7M 1s 2024-08-24T21:12:10.439 INFO:tasks.workunit.client.0.smithi179.stderr:138900K .......... .......... .......... .......... .......... 82% 35.9M 1s 2024-08-24T21:12:10.441 INFO:tasks.workunit.client.0.smithi179.stderr:138950K .......... .......... .......... .......... .......... 82% 24.2M 1s 2024-08-24T21:12:10.442 INFO:tasks.workunit.client.0.smithi179.stderr:139000K .......... .......... .......... .......... .......... 82% 45.9M 1s 2024-08-24T21:12:10.444 INFO:tasks.workunit.client.0.smithi179.stderr:139050K .......... .......... .......... .......... .......... 82% 22.0M 1s 2024-08-24T21:12:10.447 INFO:tasks.workunit.client.0.smithi179.stderr:139100K .......... .......... .......... .......... .......... 82% 29.3M 1s 2024-08-24T21:12:10.448 INFO:tasks.workunit.client.0.smithi179.stderr:139150K .......... .......... .......... .......... .......... 82% 24.1M 1s 2024-08-24T21:12:10.451 INFO:tasks.workunit.client.0.smithi179.stderr:139200K .......... .......... .......... .......... .......... 82% 22.2M 1s 2024-08-24T21:12:10.452 INFO:tasks.workunit.client.0.smithi179.stderr:139250K .......... .......... .......... .......... .......... 82% 39.7M 1s 2024-08-24T21:12:10.454 INFO:tasks.workunit.client.0.smithi179.stderr:139300K .......... .......... .......... .......... .......... 82% 26.5M 1s 2024-08-24T21:12:10.456 INFO:tasks.workunit.client.0.smithi179.stderr:139350K .......... .......... .......... .......... .......... 82% 22.8M 1s 2024-08-24T21:12:10.456 INFO:tasks.workunit.client.0.smithi179.stderr:139400K .......... .......... .......... .......... .......... 82% 53.7M 1s 2024-08-24T21:12:10.459 INFO:tasks.workunit.client.0.smithi179.stderr:139450K .......... .......... .......... .......... .......... 82% 16.6M 1s 2024-08-24T21:12:10.460 INFO:tasks.workunit.client.0.smithi179.stderr:139500K .......... .......... .......... .......... .......... 82% 43.5M 1s 2024-08-24T21:12:10.463 INFO:tasks.workunit.client.0.smithi179.stderr:139550K .......... .......... .......... .......... .......... 82% 22.9M 1s 2024-08-24T21:12:10.465 INFO:tasks.workunit.client.0.smithi179.stderr:139600K .......... .......... .......... .......... .......... 82% 21.9M 1s 2024-08-24T21:12:10.466 INFO:tasks.workunit.client.0.smithi179.stderr:139650K .......... .......... .......... .......... .......... 82% 31.5M 1s 2024-08-24T21:12:10.468 INFO:tasks.workunit.client.0.smithi179.stderr:139700K .......... .......... .......... .......... .......... 82% 26.0M 1s 2024-08-24T21:12:10.470 INFO:tasks.workunit.client.0.smithi179.stderr:139750K .......... .......... .......... .......... .......... 82% 37.0M 1s 2024-08-24T21:12:10.472 INFO:tasks.workunit.client.0.smithi179.stderr:139800K .......... .......... .......... .......... .......... 82% 23.4M 1s 2024-08-24T21:12:10.473 INFO:tasks.workunit.client.0.smithi179.stderr:139850K .......... .......... .......... .......... .......... 82% 43.8M 1s 2024-08-24T21:12:10.476 INFO:tasks.workunit.client.0.smithi179.stderr:139900K .......... .......... .......... .......... .......... 83% 20.3M 1s 2024-08-24T21:12:10.477 INFO:tasks.workunit.client.0.smithi179.stderr:139950K .......... .......... .......... .......... .......... 83% 27.2M 1s 2024-08-24T21:12:10.480 INFO:tasks.workunit.client.0.smithi179.stderr:140000K .......... .......... .......... .......... .......... 83% 17.9M 1s 2024-08-24T21:12:10.481 INFO:tasks.workunit.client.0.smithi179.stderr:140050K .......... .......... .......... .......... .......... 83% 46.9M 1s 2024-08-24T21:12:10.483 INFO:tasks.workunit.client.0.smithi179.stderr:140100K .......... .......... .......... .......... .......... 83% 23.3M 1s 2024-08-24T21:12:10.484 INFO:tasks.workunit.client.0.smithi179.stderr:140150K .......... .......... .......... .......... .......... 83% 38.2M 1s 2024-08-24T21:12:10.487 INFO:tasks.workunit.client.0.smithi179.stderr:140200K .......... .......... .......... .......... .......... 83% 18.8M 1s 2024-08-24T21:12:10.488 INFO:tasks.workunit.client.0.smithi179.stderr:140250K .......... .......... .......... .......... .......... 83% 59.5M 1s 2024-08-24T21:12:10.490 INFO:tasks.workunit.client.0.smithi179.stderr:140300K .......... .......... .......... .......... .......... 83% 22.5M 1s 2024-08-24T21:12:10.492 INFO:tasks.workunit.client.0.smithi179.stderr:140350K .......... .......... .......... .......... .......... 83% 23.5M 1s 2024-08-24T21:12:10.493 INFO:tasks.workunit.client.0.smithi179.stderr:140400K .......... .......... .......... .......... .......... 83% 28.6M 1s 2024-08-24T21:12:10.495 INFO:tasks.workunit.client.0.smithi179.stderr:140450K .......... .......... .......... .......... .......... 83% 28.2M 1s 2024-08-24T21:12:10.498 INFO:tasks.workunit.client.0.smithi179.stderr:140500K .......... .......... .......... .......... .......... 83% 23.0M 1s 2024-08-24T21:12:10.499 INFO:tasks.workunit.client.0.smithi179.stderr:140550K .......... .......... .......... .......... .......... 83% 30.5M 1s 2024-08-24T21:12:10.501 INFO:tasks.workunit.client.0.smithi179.stderr:140600K .......... .......... .......... .......... .......... 83% 23.9M 1s 2024-08-24T21:12:10.503 INFO:tasks.workunit.client.0.smithi179.stderr:140650K .......... .......... .......... .......... .......... 83% 33.4M 1s 2024-08-24T21:12:10.504 INFO:tasks.workunit.client.0.smithi179.stderr:140700K .......... .......... .......... .......... .......... 83% 26.7M 1s 2024-08-24T21:12:10.507 INFO:tasks.workunit.client.0.smithi179.stderr:140750K .......... .......... .......... .......... .......... 83% 24.9M 1s 2024-08-24T21:12:10.508 INFO:tasks.workunit.client.0.smithi179.stderr:140800K .......... .......... .......... .......... .......... 83% 41.9M 1s 2024-08-24T21:12:10.510 INFO:tasks.workunit.client.0.smithi179.stderr:140850K .......... .......... .......... .......... .......... 83% 23.8M 1s 2024-08-24T21:12:10.511 INFO:tasks.workunit.client.0.smithi179.stderr:140900K .......... .......... .......... .......... .......... 83% 34.1M 1s 2024-08-24T21:12:10.514 INFO:tasks.workunit.client.0.smithi179.stderr:140950K .......... .......... .......... .......... .......... 83% 23.4M 1s 2024-08-24T21:12:10.514 INFO:tasks.workunit.client.0.smithi179.stderr:141000K .......... .......... .......... .......... .......... 83% 57.0M 1s 2024-08-24T21:12:10.516 INFO:tasks.workunit.client.0.smithi179.stderr:141050K .......... .......... .......... .......... .......... 83% 24.7M 1s 2024-08-24T21:12:10.518 INFO:tasks.workunit.client.0.smithi179.stderr:141100K .......... .......... .......... .......... .......... 83% 23.3M 1s 2024-08-24T21:12:10.520 INFO:tasks.workunit.client.0.smithi179.stderr:141150K .......... .......... .......... .......... .......... 83% 23.8M 1s 2024-08-24T21:12:10.521 INFO:tasks.workunit.client.0.smithi179.stderr:141200K .......... .......... .......... .......... .......... 83% 41.8M 1s 2024-08-24T21:12:10.523 INFO:tasks.workunit.client.0.smithi179.stderr:141250K .......... .......... .......... .......... .......... 83% 24.2M 1s 2024-08-24T21:12:10.524 INFO:tasks.workunit.client.0.smithi179.stderr:141300K .......... .......... .......... .......... .......... 83% 41.8M 1s 2024-08-24T21:12:10.527 INFO:tasks.workunit.client.0.smithi179.stderr:141350K .......... .......... .......... .......... .......... 83% 24.2M 1s 2024-08-24T21:12:10.529 INFO:tasks.workunit.client.0.smithi179.stderr:141400K .......... .......... .......... .......... .......... 83% 24.6M 1s 2024-08-24T21:12:10.530 INFO:tasks.workunit.client.0.smithi179.stderr:141450K .......... .......... .......... .......... .......... 83% 37.7M 1s 2024-08-24T21:12:10.531 INFO:tasks.workunit.client.0.smithi179.stderr:141500K .......... .......... .......... .......... .......... 83% 47.4M 1s 2024-08-24T21:12:10.533 INFO:tasks.workunit.client.0.smithi179.stderr:141550K .......... .......... .......... .......... .......... 84% 23.8M 1s 2024-08-24T21:12:10.535 INFO:tasks.workunit.client.0.smithi179.stderr:141600K .......... .......... .......... .......... .......... 84% 23.8M 1s 2024-08-24T21:12:10.537 INFO:tasks.workunit.client.0.smithi179.stderr:141650K .......... .......... .......... .......... .......... 84% 24.4M 1s 2024-08-24T21:12:10.539 INFO:tasks.workunit.client.0.smithi179.stderr:141700K .......... .......... .......... .......... .......... 84% 36.5M 1s 2024-08-24T21:12:10.540 INFO:tasks.workunit.client.0.smithi179.stderr:141750K .......... .......... .......... .......... .......... 84% 24.1M 1s 2024-08-24T21:12:10.541 INFO:tasks.workunit.client.0.smithi179.stderr:141800K .......... .......... .......... .......... .......... 84% 44.2M 1s 2024-08-24T21:12:10.543 INFO:tasks.workunit.client.0.smithi179.stderr:141850K .......... .......... .......... .......... .......... 84% 24.8M 1s 2024-08-24T21:12:10.544 INFO:tasks.workunit.client.0.smithi179.stderr:141900K .......... .......... .......... .......... .......... 84% 41.2M 1s 2024-08-24T21:12:10.547 INFO:tasks.workunit.client.0.smithi179.stderr:141950K .......... .......... .......... .......... .......... 84% 21.4M 1s 2024-08-24T21:12:10.549 INFO:tasks.workunit.client.0.smithi179.stderr:142000K .......... .......... .......... .......... .......... 84% 20.1M 1s 2024-08-24T21:12:10.550 INFO:tasks.workunit.client.0.smithi179.stderr:142050K .......... .......... .......... .......... .......... 84% 47.0M 1s 2024-08-24T21:12:10.553 INFO:tasks.workunit.client.0.smithi179.stderr:142100K .......... .......... .......... .......... .......... 84% 17.9M 1s 2024-08-24T21:12:10.556 INFO:tasks.workunit.client.0.smithi179.stderr:142150K .......... .......... .......... .......... .......... 84% 18.7M 1s 2024-08-24T21:12:10.557 INFO:tasks.workunit.client.0.smithi179.stderr:142200K .......... .......... .......... .......... .......... 84% 35.3M 1s 2024-08-24T21:12:10.558 INFO:tasks.workunit.client.0.smithi179.stderr:142250K .......... .......... .......... .......... .......... 84% 40.5M 1s 2024-08-24T21:12:10.560 INFO:tasks.workunit.client.0.smithi179.stderr:142300K .......... .......... .......... .......... .......... 84% 28.9M 1s 2024-08-24T21:12:10.562 INFO:tasks.workunit.client.0.smithi179.stderr:142350K .......... .......... .......... .......... .......... 84% 20.7M 1s 2024-08-24T21:12:10.565 INFO:tasks.workunit.client.0.smithi179.stderr:142400K .......... .......... .......... .......... .......... 84% 16.3M 1s 2024-08-24T21:12:10.567 INFO:tasks.workunit.client.0.smithi179.stderr:142450K .......... .......... .......... .......... .......... 84% 27.8M 1s 2024-08-24T21:12:10.569 INFO:tasks.workunit.client.0.smithi179.stderr:142500K .......... .......... .......... .......... .......... 84% 26.3M 1s 2024-08-24T21:12:10.570 INFO:tasks.workunit.client.0.smithi179.stderr:142550K .......... .......... .......... .......... .......... 84% 45.1M 1s 2024-08-24T21:12:10.572 INFO:tasks.workunit.client.0.smithi179.stderr:142600K .......... .......... .......... .......... .......... 84% 23.0M 1s 2024-08-24T21:12:10.574 INFO:tasks.workunit.client.0.smithi179.stderr:142650K .......... .......... .......... .......... .......... 84% 28.6M 1s 2024-08-24T21:12:10.576 INFO:tasks.workunit.client.0.smithi179.stderr:142700K .......... .......... .......... .......... .......... 84% 26.7M 1s 2024-08-24T21:12:10.579 INFO:tasks.workunit.client.0.smithi179.stderr:142750K .......... .......... .......... .......... .......... 84% 17.6M 1s 2024-08-24T21:12:10.580 INFO:tasks.workunit.client.0.smithi179.stderr:142800K .......... .......... .......... .......... .......... 84% 26.4M 1s 2024-08-24T21:12:10.582 INFO:tasks.workunit.client.0.smithi179.stderr:142850K .......... .......... .......... .......... .......... 84% 32.3M 1s 2024-08-24T21:12:10.584 INFO:tasks.workunit.client.0.smithi179.stderr:142900K .......... .......... .......... .......... .......... 84% 24.4M 1s 2024-08-24T21:12:10.585 INFO:tasks.workunit.client.0.smithi179.stderr:142950K .......... .......... .......... .......... .......... 84% 42.4M 1s 2024-08-24T21:12:10.587 INFO:tasks.workunit.client.0.smithi179.stderr:143000K .......... .......... .......... .......... .......... 84% 24.4M 1s 2024-08-24T21:12:10.588 INFO:tasks.workunit.client.0.smithi179.stderr:143050K .......... .......... .......... .......... .......... 84% 37.4M 1s 2024-08-24T21:12:10.590 INFO:tasks.workunit.client.0.smithi179.stderr:143100K .......... .......... .......... .......... .......... 84% 24.8M 1s 2024-08-24T21:12:10.592 INFO:tasks.workunit.client.0.smithi179.stderr:143150K .......... .......... .......... .......... .......... 84% 24.3M 1s 2024-08-24T21:12:10.594 INFO:tasks.workunit.client.0.smithi179.stderr:143200K .......... .......... .......... .......... .......... 84% 32.4M 1s 2024-08-24T21:12:10.595 INFO:tasks.workunit.client.0.smithi179.stderr:143250K .......... .......... .......... .......... .......... 85% 28.8M 1s 2024-08-24T21:12:10.598 INFO:tasks.workunit.client.0.smithi179.stderr:143300K .......... .......... .......... .......... .......... 85% 22.9M 1s 2024-08-24T21:12:10.598 INFO:tasks.workunit.client.0.smithi179.stderr:143350K .......... .......... .......... .......... .......... 85% 45.2M 1s 2024-08-24T21:12:10.601 INFO:tasks.workunit.client.0.smithi179.stderr:143400K .......... .......... .......... .......... .......... 85% 24.1M 1s 2024-08-24T21:12:10.602 INFO:tasks.workunit.client.0.smithi179.stderr:143450K .......... .......... .......... .......... .......... 85% 36.3M 1s 2024-08-24T21:12:10.604 INFO:tasks.workunit.client.0.smithi179.stderr:143500K .......... .......... .......... .......... .......... 85% 26.8M 1s 2024-08-24T21:12:10.607 INFO:tasks.workunit.client.0.smithi179.stderr:143550K .......... .......... .......... .......... .......... 85% 21.2M 1s 2024-08-24T21:12:10.607 INFO:tasks.workunit.client.0.smithi179.stderr:143600K .......... .......... .......... .......... .......... 85% 54.5M 1s 2024-08-24T21:12:10.609 INFO:tasks.workunit.client.0.smithi179.stderr:143650K .......... .......... .......... .......... .......... 85% 25.3M 1s 2024-08-24T21:12:10.611 INFO:tasks.workunit.client.0.smithi179.stderr:143700K .......... .......... .......... .......... .......... 85% 28.2M 1s 2024-08-24T21:12:10.612 INFO:tasks.workunit.client.0.smithi179.stderr:143750K .......... .......... .......... .......... .......... 85% 27.8M 1s 2024-08-24T21:12:10.613 INFO:tasks.workunit.client.0.smithi179.stderr:143800K .......... .......... .......... .......... .......... 85% 38.7M 1s 2024-08-24T21:12:10.615 INFO:tasks.workunit.client.0.smithi179.stderr:143850K .......... .......... .......... .......... .......... 85% 24.1M 1s 2024-08-24T21:12:10.618 INFO:tasks.workunit.client.0.smithi179.stderr:143900K .......... .......... .......... .......... .......... 85% 33.8M 1s 2024-08-24T21:12:10.620 INFO:tasks.workunit.client.0.smithi179.stderr:143950K .......... .......... .......... .......... .......... 85% 19.2M 1s 2024-08-24T21:12:10.621 INFO:tasks.workunit.client.0.smithi179.stderr:144000K .......... .......... .......... .......... .......... 85% 33.3M 1s 2024-08-24T21:12:10.623 INFO:tasks.workunit.client.0.smithi179.stderr:144050K .......... .......... .......... .......... .......... 85% 23.7M 1s 2024-08-24T21:12:10.624 INFO:tasks.workunit.client.0.smithi179.stderr:144100K .......... .......... .......... .......... .......... 85% 41.9M 1s 2024-08-24T21:12:10.627 INFO:tasks.workunit.client.0.smithi179.stderr:144150K .......... .......... .......... .......... .......... 85% 21.7M 1s 2024-08-24T21:12:10.628 INFO:tasks.workunit.client.0.smithi179.stderr:144200K .......... .......... .......... .......... .......... 85% 44.0M 1s 2024-08-24T21:12:10.630 INFO:tasks.workunit.client.0.smithi179.stderr:144250K .......... .......... .......... .......... .......... 85% 24.7M 1s 2024-08-24T21:12:10.631 INFO:tasks.workunit.client.0.smithi179.stderr:144300K .......... .......... .......... .......... .......... 85% 45.7M 1s 2024-08-24T21:12:10.633 INFO:tasks.workunit.client.0.smithi179.stderr:144350K .......... .......... .......... .......... .......... 85% 24.3M 1s 2024-08-24T21:12:10.635 INFO:tasks.workunit.client.0.smithi179.stderr:144400K .......... .......... .......... .......... .......... 85% 23.7M 1s 2024-08-24T21:12:10.636 INFO:tasks.workunit.client.0.smithi179.stderr:144450K .......... .......... .......... .......... .......... 85% 38.2M 1s 2024-08-24T21:12:10.638 INFO:tasks.workunit.client.0.smithi179.stderr:144500K .......... .......... .......... .......... .......... 85% 23.3M 1s 2024-08-24T21:12:10.640 INFO:tasks.workunit.client.0.smithi179.stderr:144550K .......... .......... .......... .......... .......... 85% 23.4M 1s 2024-08-24T21:12:10.641 INFO:tasks.workunit.client.0.smithi179.stderr:144600K .......... .......... .......... .......... .......... 85% 47.5M 1s 2024-08-24T21:12:10.644 INFO:tasks.workunit.client.0.smithi179.stderr:144650K .......... .......... .......... .......... .......... 85% 24.0M 1s 2024-08-24T21:12:10.645 INFO:tasks.workunit.client.0.smithi179.stderr:144700K .......... .......... .......... .......... .......... 85% 29.0M 1s 2024-08-24T21:12:10.647 INFO:tasks.workunit.client.0.smithi179.stderr:144750K .......... .......... .......... .......... .......... 85% 27.1M 1s 2024-08-24T21:12:10.649 INFO:tasks.workunit.client.0.smithi179.stderr:144800K .......... .......... .......... .......... .......... 85% 25.1M 1s 2024-08-24T21:12:10.650 INFO:tasks.workunit.client.0.smithi179.stderr:144850K .......... .......... .......... .......... .......... 85% 36.5M 1s 2024-08-24T21:12:10.652 INFO:tasks.workunit.client.0.smithi179.stderr:144900K .......... .......... .......... .......... .......... 85% 22.2M 1s 2024-08-24T21:12:10.654 INFO:tasks.workunit.client.0.smithi179.stderr:144950K .......... .......... .......... .......... .......... 86% 38.4M 1s 2024-08-24T21:12:10.656 INFO:tasks.workunit.client.0.smithi179.stderr:145000K .......... .......... .......... .......... .......... 86% 24.4M 1s 2024-08-24T21:12:10.658 INFO:tasks.workunit.client.0.smithi179.stderr:145050K .......... .......... .......... .......... .......... 86% 23.8M 1s 2024-08-24T21:12:10.658 INFO:tasks.workunit.client.0.smithi179.stderr:145100K .......... .......... .......... .......... .......... 86% 48.3M 1s 2024-08-24T21:12:10.661 INFO:tasks.workunit.client.0.smithi179.stderr:145150K .......... .......... .......... .......... .......... 86% 23.5M 1s 2024-08-24T21:12:10.663 INFO:tasks.workunit.client.0.smithi179.stderr:145200K .......... .......... .......... .......... .......... 86% 22.9M 1s 2024-08-24T21:12:10.664 INFO:tasks.workunit.client.0.smithi179.stderr:145250K .......... .......... .......... .......... .......... 86% 40.1M 1s 2024-08-24T21:12:10.666 INFO:tasks.workunit.client.0.smithi179.stderr:145300K .......... .......... .......... .......... .......... 86% 25.7M 1s 2024-08-24T21:12:10.667 INFO:tasks.workunit.client.0.smithi179.stderr:145350K .......... .......... .......... .......... .......... 86% 39.5M 1s 2024-08-24T21:12:10.669 INFO:tasks.workunit.client.0.smithi179.stderr:145400K .......... .......... .......... .......... .......... 86% 23.7M 1s 2024-08-24T21:12:10.670 INFO:tasks.workunit.client.0.smithi179.stderr:145450K .......... .......... .......... .......... .......... 86% 40.6M 1s 2024-08-24T21:12:10.672 INFO:tasks.workunit.client.0.smithi179.stderr:145500K .......... .......... .......... .......... .......... 86% 23.3M 1s 2024-08-24T21:12:10.675 INFO:tasks.workunit.client.0.smithi179.stderr:145550K .......... .......... .......... .......... .......... 86% 26.1M 1s 2024-08-24T21:12:10.677 INFO:tasks.workunit.client.0.smithi179.stderr:145600K .......... .......... .......... .......... .......... 86% 22.1M 1s 2024-08-24T21:12:10.678 INFO:tasks.workunit.client.0.smithi179.stderr:145650K .......... .......... .......... .......... .......... 86% 46.4M 1s 2024-08-24T21:12:10.679 INFO:tasks.workunit.client.0.smithi179.stderr:145700K .......... .......... .......... .......... .......... 86% 38.2M 1s 2024-08-24T21:12:10.681 INFO:tasks.workunit.client.0.smithi179.stderr:145750K .......... .......... .......... .......... .......... 86% 26.0M 1s 2024-08-24T21:12:10.683 INFO:tasks.workunit.client.0.smithi179.stderr:145800K .......... .......... .......... .......... .......... 86% 22.6M 1s 2024-08-24T21:12:10.684 INFO:tasks.workunit.client.0.smithi179.stderr:145850K .......... .......... .......... .......... .......... 86% 39.8M 1s 2024-08-24T21:12:10.686 INFO:tasks.workunit.client.0.smithi179.stderr:145900K .......... .......... .......... .......... .......... 86% 25.0M 1s 2024-08-24T21:12:10.688 INFO:tasks.workunit.client.0.smithi179.stderr:145950K .......... .......... .......... .......... .......... 86% 24.0M 1s 2024-08-24T21:12:10.690 INFO:tasks.workunit.client.0.smithi179.stderr:146000K .......... .......... .......... .......... .......... 86% 37.1M 1s 2024-08-24T21:12:10.692 INFO:tasks.workunit.client.0.smithi179.stderr:146050K .......... .......... .......... .......... .......... 86% 23.0M 1s 2024-08-24T21:12:10.693 INFO:tasks.workunit.client.0.smithi179.stderr:146100K .......... .......... .......... .......... .......... 86% 42.2M 1s 2024-08-24T21:12:10.695 INFO:tasks.workunit.client.0.smithi179.stderr:146150K .......... .......... .......... .......... .......... 86% 20.4M 1s 2024-08-24T21:12:10.697 INFO:tasks.workunit.client.0.smithi179.stderr:146200K .......... .......... .......... .......... .......... 86% 23.2M 1s 2024-08-24T21:12:10.698 INFO:tasks.workunit.client.0.smithi179.stderr:146250K .......... .......... .......... .......... .......... 86% 51.0M 1s 2024-08-24T21:12:10.700 INFO:tasks.workunit.client.0.smithi179.stderr:146300K .......... .......... .......... .......... .......... 86% 23.3M 1s 2024-08-24T21:12:10.702 INFO:tasks.workunit.client.0.smithi179.stderr:146350K .......... .......... .......... .......... .......... 86% 26.0M 1s 2024-08-24T21:12:10.703 INFO:tasks.workunit.client.0.smithi179.stderr:146400K .......... .......... .......... .......... .......... 86% 44.6M 1s 2024-08-24T21:12:10.705 INFO:tasks.workunit.client.0.smithi179.stderr:146450K .......... .......... .......... .......... .......... 86% 23.8M 1s 2024-08-24T21:12:10.707 INFO:tasks.workunit.client.0.smithi179.stderr:146500K .......... .......... .......... .......... .......... 86% 38.7M 1s 2024-08-24T21:12:10.709 INFO:tasks.workunit.client.0.smithi179.stderr:146550K .......... .......... .......... .......... .......... 86% 24.8M 1s 2024-08-24T21:12:10.710 INFO:tasks.workunit.client.0.smithi179.stderr:146600K .......... .......... .......... .......... .......... 86% 30.8M 1s 2024-08-24T21:12:10.712 INFO:tasks.workunit.client.0.smithi179.stderr:146650K .......... .......... .......... .......... .......... 87% 28.1M 1s 2024-08-24T21:12:10.714 INFO:tasks.workunit.client.0.smithi179.stderr:146700K .......... .......... .......... .......... .......... 87% 32.1M 1s 2024-08-24T21:12:10.716 INFO:tasks.workunit.client.0.smithi179.stderr:146750K .......... .......... .......... .......... .......... 87% 24.6M 1s 2024-08-24T21:12:10.717 INFO:tasks.workunit.client.0.smithi179.stderr:146800K .......... .......... .......... .......... .......... 87% 24.7M 1s 2024-08-24T21:12:10.721 INFO:tasks.workunit.client.0.smithi179.stderr:146850K .......... .......... .......... .......... .......... 87% 20.9M 1s 2024-08-24T21:12:10.721 INFO:tasks.workunit.client.0.smithi179.stderr:146900K .......... .......... .......... .......... .......... 87% 51.9M 1s 2024-08-24T21:12:10.723 INFO:tasks.workunit.client.0.smithi179.stderr:146950K .......... .......... .......... .......... .......... 87% 20.2M 1s 2024-08-24T21:12:10.724 INFO:tasks.workunit.client.0.smithi179.stderr:147000K .......... .......... .......... .......... .......... 87% 40.9M 1s 2024-08-24T21:12:10.727 INFO:tasks.workunit.client.0.smithi179.stderr:147050K .......... .......... .......... .......... .......... 87% 21.8M 1s 2024-08-24T21:12:10.727 INFO:tasks.workunit.client.0.smithi179.stderr:147100K .......... .......... .......... .......... .......... 87% 44.2M 1s 2024-08-24T21:12:10.730 INFO:tasks.workunit.client.0.smithi179.stderr:147150K .......... .......... .......... .......... .......... 87% 20.2M 1s 2024-08-24T21:12:10.733 INFO:tasks.workunit.client.0.smithi179.stderr:147200K .......... .......... .......... .......... .......... 87% 19.9M 1s 2024-08-24T21:12:10.734 INFO:tasks.workunit.client.0.smithi179.stderr:147250K .......... .......... .......... .......... .......... 87% 30.3M 1s 2024-08-24T21:12:10.737 INFO:tasks.workunit.client.0.smithi179.stderr:147300K .......... .......... .......... .......... .......... 87% 19.4M 1s 2024-08-24T21:12:10.739 INFO:tasks.workunit.client.0.smithi179.stderr:147350K .......... .......... .......... .......... .......... 87% 18.0M 1s 2024-08-24T21:12:10.740 INFO:tasks.workunit.client.0.smithi179.stderr:147400K .......... .......... .......... .......... .......... 87% 44.5M 1s 2024-08-24T21:12:10.743 INFO:tasks.workunit.client.0.smithi179.stderr:147450K .......... .......... .......... .......... .......... 87% 20.1M 1s 2024-08-24T21:12:10.744 INFO:tasks.workunit.client.0.smithi179.stderr:147500K .......... .......... .......... .......... .......... 87% 41.6M 1s 2024-08-24T21:12:10.747 INFO:tasks.workunit.client.0.smithi179.stderr:147550K .......... .......... .......... .......... .......... 87% 21.1M 1s 2024-08-24T21:12:10.748 INFO:tasks.workunit.client.0.smithi179.stderr:147600K .......... .......... .......... .......... .......... 87% 27.9M 1s 2024-08-24T21:12:10.749 INFO:tasks.workunit.client.0.smithi179.stderr:147650K .......... .......... .......... .......... .......... 87% 42.5M 1s 2024-08-24T21:12:10.752 INFO:tasks.workunit.client.0.smithi179.stderr:147700K .......... .......... .......... .......... .......... 87% 18.9M 1s 2024-08-24T21:12:10.753 INFO:tasks.workunit.client.0.smithi179.stderr:147750K .......... .......... .......... .......... .......... 87% 38.5M 1s 2024-08-24T21:12:10.755 INFO:tasks.workunit.client.0.smithi179.stderr:147800K .......... .......... .......... .......... .......... 87% 20.5M 1s 2024-08-24T21:12:10.758 INFO:tasks.workunit.client.0.smithi179.stderr:147850K .......... .......... .......... .......... .......... 87% 19.9M 1s 2024-08-24T21:12:10.759 INFO:tasks.workunit.client.0.smithi179.stderr:147900K .......... .......... .......... .......... .......... 87% 44.0M 1s 2024-08-24T21:12:10.761 INFO:tasks.workunit.client.0.smithi179.stderr:147950K .......... .......... .......... .......... .......... 87% 23.2M 1s 2024-08-24T21:12:10.764 INFO:tasks.workunit.client.0.smithi179.stderr:148000K .......... .......... .......... .......... .......... 87% 18.4M 1s 2024-08-24T21:12:10.765 INFO:tasks.workunit.client.0.smithi179.stderr:148050K .......... .......... .......... .......... .......... 87% 39.3M 1s 2024-08-24T21:12:10.768 INFO:tasks.workunit.client.0.smithi179.stderr:148100K .......... .......... .......... .......... .......... 87% 20.6M 1s 2024-08-24T21:12:10.768 INFO:tasks.workunit.client.0.smithi179.stderr:148150K .......... .......... .......... .......... .......... 87% 45.1M 1s 2024-08-24T21:12:10.771 INFO:tasks.workunit.client.0.smithi179.stderr:148200K .......... .......... .......... .......... .......... 87% 23.7M 1s 2024-08-24T21:12:10.772 INFO:tasks.workunit.client.0.smithi179.stderr:148250K .......... .......... .......... .......... .......... 87% 38.2M 1s 2024-08-24T21:12:10.774 INFO:tasks.workunit.client.0.smithi179.stderr:148300K .......... .......... .......... .......... .......... 88% 18.4M 1s 2024-08-24T21:12:10.777 INFO:tasks.workunit.client.0.smithi179.stderr:148350K .......... .......... .......... .......... .......... 88% 20.5M 1s 2024-08-24T21:12:10.780 INFO:tasks.workunit.client.0.smithi179.stderr:148400K .......... .......... .......... .......... .......... 88% 21.3M 1s 2024-08-24T21:12:10.780 INFO:tasks.workunit.client.0.smithi179.stderr:148450K .......... .......... .......... .......... .......... 88% 47.0M 1s 2024-08-24T21:12:10.782 INFO:tasks.workunit.client.0.smithi179.stderr:148500K .......... .......... .......... .......... .......... 88% 24.9M 1s 2024-08-24T21:12:10.785 INFO:tasks.workunit.client.0.smithi179.stderr:148550K .......... .......... .......... .......... .......... 88% 24.5M 1s 2024-08-24T21:12:10.787 INFO:tasks.workunit.client.0.smithi179.stderr:148600K .......... .......... .......... .......... .......... 88% 22.2M 1s 2024-08-24T21:12:10.787 INFO:tasks.workunit.client.0.smithi179.stderr:148650K .......... .......... .......... .......... .......... 88% 60.8M 1s 2024-08-24T21:12:10.789 INFO:tasks.workunit.client.0.smithi179.stderr:148700K .......... .......... .......... .......... .......... 88% 22.2M 1s 2024-08-24T21:12:10.791 INFO:tasks.workunit.client.0.smithi179.stderr:148750K .......... .......... .......... .......... .......... 88% 24.1M 1s 2024-08-24T21:12:10.793 INFO:tasks.workunit.client.0.smithi179.stderr:148800K .......... .......... .......... .......... .......... 88% 40.8M 1s 2024-08-24T21:12:10.795 INFO:tasks.workunit.client.0.smithi179.stderr:148850K .......... .......... .......... .......... .......... 88% 23.2M 1s 2024-08-24T21:12:10.796 INFO:tasks.workunit.client.0.smithi179.stderr:148900K .......... .......... .......... .......... .......... 88% 42.5M 1s 2024-08-24T21:12:10.798 INFO:tasks.workunit.client.0.smithi179.stderr:148950K .......... .......... .......... .......... .......... 88% 24.1M 1s 2024-08-24T21:12:10.800 INFO:tasks.workunit.client.0.smithi179.stderr:149000K .......... .......... .......... .......... .......... 88% 36.5M 1s 2024-08-24T21:12:10.802 INFO:tasks.workunit.client.0.smithi179.stderr:149050K .......... .......... .......... .......... .......... 88% 23.2M 1s 2024-08-24T21:12:10.803 INFO:tasks.workunit.client.0.smithi179.stderr:149100K .......... .......... .......... .......... .......... 88% 28.8M 1s 2024-08-24T21:12:10.805 INFO:tasks.workunit.client.0.smithi179.stderr:149150K .......... .......... .......... .......... .......... 88% 23.5M 1s 2024-08-24T21:12:10.806 INFO:tasks.workunit.client.0.smithi179.stderr:149200K .......... .......... .......... .......... .......... 88% 41.4M 1s 2024-08-24T21:12:10.809 INFO:tasks.workunit.client.0.smithi179.stderr:149250K .......... .......... .......... .......... .......... 88% 20.7M 1s 2024-08-24T21:12:10.810 INFO:tasks.workunit.client.0.smithi179.stderr:149300K .......... .......... .......... .......... .......... 88% 38.5M 1s 2024-08-24T21:12:10.812 INFO:tasks.workunit.client.0.smithi179.stderr:149350K .......... .......... .......... .......... .......... 88% 24.4M 1s 2024-08-24T21:12:10.813 INFO:tasks.workunit.client.0.smithi179.stderr:149400K .......... .......... .......... .......... .......... 88% 52.7M 1s 2024-08-24T21:12:10.815 INFO:tasks.workunit.client.0.smithi179.stderr:149450K .......... .......... .......... .......... .......... 88% 22.3M 1s 2024-08-24T21:12:10.816 INFO:tasks.workunit.client.0.smithi179.stderr:149500K .......... .......... .......... .......... .......... 88% 33.5M 1s 2024-08-24T21:12:10.818 INFO:tasks.workunit.client.0.smithi179.stderr:149550K .......... .......... .......... .......... .......... 88% 26.2M 1s 2024-08-24T21:12:10.821 INFO:tasks.workunit.client.0.smithi179.stderr:149600K .......... .......... .......... .......... .......... 88% 24.0M 1s 2024-08-24T21:12:10.822 INFO:tasks.workunit.client.0.smithi179.stderr:149650K .......... .......... .......... .......... .......... 88% 26.2M 1s 2024-08-24T21:12:10.823 INFO:tasks.workunit.client.0.smithi179.stderr:149700K .......... .......... .......... .......... .......... 88% 44.0M 1s 2024-08-24T21:12:10.826 INFO:tasks.workunit.client.0.smithi179.stderr:149750K .......... .......... .......... .......... .......... 88% 22.7M 1s 2024-08-24T21:12:10.827 INFO:tasks.workunit.client.0.smithi179.stderr:149800K .......... .......... .......... .......... .......... 88% 48.0M 1s 2024-08-24T21:12:10.829 INFO:tasks.workunit.client.0.smithi179.stderr:149850K .......... .......... .......... .......... .......... 88% 19.5M 1s 2024-08-24T21:12:10.830 INFO:tasks.workunit.client.0.smithi179.stderr:149900K .......... .......... .......... .......... .......... 88% 38.5M 1s 2024-08-24T21:12:10.832 INFO:tasks.workunit.client.0.smithi179.stderr:149950K .......... .......... .......... .......... .......... 88% 23.9M 1s 2024-08-24T21:12:10.835 INFO:tasks.workunit.client.0.smithi179.stderr:150000K .......... .......... .......... .......... .......... 89% 23.0M 1s 2024-08-24T21:12:10.835 INFO:tasks.workunit.client.0.smithi179.stderr:150050K .......... .......... .......... .......... .......... 89% 41.6M 1s 2024-08-24T21:12:10.838 INFO:tasks.workunit.client.0.smithi179.stderr:150100K .......... .......... .......... .......... .......... 89% 24.8M 1s 2024-08-24T21:12:10.840 INFO:tasks.workunit.client.0.smithi179.stderr:150150K .......... .......... .......... .......... .......... 89% 23.3M 1s 2024-08-24T21:12:10.841 INFO:tasks.workunit.client.0.smithi179.stderr:150200K .......... .......... .......... .......... .......... 89% 45.5M 1s 2024-08-24T21:12:10.843 INFO:tasks.workunit.client.0.smithi179.stderr:150250K .......... .......... .......... .......... .......... 89% 23.9M 1s 2024-08-24T21:12:10.844 INFO:tasks.workunit.client.0.smithi179.stderr:150300K .......... .......... .......... .......... .......... 89% 45.4M 1s 2024-08-24T21:12:10.846 INFO:tasks.workunit.client.0.smithi179.stderr:150350K .......... .......... .......... .......... .......... 89% 23.7M 1s 2024-08-24T21:12:10.848 INFO:tasks.workunit.client.0.smithi179.stderr:150400K .......... .......... .......... .......... .......... 89% 24.3M 1s 2024-08-24T21:12:10.849 INFO:tasks.workunit.client.0.smithi179.stderr:150450K .......... .......... .......... .......... .......... 89% 42.1M 1s 2024-08-24T21:12:10.851 INFO:tasks.workunit.client.0.smithi179.stderr:150500K .......... .......... .......... .......... .......... 89% 26.4M 1s 2024-08-24T21:12:10.852 INFO:tasks.workunit.client.0.smithi179.stderr:150550K .......... .......... .......... .......... .......... 89% 35.5M 1s 2024-08-24T21:12:10.854 INFO:tasks.workunit.client.0.smithi179.stderr:150600K .......... .......... .......... .......... .......... 89% 23.6M 1s 2024-08-24T21:12:10.855 INFO:tasks.workunit.client.0.smithi179.stderr:150650K .......... .......... .......... .......... .......... 89% 49.1M 1s 2024-08-24T21:12:10.857 INFO:tasks.workunit.client.0.smithi179.stderr:150700K .......... .......... .......... .......... .......... 89% 20.9M 1s 2024-08-24T21:12:10.860 INFO:tasks.workunit.client.0.smithi179.stderr:150750K .......... .......... .......... .......... .......... 89% 23.1M 1s 2024-08-24T21:12:10.862 INFO:tasks.workunit.client.0.smithi179.stderr:150800K .......... .......... .......... .......... .......... 89% 25.9M 1s 2024-08-24T21:12:10.863 INFO:tasks.workunit.client.0.smithi179.stderr:150850K .......... .......... .......... .......... .......... 89% 35.5M 1s 2024-08-24T21:12:10.865 INFO:tasks.workunit.client.0.smithi179.stderr:150900K .......... .......... .......... .......... .......... 89% 24.0M 1s 2024-08-24T21:12:10.866 INFO:tasks.workunit.client.0.smithi179.stderr:150950K .......... .......... .......... .......... .......... 89% 43.3M 1s 2024-08-24T21:12:10.868 INFO:tasks.workunit.client.0.smithi179.stderr:151000K .......... .......... .......... .......... .......... 89% 24.1M 1s 2024-08-24T21:12:10.869 INFO:tasks.workunit.client.0.smithi179.stderr:151050K .......... .......... .......... .......... .......... 89% 37.0M 1s 2024-08-24T21:12:10.871 INFO:tasks.workunit.client.0.smithi179.stderr:151100K .......... .......... .......... .......... .......... 89% 34.2M 1s 2024-08-24T21:12:10.874 INFO:tasks.workunit.client.0.smithi179.stderr:151150K .......... .......... .......... .......... .......... 89% 17.7M 1s 2024-08-24T21:12:10.875 INFO:tasks.workunit.client.0.smithi179.stderr:151200K .......... .......... .......... .......... .......... 89% 41.2M 1s 2024-08-24T21:12:10.877 INFO:tasks.workunit.client.0.smithi179.stderr:151250K .......... .......... .......... .......... .......... 89% 21.9M 1s 2024-08-24T21:12:10.879 INFO:tasks.workunit.client.0.smithi179.stderr:151300K .......... .......... .......... .......... .......... 89% 28.3M 1s 2024-08-24T21:12:10.880 INFO:tasks.workunit.client.0.smithi179.stderr:151350K .......... .......... .......... .......... .......... 89% 30.7M 1s 2024-08-24T21:12:10.883 INFO:tasks.workunit.client.0.smithi179.stderr:151400K .......... .......... .......... .......... .......... 89% 21.9M 1s 2024-08-24T21:12:10.884 INFO:tasks.workunit.client.0.smithi179.stderr:151450K .......... .......... .......... .......... .......... 89% 37.6M 1s 2024-08-24T21:12:10.885 INFO:tasks.workunit.client.0.smithi179.stderr:151500K .......... .......... .......... .......... .......... 89% 39.3M 1s 2024-08-24T21:12:10.888 INFO:tasks.workunit.client.0.smithi179.stderr:151550K .......... .......... .......... .......... .......... 89% 17.0M 1s 2024-08-24T21:12:10.890 INFO:tasks.workunit.client.0.smithi179.stderr:151600K .......... .......... .......... .......... .......... 89% 30.2M 1s 2024-08-24T21:12:10.892 INFO:tasks.workunit.client.0.smithi179.stderr:151650K .......... .......... .......... .......... .......... 89% 23.2M 1s 2024-08-24T21:12:10.893 INFO:tasks.workunit.client.0.smithi179.stderr:151700K .......... .......... .......... .......... .......... 90% 43.4M 1s 2024-08-24T21:12:10.895 INFO:tasks.workunit.client.0.smithi179.stderr:151750K .......... .......... .......... .......... .......... 90% 21.9M 1s 2024-08-24T21:12:10.896 INFO:tasks.workunit.client.0.smithi179.stderr:151800K .......... .......... .......... .......... .......... 90% 48.1M 1s 2024-08-24T21:12:10.898 INFO:tasks.workunit.client.0.smithi179.stderr:151850K .......... .......... .......... .......... .......... 90% 21.7M 1s 2024-08-24T21:12:10.901 INFO:tasks.workunit.client.0.smithi179.stderr:151900K .......... .......... .......... .......... .......... 90% 27.3M 1s 2024-08-24T21:12:10.903 INFO:tasks.workunit.client.0.smithi179.stderr:151950K .......... .......... .......... .......... .......... 90% 21.8M 1s 2024-08-24T21:12:10.904 INFO:tasks.workunit.client.0.smithi179.stderr:152000K .......... .......... .......... .......... .......... 90% 46.4M 1s 2024-08-24T21:12:10.906 INFO:tasks.workunit.client.0.smithi179.stderr:152050K .......... .......... .......... .......... .......... 90% 26.1M 1s 2024-08-24T21:12:10.907 INFO:tasks.workunit.client.0.smithi179.stderr:152100K .......... .......... .......... .......... .......... 90% 32.7M 1s 2024-08-24T21:12:10.909 INFO:tasks.workunit.client.0.smithi179.stderr:152150K .......... .......... .......... .......... .......... 90% 25.3M 1s 2024-08-24T21:12:10.910 INFO:tasks.workunit.client.0.smithi179.stderr:152200K .......... .......... .......... .......... .......... 90% 44.9M 1s 2024-08-24T21:12:10.912 INFO:tasks.workunit.client.0.smithi179.stderr:152250K .......... .......... .......... .......... .......... 90% 27.5M 1s 2024-08-24T21:12:10.913 INFO:tasks.workunit.client.0.smithi179.stderr:152300K .......... .......... .......... .......... .......... 90% 33.3M 1s 2024-08-24T21:12:10.915 INFO:tasks.workunit.client.0.smithi179.stderr:152350K .......... .......... .......... .......... .......... 90% 23.1M 1s 2024-08-24T21:12:10.918 INFO:tasks.workunit.client.0.smithi179.stderr:152400K .......... .......... .......... .......... .......... 90% 20.6M 1s 2024-08-24T21:12:10.920 INFO:tasks.workunit.client.0.smithi179.stderr:152450K .......... .......... .......... .......... .......... 90% 23.4M 1s 2024-08-24T21:12:10.921 INFO:tasks.workunit.client.0.smithi179.stderr:152500K .......... .......... .......... .......... .......... 90% 40.5M 1s 2024-08-24T21:12:10.923 INFO:tasks.workunit.client.0.smithi179.stderr:152550K .......... .......... .......... .......... .......... 90% 23.2M 1s 2024-08-24T21:12:10.924 INFO:tasks.workunit.client.0.smithi179.stderr:152600K .......... .......... .......... .......... .......... 90% 43.8M 1s 2024-08-24T21:12:10.926 INFO:tasks.workunit.client.0.smithi179.stderr:152650K .......... .......... .......... .......... .......... 90% 26.4M 1s 2024-08-24T21:12:10.928 INFO:tasks.workunit.client.0.smithi179.stderr:152700K .......... .......... .......... .......... .......... 90% 31.8M 1s 2024-08-24T21:12:10.930 INFO:tasks.workunit.client.0.smithi179.stderr:152750K .......... .......... .......... .......... .......... 90% 21.0M 1s 2024-08-24T21:12:10.932 INFO:tasks.workunit.client.0.smithi179.stderr:152800K .......... .......... .......... .......... .......... 90% 26.0M 1s 2024-08-24T21:12:10.933 INFO:tasks.workunit.client.0.smithi179.stderr:152850K .......... .......... .......... .......... .......... 90% 36.8M 1s 2024-08-24T21:12:10.936 INFO:tasks.workunit.client.0.smithi179.stderr:152900K .......... .......... .......... .......... .......... 90% 18.2M 1s 2024-08-24T21:12:10.938 INFO:tasks.workunit.client.0.smithi179.stderr:152950K .......... .......... .......... .......... .......... 90% 28.7M 1s 2024-08-24T21:12:10.938 INFO:tasks.workunit.client.0.smithi179.stderr:153000K .......... .......... .......... .......... .......... 90% 43.0M 1s 2024-08-24T21:12:10.941 INFO:tasks.workunit.client.0.smithi179.stderr:153050K .......... .......... .......... .......... .......... 90% 23.1M 1s 2024-08-24T21:12:10.942 INFO:tasks.workunit.client.0.smithi179.stderr:153100K .......... .......... .......... .......... .......... 90% 35.3M 1s 2024-08-24T21:12:10.944 INFO:tasks.workunit.client.0.smithi179.stderr:153150K .......... .......... .......... .......... .......... 90% 26.6M 1s 2024-08-24T21:12:10.946 INFO:tasks.workunit.client.0.smithi179.stderr:153200K .......... .......... .......... .......... .......... 90% 21.3M 1s 2024-08-24T21:12:10.947 INFO:tasks.workunit.client.0.smithi179.stderr:153250K .......... .......... .......... .......... .......... 90% 47.2M 1s 2024-08-24T21:12:10.950 INFO:tasks.workunit.client.0.smithi179.stderr:153300K .......... .......... .......... .......... .......... 90% 22.6M 1s 2024-08-24T21:12:10.952 INFO:tasks.workunit.client.0.smithi179.stderr:153350K .......... .......... .......... .......... .......... 91% 27.2M 1s 2024-08-24T21:12:10.953 INFO:tasks.workunit.client.0.smithi179.stderr:153400K .......... .......... .......... .......... .......... 91% 26.6M 1s 2024-08-24T21:12:10.954 INFO:tasks.workunit.client.0.smithi179.stderr:153450K .......... .......... .......... .......... .......... 91% 56.4M 1s 2024-08-24T21:12:10.956 INFO:tasks.workunit.client.0.smithi179.stderr:153500K .......... .......... .......... .......... .......... 91% 19.2M 1s 2024-08-24T21:12:10.958 INFO:tasks.workunit.client.0.smithi179.stderr:153550K .......... .......... .......... .......... .......... 91% 22.9M 1s 2024-08-24T21:12:10.961 INFO:tasks.workunit.client.0.smithi179.stderr:153600K .......... .......... .......... .......... .......... 91% 22.2M 1s 2024-08-24T21:12:10.963 INFO:tasks.workunit.client.0.smithi179.stderr:153650K .......... .......... .......... .......... .......... 91% 23.6M 1s 2024-08-24T21:12:10.965 INFO:tasks.workunit.client.0.smithi179.stderr:153700K .......... .......... .......... .......... .......... 91% 30.5M 1s 2024-08-24T21:12:10.966 INFO:tasks.workunit.client.0.smithi179.stderr:153750K .......... .......... .......... .......... .......... 91% 41.5M 1s 2024-08-24T21:12:10.968 INFO:tasks.workunit.client.0.smithi179.stderr:153800K .......... .......... .......... .......... .......... 91% 24.2M 1s 2024-08-24T21:12:10.969 INFO:tasks.workunit.client.0.smithi179.stderr:153850K .......... .......... .......... .......... .......... 91% 34.1M 1s 2024-08-24T21:12:10.971 INFO:tasks.workunit.client.0.smithi179.stderr:153900K .......... .......... .......... .......... .......... 91% 26.7M 1s 2024-08-24T21:12:10.973 INFO:tasks.workunit.client.0.smithi179.stderr:153950K .......... .......... .......... .......... .......... 91% 21.9M 1s 2024-08-24T21:12:10.974 INFO:tasks.workunit.client.0.smithi179.stderr:154000K .......... .......... .......... .......... .......... 91% 41.5M 1s 2024-08-24T21:12:10.977 INFO:tasks.workunit.client.0.smithi179.stderr:154050K .......... .......... .......... .......... .......... 91% 23.0M 1s 2024-08-24T21:12:10.978 INFO:tasks.workunit.client.0.smithi179.stderr:154100K .......... .......... .......... .......... .......... 91% 32.6M 1s 2024-08-24T21:12:10.980 INFO:tasks.workunit.client.0.smithi179.stderr:154150K .......... .......... .......... .......... .......... 91% 25.3M 1s 2024-08-24T21:12:10.982 INFO:tasks.workunit.client.0.smithi179.stderr:154200K .......... .......... .......... .......... .......... 91% 25.2M 1s 2024-08-24T21:12:10.983 INFO:tasks.workunit.client.0.smithi179.stderr:154250K .......... .......... .......... .......... .......... 91% 31.3M 1s 2024-08-24T21:12:10.986 INFO:tasks.workunit.client.0.smithi179.stderr:154300K .......... .......... .......... .......... .......... 91% 24.0M 1s 2024-08-24T21:12:10.988 INFO:tasks.workunit.client.0.smithi179.stderr:154350K .......... .......... .......... .......... .......... 91% 26.9M 1s 2024-08-24T21:12:10.989 INFO:tasks.workunit.client.0.smithi179.stderr:154400K .......... .......... .......... .......... .......... 91% 32.0M 1s 2024-08-24T21:12:10.991 INFO:tasks.workunit.client.0.smithi179.stderr:154450K .......... .......... .......... .......... .......... 91% 28.0M 1s 2024-08-24T21:12:10.992 INFO:tasks.workunit.client.0.smithi179.stderr:154500K .......... .......... .......... .......... .......... 91% 30.3M 1s 2024-08-24T21:12:10.994 INFO:tasks.workunit.client.0.smithi179.stderr:154550K .......... .......... .......... .......... .......... 91% 26.0M 1s 2024-08-24T21:12:10.995 INFO:tasks.workunit.client.0.smithi179.stderr:154600K .......... .......... .......... .......... .......... 91% 40.3M 1s 2024-08-24T21:12:10.998 INFO:tasks.workunit.client.0.smithi179.stderr:154650K .......... .......... .......... .......... .......... 91% 19.2M 1s 2024-08-24T21:12:11.000 INFO:tasks.workunit.client.0.smithi179.stderr:154700K .......... .......... .......... .......... .......... 91% 27.6M 0s 2024-08-24T21:12:11.001 INFO:tasks.workunit.client.0.smithi179.stderr:154750K .......... .......... .......... .......... .......... 91% 25.1M 0s 2024-08-24T21:12:11.003 INFO:tasks.workunit.client.0.smithi179.stderr:154800K .......... .......... .......... .......... .......... 91% 32.7M 0s 2024-08-24T21:12:11.005 INFO:tasks.workunit.client.0.smithi179.stderr:154850K .......... .......... .......... .......... .......... 91% 21.6M 0s 2024-08-24T21:12:11.006 INFO:tasks.workunit.client.0.smithi179.stderr:154900K .......... .......... .......... .......... .......... 91% 39.6M 0s 2024-08-24T21:12:11.009 INFO:tasks.workunit.client.0.smithi179.stderr:154950K .......... .......... .......... .......... .......... 91% 19.0M 0s 2024-08-24T21:12:11.011 INFO:tasks.workunit.client.0.smithi179.stderr:155000K .......... .......... .......... .......... .......... 91% 41.4M 0s 2024-08-24T21:12:11.012 INFO:tasks.workunit.client.0.smithi179.stderr:155050K .......... .......... .......... .......... .......... 92% 29.2M 0s 2024-08-24T21:12:11.013 INFO:tasks.workunit.client.0.smithi179.stderr:155100K .......... .......... .......... .......... .......... 92% 39.1M 0s 2024-08-24T21:12:11.015 INFO:tasks.workunit.client.0.smithi179.stderr:155150K .......... .......... .......... .......... .......... 92% 22.3M 0s 2024-08-24T21:12:11.018 INFO:tasks.workunit.client.0.smithi179.stderr:155200K .......... .......... .......... .......... .......... 92% 19.2M 0s 2024-08-24T21:12:11.020 INFO:tasks.workunit.client.0.smithi179.stderr:155250K .......... .......... .......... .......... .......... 92% 23.9M 0s 2024-08-24T21:12:11.021 INFO:tasks.workunit.client.0.smithi179.stderr:155300K .......... .......... .......... .......... .......... 92% 38.1M 0s 2024-08-24T21:12:11.023 INFO:tasks.workunit.client.0.smithi179.stderr:155350K .......... .......... .......... .......... .......... 92% 23.7M 0s 2024-08-24T21:12:11.024 INFO:tasks.workunit.client.0.smithi179.stderr:155400K .......... .......... .......... .......... .......... 92% 48.3M 0s 2024-08-24T21:12:11.027 INFO:tasks.workunit.client.0.smithi179.stderr:155450K .......... .......... .......... .......... .......... 92% 20.4M 0s 2024-08-24T21:12:11.027 INFO:tasks.workunit.client.0.smithi179.stderr:155500K .......... .......... .......... .......... .......... 92% 51.2M 0s 2024-08-24T21:12:11.029 INFO:tasks.workunit.client.0.smithi179.stderr:155550K .......... .......... .......... .......... .......... 92% 23.8M 0s 2024-08-24T21:12:11.032 INFO:tasks.workunit.client.0.smithi179.stderr:155600K .......... .......... .......... .......... .......... 92% 21.8M 0s 2024-08-24T21:12:11.033 INFO:tasks.workunit.client.0.smithi179.stderr:155650K .......... .......... .......... .......... .......... 92% 37.6M 0s 2024-08-24T21:12:11.036 INFO:tasks.workunit.client.0.smithi179.stderr:155700K .......... .......... .......... .......... .......... 92% 21.6M 0s 2024-08-24T21:12:11.038 INFO:tasks.workunit.client.0.smithi179.stderr:155750K .......... .......... .......... .......... .......... 92% 23.2M 0s 2024-08-24T21:12:11.039 INFO:tasks.workunit.client.0.smithi179.stderr:155800K .......... .......... .......... .......... .......... 92% 39.7M 0s 2024-08-24T21:12:11.041 INFO:tasks.workunit.client.0.smithi179.stderr:155850K .......... .......... .......... .......... .......... 92% 23.4M 0s 2024-08-24T21:12:11.042 INFO:tasks.workunit.client.0.smithi179.stderr:155900K .......... .......... .......... .......... .......... 92% 37.8M 0s 2024-08-24T21:12:11.045 INFO:tasks.workunit.client.0.smithi179.stderr:155950K .......... .......... .......... .......... .......... 92% 18.4M 0s 2024-08-24T21:12:11.047 INFO:tasks.workunit.client.0.smithi179.stderr:156000K .......... .......... .......... .......... .......... 92% 25.3M 0s 2024-08-24T21:12:11.048 INFO:tasks.workunit.client.0.smithi179.stderr:156050K .......... .......... .......... .......... .......... 92% 41.6M 0s 2024-08-24T21:12:11.050 INFO:tasks.workunit.client.0.smithi179.stderr:156100K .......... .......... .......... .......... .......... 92% 22.6M 0s 2024-08-24T21:12:11.056 INFO:tasks.workunit.client.0.smithi179.stderr:156150K .......... .......... .......... .......... .......... 92% 27.7M 0s 2024-08-24T21:12:11.057 INFO:tasks.workunit.client.0.smithi179.stderr:156200K .......... .......... .......... .......... .......... 92% 29.2M 0s 2024-08-24T21:12:11.057 INFO:tasks.workunit.client.0.smithi179.stderr:156250K .......... .......... .......... .......... .......... 92% 39.3M 0s 2024-08-24T21:12:11.058 INFO:tasks.workunit.client.0.smithi179.stderr:156300K .......... .......... .......... .......... .......... 92% 20.2M 0s 2024-08-24T21:12:11.059 INFO:tasks.workunit.client.0.smithi179.stderr:156350K .......... .......... .......... .......... .......... 92% 22.5M 0s 2024-08-24T21:12:11.062 INFO:tasks.workunit.client.0.smithi179.stderr:156400K .......... .......... .......... .......... .......... 92% 24.0M 0s 2024-08-24T21:12:11.063 INFO:tasks.workunit.client.0.smithi179.stderr:156450K .......... .......... .......... .......... .......... 92% 35.2M 0s 2024-08-24T21:12:11.065 INFO:tasks.workunit.client.0.smithi179.stderr:156500K .......... .......... .......... .......... .......... 92% 28.3M 0s 2024-08-24T21:12:11.066 INFO:tasks.workunit.client.0.smithi179.stderr:156550K .......... .......... .......... .......... .......... 92% 41.5M 0s 2024-08-24T21:12:11.068 INFO:tasks.workunit.client.0.smithi179.stderr:156600K .......... .......... .......... .......... .......... 92% 24.0M 0s 2024-08-24T21:12:11.069 INFO:tasks.workunit.client.0.smithi179.stderr:156650K .......... .......... .......... .......... .......... 92% 41.6M 0s 2024-08-24T21:12:11.071 INFO:tasks.workunit.client.0.smithi179.stderr:156700K .......... .......... .......... .......... .......... 92% 24.5M 0s 2024-08-24T21:12:11.073 INFO:tasks.workunit.client.0.smithi179.stderr:156750K .......... .......... .......... .......... .......... 93% 22.0M 0s 2024-08-24T21:12:11.074 INFO:tasks.workunit.client.0.smithi179.stderr:156800K .......... .......... .......... .......... .......... 93% 41.3M 0s 2024-08-24T21:12:11.076 INFO:tasks.workunit.client.0.smithi179.stderr:156850K .......... .......... .......... .......... .......... 93% 28.3M 0s 2024-08-24T21:12:11.077 INFO:tasks.workunit.client.0.smithi179.stderr:156900K .......... .......... .......... .......... .......... 93% 39.3M 0s 2024-08-24T21:12:11.079 INFO:tasks.workunit.client.0.smithi179.stderr:156950K .......... .......... .......... .......... .......... 93% 23.7M 0s 2024-08-24T21:12:11.082 INFO:tasks.workunit.client.0.smithi179.stderr:157000K .......... .......... .......... .......... .......... 93% 23.4M 0s 2024-08-24T21:12:11.082 INFO:tasks.workunit.client.0.smithi179.stderr:157050K .......... .......... .......... .......... .......... 93% 46.4M 0s 2024-08-24T21:12:11.084 INFO:tasks.workunit.client.0.smithi179.stderr:157100K .......... .......... .......... .......... .......... 93% 25.0M 0s 2024-08-24T21:12:11.088 INFO:tasks.workunit.client.0.smithi179.stderr:157150K .......... .......... .......... .......... .......... 93% 22.9M 0s 2024-08-24T21:12:11.088 INFO:tasks.workunit.client.0.smithi179.stderr:157200K .......... .......... .......... .......... .......... 93% 48.1M 0s 2024-08-24T21:12:11.090 INFO:tasks.workunit.client.0.smithi179.stderr:157250K .......... .......... .......... .......... .......... 93% 23.7M 0s 2024-08-24T21:12:11.091 INFO:tasks.workunit.client.0.smithi179.stderr:157300K .......... .......... .......... .......... .......... 93% 43.7M 0s 2024-08-24T21:12:11.093 INFO:tasks.workunit.client.0.smithi179.stderr:157350K .......... .......... .......... .......... .......... 93% 22.5M 0s 2024-08-24T21:12:11.094 INFO:tasks.workunit.client.0.smithi179.stderr:157400K .......... .......... .......... .......... .......... 93% 37.4M 0s 2024-08-24T21:12:11.096 INFO:tasks.workunit.client.0.smithi179.stderr:157450K .......... .......... .......... .......... .......... 93% 26.0M 0s 2024-08-24T21:12:11.098 INFO:tasks.workunit.client.0.smithi179.stderr:157500K .......... .......... .......... .......... .......... 93% 21.2M 0s 2024-08-24T21:12:11.102 INFO:tasks.workunit.client.0.smithi179.stderr:157550K .......... .......... .......... .......... .......... 93% 22.6M 0s 2024-08-24T21:12:11.102 INFO:tasks.workunit.client.0.smithi179.stderr:157600K .......... .......... .......... .......... .......... 93% 47.9M 0s 2024-08-24T21:12:11.104 INFO:tasks.workunit.client.0.smithi179.stderr:157650K .......... .......... .......... .......... .......... 93% 24.6M 0s 2024-08-24T21:12:11.104 INFO:tasks.workunit.client.0.smithi179.stderr:157700K .......... .......... .......... .......... .......... 93% 48.1M 0s 2024-08-24T21:12:11.107 INFO:tasks.workunit.client.0.smithi179.stderr:157750K .......... .......... .......... .......... .......... 93% 18.0M 0s 2024-08-24T21:12:11.109 INFO:tasks.workunit.client.0.smithi179.stderr:157800K .......... .......... .......... .......... .......... 93% 25.9M 0s 2024-08-24T21:12:11.111 INFO:tasks.workunit.client.0.smithi179.stderr:157850K .......... .......... .......... .......... .......... 93% 23.1M 0s 2024-08-24T21:12:11.112 INFO:tasks.workunit.client.0.smithi179.stderr:157900K .......... .......... .......... .......... .......... 93% 47.2M 0s 2024-08-24T21:12:11.115 INFO:tasks.workunit.client.0.smithi179.stderr:157950K .......... .......... .......... .......... .......... 93% 18.0M 0s 2024-08-24T21:12:11.117 INFO:tasks.workunit.client.0.smithi179.stderr:158000K .......... .......... .......... .......... .......... 93% 26.1M 0s 2024-08-24T21:12:11.120 INFO:tasks.workunit.client.0.smithi179.stderr:158050K .......... .......... .......... .......... .......... 93% 21.2M 0s 2024-08-24T21:12:11.120 INFO:tasks.workunit.client.0.smithi179.stderr:158100K .......... .......... .......... .......... .......... 93% 48.8M 0s 2024-08-24T21:12:11.123 INFO:tasks.workunit.client.0.smithi179.stderr:158150K .......... .......... .......... .......... .......... 93% 18.8M 0s 2024-08-24T21:12:11.124 INFO:tasks.workunit.client.0.smithi179.stderr:158200K .......... .......... .......... .......... .......... 93% 29.6M 0s 2024-08-24T21:12:11.127 INFO:tasks.workunit.client.0.smithi179.stderr:158250K .......... .......... .......... .......... .......... 93% 24.4M 0s 2024-08-24T21:12:11.128 INFO:tasks.workunit.client.0.smithi179.stderr:158300K .......... .......... .......... .......... .......... 93% 43.7M 0s 2024-08-24T21:12:11.130 INFO:tasks.workunit.client.0.smithi179.stderr:158350K .......... .......... .......... .......... .......... 93% 25.5M 0s 2024-08-24T21:12:11.133 INFO:tasks.workunit.client.0.smithi179.stderr:158400K .......... .......... .......... .......... .......... 93% 18.4M 0s 2024-08-24T21:12:11.133 INFO:tasks.workunit.client.0.smithi179.stderr:158450K .......... .......... .......... .......... .......... 94% 35.5M 0s 2024-08-24T21:12:11.135 INFO:tasks.workunit.client.0.smithi179.stderr:158500K .......... .......... .......... .......... .......... 94% 26.5M 0s 2024-08-24T21:12:11.136 INFO:tasks.workunit.client.0.smithi179.stderr:158550K .......... .......... .......... .......... .......... 94% 48.5M 0s 2024-08-24T21:12:11.138 INFO:tasks.workunit.client.0.smithi179.stderr:158600K .......... .......... .......... .......... .......... 94% 24.1M 0s 2024-08-24T21:12:11.142 INFO:tasks.workunit.client.0.smithi179.stderr:158650K .......... .......... .......... .......... .......... 94% 16.3M 0s 2024-08-24T21:12:11.143 INFO:tasks.workunit.client.0.smithi179.stderr:158700K .......... .......... .......... .......... .......... 94% 31.7M 0s 2024-08-24T21:12:11.145 INFO:tasks.workunit.client.0.smithi179.stderr:158750K .......... .......... .......... .......... .......... 94% 26.0M 0s 2024-08-24T21:12:11.147 INFO:tasks.workunit.client.0.smithi179.stderr:158800K .......... .......... .......... .......... .......... 94% 25.1M 0s 2024-08-24T21:12:11.148 INFO:tasks.workunit.client.0.smithi179.stderr:158850K .......... .......... .......... .......... .......... 94% 42.7M 0s 2024-08-24T21:12:11.150 INFO:tasks.workunit.client.0.smithi179.stderr:158900K .......... .......... .......... .......... .......... 94% 22.6M 0s 2024-08-24T21:12:11.151 INFO:tasks.workunit.client.0.smithi179.stderr:158950K .......... .......... .......... .......... .......... 94% 41.2M 0s 2024-08-24T21:12:11.153 INFO:tasks.workunit.client.0.smithi179.stderr:159000K .......... .......... .......... .......... .......... 94% 23.4M 0s 2024-08-24T21:12:11.154 INFO:tasks.workunit.client.0.smithi179.stderr:159050K .......... .......... .......... .......... .......... 94% 44.7M 0s 2024-08-24T21:12:11.157 INFO:tasks.workunit.client.0.smithi179.stderr:159100K .......... .......... .......... .......... .......... 94% 24.0M 0s 2024-08-24T21:12:11.159 INFO:tasks.workunit.client.0.smithi179.stderr:159150K .......... .......... .......... .......... .......... 94% 21.6M 0s 2024-08-24T21:12:11.161 INFO:tasks.workunit.client.0.smithi179.stderr:159200K .......... .......... .......... .......... .......... 94% 23.6M 0s 2024-08-24T21:12:11.163 INFO:tasks.workunit.client.0.smithi179.stderr:159250K .......... .......... .......... .......... .......... 94% 35.3M 0s 2024-08-24T21:12:11.164 INFO:tasks.workunit.client.0.smithi179.stderr:159300K .......... .......... .......... .......... .......... 94% 26.5M 0s 2024-08-24T21:12:11.166 INFO:tasks.workunit.client.0.smithi179.stderr:159350K .......... .......... .......... .......... .......... 94% 35.1M 0s 2024-08-24T21:12:11.167 INFO:tasks.workunit.client.0.smithi179.stderr:159400K .......... .......... .......... .......... .......... 94% 27.8M 0s 2024-08-24T21:12:11.168 INFO:tasks.workunit.client.0.smithi179.stderr:159450K .......... .......... .......... .......... .......... 94% 33.8M 0s 2024-08-24T21:12:11.170 INFO:tasks.workunit.client.0.smithi179.stderr:159500K .......... .......... .......... .......... .......... 94% 27.5M 0s 2024-08-24T21:12:11.173 INFO:tasks.workunit.client.0.smithi179.stderr:159550K .......... .......... .......... .......... .......... 94% 23.6M 0s 2024-08-24T21:12:11.174 INFO:tasks.workunit.client.0.smithi179.stderr:159600K .......... .......... .......... .......... .......... 94% 44.0M 0s 2024-08-24T21:12:11.176 INFO:tasks.workunit.client.0.smithi179.stderr:159650K .......... .......... .......... .......... .......... 94% 25.1M 0s 2024-08-24T21:12:11.177 INFO:tasks.workunit.client.0.smithi179.stderr:159700K .......... .......... .......... .......... .......... 94% 39.9M 0s 2024-08-24T21:12:11.180 INFO:tasks.workunit.client.0.smithi179.stderr:159750K .......... .......... .......... .......... .......... 94% 22.2M 0s 2024-08-24T21:12:11.181 INFO:tasks.workunit.client.0.smithi179.stderr:159800K .......... .......... .......... .......... .......... 94% 22.8M 0s 2024-08-24T21:12:11.182 INFO:tasks.workunit.client.0.smithi179.stderr:159850K .......... .......... .......... .......... .......... 94% 43.3M 0s 2024-08-24T21:12:11.184 INFO:tasks.workunit.client.0.smithi179.stderr:159900K .......... .......... .......... .......... .......... 94% 23.5M 0s 2024-08-24T21:12:11.186 INFO:tasks.workunit.client.0.smithi179.stderr:159950K .......... .......... .......... .......... .......... 94% 27.0M 0s 2024-08-24T21:12:11.188 INFO:tasks.workunit.client.0.smithi179.stderr:160000K .......... .......... .......... .......... .......... 94% 39.7M 0s 2024-08-24T21:12:11.189 INFO:tasks.workunit.client.0.smithi179.stderr:160050K .......... .......... .......... .......... .......... 94% 24.3M 0s 2024-08-24T21:12:11.190 INFO:tasks.workunit.client.0.smithi179.stderr:160100K .......... .......... .......... .......... .......... 95% 45.4M 0s 2024-08-24T21:12:11.193 INFO:tasks.workunit.client.0.smithi179.stderr:160150K .......... .......... .......... .......... .......... 95% 23.4M 0s 2024-08-24T21:12:11.194 INFO:tasks.workunit.client.0.smithi179.stderr:160200K .......... .......... .......... .......... .......... 95% 39.6M 0s 2024-08-24T21:12:11.196 INFO:tasks.workunit.client.0.smithi179.stderr:160250K .......... .......... .......... .......... .......... 95% 25.7M 0s 2024-08-24T21:12:11.199 INFO:tasks.workunit.client.0.smithi179.stderr:160300K .......... .......... .......... .......... .......... 95% 21.2M 0s 2024-08-24T21:12:11.200 INFO:tasks.workunit.client.0.smithi179.stderr:160350K .......... .......... .......... .......... .......... 95% 26.0M 0s 2024-08-24T21:12:11.201 INFO:tasks.workunit.client.0.smithi179.stderr:160400K .......... .......... .......... .......... .......... 95% 44.6M 0s 2024-08-24T21:12:11.203 INFO:tasks.workunit.client.0.smithi179.stderr:160450K .......... .......... .......... .......... .......... 95% 22.7M 0s 2024-08-24T21:12:11.205 INFO:tasks.workunit.client.0.smithi179.stderr:160500K .......... .......... .......... .......... .......... 95% 36.6M 0s 2024-08-24T21:12:11.206 INFO:tasks.workunit.client.0.smithi179.stderr:160550K .......... .......... .......... .......... .......... 95% 24.8M 0s 2024-08-24T21:12:11.207 INFO:tasks.workunit.client.0.smithi179.stderr:160600K .......... .......... .......... .......... .......... 95% 38.2M 0s 2024-08-24T21:12:11.210 INFO:tasks.workunit.client.0.smithi179.stderr:160650K .......... .......... .......... .......... .......... 95% 21.9M 0s 2024-08-24T21:12:11.211 INFO:tasks.workunit.client.0.smithi179.stderr:160700K .......... .......... .......... .......... .......... 95% 42.7M 0s 2024-08-24T21:12:11.213 INFO:tasks.workunit.client.0.smithi179.stderr:160750K .......... .......... .......... .......... .......... 95% 23.6M 0s 2024-08-24T21:12:11.216 INFO:tasks.workunit.client.0.smithi179.stderr:160800K .......... .......... .......... .......... .......... 95% 20.6M 0s 2024-08-24T21:12:11.219 INFO:tasks.workunit.client.0.smithi179.stderr:160850K .......... .......... .......... .......... .......... 95% 23.0M 0s 2024-08-24T21:12:11.219 INFO:tasks.workunit.client.0.smithi179.stderr:160900K .......... .......... .......... .......... .......... 95% 53.2M 0s 2024-08-24T21:12:11.221 INFO:tasks.workunit.client.0.smithi179.stderr:160950K .......... .......... .......... .......... .......... 95% 21.5M 0s 2024-08-24T21:12:11.222 INFO:tasks.workunit.client.0.smithi179.stderr:161000K .......... .......... .......... .......... .......... 95% 44.0M 0s 2024-08-24T21:12:11.224 INFO:tasks.workunit.client.0.smithi179.stderr:161050K .......... .......... .......... .......... .......... 95% 24.4M 0s 2024-08-24T21:12:11.225 INFO:tasks.workunit.client.0.smithi179.stderr:161100K .......... .......... .......... .......... .......... 95% 46.1M 0s 2024-08-24T21:12:11.227 INFO:tasks.workunit.client.0.smithi179.stderr:161150K .......... .......... .......... .......... .......... 95% 23.3M 0s 2024-08-24T21:12:11.229 INFO:tasks.workunit.client.0.smithi179.stderr:161200K .......... .......... .......... .......... .......... 95% 24.7M 0s 2024-08-24T21:12:11.230 INFO:tasks.workunit.client.0.smithi179.stderr:161250K .......... .......... .......... .......... .......... 95% 38.0M 0s 2024-08-24T21:12:11.233 INFO:tasks.workunit.client.0.smithi179.stderr:161300K .......... .......... .......... .......... .......... 95% 24.4M 0s 2024-08-24T21:12:11.233 INFO:tasks.workunit.client.0.smithi179.stderr:161350K .......... .......... .......... .......... .......... 95% 50.7M 0s 2024-08-24T21:12:11.235 INFO:tasks.workunit.client.0.smithi179.stderr:161400K .......... .......... .......... .......... .......... 95% 20.4M 0s 2024-08-24T21:12:11.237 INFO:tasks.workunit.client.0.smithi179.stderr:161450K .......... .......... .......... .......... .......... 95% 47.6M 0s 2024-08-24T21:12:11.239 INFO:tasks.workunit.client.0.smithi179.stderr:161500K .......... .......... .......... .......... .......... 95% 22.5M 0s 2024-08-24T21:12:11.241 INFO:tasks.workunit.client.0.smithi179.stderr:161550K .......... .......... .......... .......... .......... 95% 22.3M 0s 2024-08-24T21:12:11.243 INFO:tasks.workunit.client.0.smithi179.stderr:161600K .......... .......... .......... .......... .......... 95% 28.2M 0s 2024-08-24T21:12:11.244 INFO:tasks.workunit.client.0.smithi179.stderr:161650K .......... .......... .......... .......... .......... 95% 45.8M 0s 2024-08-24T21:12:11.246 INFO:tasks.workunit.client.0.smithi179.stderr:161700K .......... .......... .......... .......... .......... 95% 23.6M 0s 2024-08-24T21:12:11.247 INFO:tasks.workunit.client.0.smithi179.stderr:161750K .......... .......... .......... .......... .......... 95% 36.2M 0s 2024-08-24T21:12:11.249 INFO:tasks.workunit.client.0.smithi179.stderr:161800K .......... .......... .......... .......... .......... 96% 25.2M 0s 2024-08-24T21:12:11.251 INFO:tasks.workunit.client.0.smithi179.stderr:161850K .......... .......... .......... .......... .......... 96% 39.7M 0s 2024-08-24T21:12:11.253 INFO:tasks.workunit.client.0.smithi179.stderr:161900K .......... .......... .......... .......... .......... 96% 23.7M 0s 2024-08-24T21:12:11.255 INFO:tasks.workunit.client.0.smithi179.stderr:161950K .......... .......... .......... .......... .......... 96% 24.1M 0s 2024-08-24T21:12:11.256 INFO:tasks.workunit.client.0.smithi179.stderr:162000K .......... .......... .......... .......... .......... 96% 31.7M 0s 2024-08-24T21:12:11.258 INFO:tasks.workunit.client.0.smithi179.stderr:162050K .......... .......... .......... .......... .......... 96% 20.6M 0s 2024-08-24T21:12:11.263 INFO:tasks.workunit.client.0.smithi179.stderr:162100K .......... .......... .......... .......... .......... 96% 27.9M 0s 2024-08-24T21:12:11.263 INFO:tasks.workunit.client.0.smithi179.stderr:162150K .......... .......... .......... .......... .......... 96% 40.1M 0s 2024-08-24T21:12:11.264 INFO:tasks.workunit.client.0.smithi179.stderr:162200K .......... .......... .......... .......... .......... 96% 21.3M 0s 2024-08-24T21:12:11.265 INFO:tasks.workunit.client.0.smithi179.stderr:162250K .......... .......... .......... .......... .......... 96% 40.8M 0s 2024-08-24T21:12:11.267 INFO:tasks.workunit.client.0.smithi179.stderr:162300K .......... .......... .......... .......... .......... 96% 22.8M 0s 2024-08-24T21:12:11.269 INFO:tasks.workunit.client.0.smithi179.stderr:162350K .......... .......... .......... .......... .......... 96% 24.1M 0s 2024-08-24T21:12:11.270 INFO:tasks.workunit.client.0.smithi179.stderr:162400K .......... .......... .......... .......... .......... 96% 37.6M 0s 2024-08-24T21:12:11.272 INFO:tasks.workunit.client.0.smithi179.stderr:162450K .......... .......... .......... .......... .......... 96% 24.6M 0s 2024-08-24T21:12:11.273 INFO:tasks.workunit.client.0.smithi179.stderr:162500K .......... .......... .......... .......... .......... 96% 41.5M 0s 2024-08-24T21:12:11.276 INFO:tasks.workunit.client.0.smithi179.stderr:162550K .......... .......... .......... .......... .......... 96% 24.3M 0s 2024-08-24T21:12:11.278 INFO:tasks.workunit.client.0.smithi179.stderr:162600K .......... .......... .......... .......... .......... 96% 21.5M 0s 2024-08-24T21:12:11.279 INFO:tasks.workunit.client.0.smithi179.stderr:162650K .......... .......... .......... .......... .......... 96% 36.2M 0s 2024-08-24T21:12:11.281 INFO:tasks.workunit.client.0.smithi179.stderr:162700K .......... .......... .......... .......... .......... 96% 24.0M 0s 2024-08-24T21:12:11.283 INFO:tasks.workunit.client.0.smithi179.stderr:162750K .......... .......... .......... .......... .......... 96% 24.2M 0s 2024-08-24T21:12:11.284 INFO:tasks.workunit.client.0.smithi179.stderr:162800K .......... .......... .......... .......... .......... 96% 36.9M 0s 2024-08-24T21:12:11.287 INFO:tasks.workunit.client.0.smithi179.stderr:162850K .......... .......... .......... .......... .......... 96% 20.9M 0s 2024-08-24T21:12:11.288 INFO:tasks.workunit.client.0.smithi179.stderr:162900K .......... .......... .......... .......... .......... 96% 46.3M 0s 2024-08-24T21:12:11.290 INFO:tasks.workunit.client.0.smithi179.stderr:162950K .......... .......... .......... .......... .......... 96% 21.8M 0s 2024-08-24T21:12:11.292 INFO:tasks.workunit.client.0.smithi179.stderr:163000K .......... .......... .......... .......... .......... 96% 29.5M 0s 2024-08-24T21:12:11.294 INFO:tasks.workunit.client.0.smithi179.stderr:163050K .......... .......... .......... .......... .......... 96% 23.4M 0s 2024-08-24T21:12:11.295 INFO:tasks.workunit.client.0.smithi179.stderr:163100K .......... .......... .......... .......... .......... 96% 52.1M 0s 2024-08-24T21:12:11.299 INFO:tasks.workunit.client.0.smithi179.stderr:163150K .......... .......... .......... .......... .......... 96% 11.1M 0s 2024-08-24T21:12:11.301 INFO:tasks.workunit.client.0.smithi179.stderr:163200K .......... .......... .......... .......... .......... 96% 30.9M 0s 2024-08-24T21:12:11.303 INFO:tasks.workunit.client.0.smithi179.stderr:163250K .......... .......... .......... .......... .......... 96% 24.4M 0s 2024-08-24T21:12:11.304 INFO:tasks.workunit.client.0.smithi179.stderr:163300K .......... .......... .......... .......... .......... 96% 43.2M 0s 2024-08-24T21:12:11.306 INFO:tasks.workunit.client.0.smithi179.stderr:163350K .......... .......... .......... .......... .......... 96% 22.4M 0s 2024-08-24T21:12:11.307 INFO:tasks.workunit.client.0.smithi179.stderr:163400K .......... .......... .......... .......... .......... 96% 43.7M 0s 2024-08-24T21:12:11.309 INFO:tasks.workunit.client.0.smithi179.stderr:163450K .......... .......... .......... .......... .......... 96% 23.0M 0s 2024-08-24T21:12:11.310 INFO:tasks.workunit.client.0.smithi179.stderr:163500K .......... .......... .......... .......... .......... 97% 40.7M 0s 2024-08-24T21:12:11.313 INFO:tasks.workunit.client.0.smithi179.stderr:163550K .......... .......... .......... .......... .......... 97% 17.5M 0s 2024-08-24T21:12:11.315 INFO:tasks.workunit.client.0.smithi179.stderr:163600K .......... .......... .......... .......... .......... 97% 27.5M 0s 2024-08-24T21:12:11.316 INFO:tasks.workunit.client.0.smithi179.stderr:163650K .......... .......... .......... .......... .......... 97% 43.9M 0s 2024-08-24T21:12:11.318 INFO:tasks.workunit.client.0.smithi179.stderr:163700K .......... .......... .......... .......... .......... 97% 20.0M 0s 2024-08-24T21:12:11.321 INFO:tasks.workunit.client.0.smithi179.stderr:163750K .......... .......... .......... .......... .......... 97% 26.8M 0s 2024-08-24T21:12:11.322 INFO:tasks.workunit.client.0.smithi179.stderr:163800K .......... .......... .......... .......... .......... 97% 25.0M 0s 2024-08-24T21:12:11.330 INFO:tasks.workunit.client.0.smithi179.stderr:163850K .......... .......... .......... .......... .......... 97% 10.5M 0s 2024-08-24T21:12:11.330 INFO:tasks.workunit.client.0.smithi179.stderr:163900K .......... .......... .......... .......... .......... 97% 92.8M 0s 2024-08-24T21:12:11.330 INFO:tasks.workunit.client.0.smithi179.stderr:163950K .......... .......... .......... .......... .......... 97% 58.5M 0s 2024-08-24T21:12:11.331 INFO:tasks.workunit.client.0.smithi179.stderr:164000K .......... .......... .......... .......... .......... 97% 22.5M 0s 2024-08-24T21:12:11.332 INFO:tasks.workunit.client.0.smithi179.stderr:164050K .......... .......... .......... .......... .......... 97% 38.6M 0s 2024-08-24T21:12:11.334 INFO:tasks.workunit.client.0.smithi179.stderr:164100K .......... .......... .......... .......... .......... 97% 24.3M 0s 2024-08-24T21:12:11.336 INFO:tasks.workunit.client.0.smithi179.stderr:164150K .......... .......... .......... .......... .......... 97% 26.9M 0s 2024-08-24T21:12:11.338 INFO:tasks.workunit.client.0.smithi179.stderr:164200K .......... .......... .......... .......... .......... 97% 24.1M 0s 2024-08-24T21:12:11.339 INFO:tasks.workunit.client.0.smithi179.stderr:164250K .......... .......... .......... .......... .......... 97% 28.0M 0s 2024-08-24T21:12:11.342 INFO:tasks.workunit.client.0.smithi179.stderr:164300K .......... .......... .......... .......... .......... 97% 22.7M 0s 2024-08-24T21:12:11.344 INFO:tasks.workunit.client.0.smithi179.stderr:164350K .......... .......... .......... .......... .......... 97% 25.4M 0s 2024-08-24T21:12:11.346 INFO:tasks.workunit.client.0.smithi179.stderr:164400K .......... .......... .......... .......... .......... 97% 22.8M 0s 2024-08-24T21:12:11.348 INFO:tasks.workunit.client.0.smithi179.stderr:164450K .......... .......... .......... .......... .......... 97% 27.5M 0s 2024-08-24T21:12:11.350 INFO:tasks.workunit.client.0.smithi179.stderr:164500K .......... .......... .......... .......... .......... 97% 25.5M 0s 2024-08-24T21:12:11.351 INFO:tasks.workunit.client.0.smithi179.stderr:164550K .......... .......... .......... .......... .......... 97% 34.7M 0s 2024-08-24T21:12:11.353 INFO:tasks.workunit.client.0.smithi179.stderr:164600K .......... .......... .......... .......... .......... 97% 24.5M 0s 2024-08-24T21:12:11.354 INFO:tasks.workunit.client.0.smithi179.stderr:164650K .......... .......... .......... .......... .......... 97% 44.8M 0s 2024-08-24T21:12:11.356 INFO:tasks.workunit.client.0.smithi179.stderr:164700K .......... .......... .......... .......... .......... 97% 24.6M 0s 2024-08-24T21:12:11.359 INFO:tasks.workunit.client.0.smithi179.stderr:164750K .......... .......... .......... .......... .......... 97% 21.6M 0s 2024-08-24T21:12:11.360 INFO:tasks.workunit.client.0.smithi179.stderr:164800K .......... .......... .......... .......... .......... 97% 39.1M 0s 2024-08-24T21:12:11.362 INFO:tasks.workunit.client.0.smithi179.stderr:164850K .......... .......... .......... .......... .......... 97% 22.1M 0s 2024-08-24T21:12:11.363 INFO:tasks.workunit.client.0.smithi179.stderr:164900K .......... .......... .......... .......... .......... 97% 28.5M 0s 2024-08-24T21:12:11.365 INFO:tasks.workunit.client.0.smithi179.stderr:164950K .......... .......... .......... .......... .......... 97% 35.5M 0s 2024-08-24T21:12:11.367 INFO:tasks.workunit.client.0.smithi179.stderr:165000K .......... .......... .......... .......... .......... 97% 24.7M 0s 2024-08-24T21:12:11.368 INFO:tasks.workunit.client.0.smithi179.stderr:165050K .......... .......... .......... .......... .......... 97% 33.8M 0s 2024-08-24T21:12:11.370 INFO:tasks.workunit.client.0.smithi179.stderr:165100K .......... .......... .......... .......... .......... 97% 23.5M 0s 2024-08-24T21:12:11.373 INFO:tasks.workunit.client.0.smithi179.stderr:165150K .......... .......... .......... .......... .......... 98% 22.9M 0s 2024-08-24T21:12:11.374 INFO:tasks.workunit.client.0.smithi179.stderr:165200K .......... .......... .......... .......... .......... 98% 43.4M 0s 2024-08-24T21:12:11.376 INFO:tasks.workunit.client.0.smithi179.stderr:165250K .......... .......... .......... .......... .......... 98% 24.1M 0s 2024-08-24T21:12:11.377 INFO:tasks.workunit.client.0.smithi179.stderr:165300K .......... .......... .......... .......... .......... 98% 42.4M 0s 2024-08-24T21:12:11.379 INFO:tasks.workunit.client.0.smithi179.stderr:165350K .......... .......... .......... .......... .......... 98% 24.2M 0s 2024-08-24T21:12:11.381 INFO:tasks.workunit.client.0.smithi179.stderr:165400K .......... .......... .......... .......... .......... 98% 21.2M 0s 2024-08-24T21:12:11.382 INFO:tasks.workunit.client.0.smithi179.stderr:165450K .......... .......... .......... .......... .......... 98% 48.7M 0s 2024-08-24T21:12:11.384 INFO:tasks.workunit.client.0.smithi179.stderr:165500K .......... .......... .......... .......... .......... 98% 24.1M 0s 2024-08-24T21:12:11.386 INFO:tasks.workunit.client.0.smithi179.stderr:165550K .......... .......... .......... .......... .......... 98% 24.5M 0s 2024-08-24T21:12:11.387 INFO:tasks.workunit.client.0.smithi179.stderr:165600K .......... .......... .......... .......... .......... 98% 34.6M 0s 2024-08-24T21:12:11.390 INFO:tasks.workunit.client.0.smithi179.stderr:165650K .......... .......... .......... .......... .......... 98% 24.2M 0s 2024-08-24T21:12:11.391 INFO:tasks.workunit.client.0.smithi179.stderr:165700K .......... .......... .......... .......... .......... 98% 40.3M 0s 2024-08-24T21:12:11.393 INFO:tasks.workunit.client.0.smithi179.stderr:165750K .......... .......... .......... .......... .......... 98% 22.1M 0s 2024-08-24T21:12:11.394 INFO:tasks.workunit.client.0.smithi179.stderr:165800K .......... .......... .......... .......... .......... 98% 39.5M 0s 2024-08-24T21:12:11.395 INFO:tasks.workunit.client.0.smithi179.stderr:165850K .......... .......... .......... .......... .......... 98% 31.9M 0s 2024-08-24T21:12:11.397 INFO:tasks.workunit.client.0.smithi179.stderr:165900K .......... .......... .......... .......... .......... 98% 34.6M 0s 2024-08-24T21:12:11.401 INFO:tasks.workunit.client.0.smithi179.stderr:165950K .......... .......... .......... .......... .......... 98% 15.3M 0s 2024-08-24T21:12:11.402 INFO:tasks.workunit.client.0.smithi179.stderr:166000K .......... .......... .......... .......... .......... 98% 36.4M 0s 2024-08-24T21:12:11.403 INFO:tasks.workunit.client.0.smithi179.stderr:166050K .......... .......... .......... .......... .......... 98% 29.0M 0s 2024-08-24T21:12:11.405 INFO:tasks.workunit.client.0.smithi179.stderr:166100K .......... .......... .......... .......... .......... 98% 37.9M 0s 2024-08-24T21:12:11.407 INFO:tasks.workunit.client.0.smithi179.stderr:166150K .......... .......... .......... .......... .......... 98% 23.5M 0s 2024-08-24T21:12:11.408 INFO:tasks.workunit.client.0.smithi179.stderr:166200K .......... .......... .......... .......... .......... 98% 49.8M 0s 2024-08-24T21:12:11.410 INFO:tasks.workunit.client.0.smithi179.stderr:166250K .......... .......... .......... .......... .......... 98% 20.0M 0s 2024-08-24T21:12:11.412 INFO:tasks.workunit.client.0.smithi179.stderr:166300K .......... .......... .......... .......... .......... 98% 42.6M 0s 2024-08-24T21:12:11.413 INFO:tasks.workunit.client.0.smithi179.stderr:166350K .......... .......... .......... .......... .......... 98% 26.0M 0s 2024-08-24T21:12:11.415 INFO:tasks.workunit.client.0.smithi179.stderr:166400K .......... .......... .......... .......... .......... 98% 23.1M 0s 2024-08-24T21:12:11.416 INFO:tasks.workunit.client.0.smithi179.stderr:166450K .......... .......... .......... .......... .......... 98% 40.9M 0s 2024-08-24T21:12:11.418 INFO:tasks.workunit.client.0.smithi179.stderr:166500K .......... .......... .......... .......... .......... 98% 25.8M 0s 2024-08-24T21:12:11.421 INFO:tasks.workunit.client.0.smithi179.stderr:166550K .......... .......... .......... .......... .......... 98% 21.8M 0s 2024-08-24T21:12:11.422 INFO:tasks.workunit.client.0.smithi179.stderr:166600K .......... .......... .......... .......... .......... 98% 44.6M 0s 2024-08-24T21:12:11.423 INFO:tasks.workunit.client.0.smithi179.stderr:166650K .......... .......... .......... .......... .......... 98% 26.3M 0s 2024-08-24T21:12:11.425 INFO:tasks.workunit.client.0.smithi179.stderr:166700K .......... .......... .......... .......... .......... 98% 30.8M 0s 2024-08-24T21:12:11.427 INFO:tasks.workunit.client.0.smithi179.stderr:166750K .......... .......... .......... .......... .......... 98% 22.5M 0s 2024-08-24T21:12:11.430 INFO:tasks.workunit.client.0.smithi179.stderr:166800K .......... .......... .......... .......... .......... 98% 20.4M 0s 2024-08-24T21:12:11.432 INFO:tasks.workunit.client.0.smithi179.stderr:166850K .......... .......... .......... .......... .......... 99% 30.8M 0s 2024-08-24T21:12:11.433 INFO:tasks.workunit.client.0.smithi179.stderr:166900K .......... .......... .......... .......... .......... 99% 32.3M 0s 2024-08-24T21:12:11.434 INFO:tasks.workunit.client.0.smithi179.stderr:166950K .......... .......... .......... .......... .......... 99% 46.0M 0s 2024-08-24T21:12:11.436 INFO:tasks.workunit.client.0.smithi179.stderr:167000K .......... .......... .......... .......... .......... 99% 24.7M 0s 2024-08-24T21:12:11.437 INFO:tasks.workunit.client.0.smithi179.stderr:167050K .......... .......... .......... .......... .......... 99% 36.9M 0s 2024-08-24T21:12:11.439 INFO:tasks.workunit.client.0.smithi179.stderr:167100K .......... .......... .......... .......... .......... 99% 22.3M 0s 2024-08-24T21:12:11.442 INFO:tasks.workunit.client.0.smithi179.stderr:167150K .......... .......... .......... .......... .......... 99% 19.5M 0s 2024-08-24T21:12:11.443 INFO:tasks.workunit.client.0.smithi179.stderr:167200K .......... .......... .......... .......... .......... 99% 36.8M 0s 2024-08-24T21:12:11.445 INFO:tasks.workunit.client.0.smithi179.stderr:167250K .......... .......... .......... .......... .......... 99% 33.4M 0s 2024-08-24T21:12:11.447 INFO:tasks.workunit.client.0.smithi179.stderr:167300K .......... .......... .......... .......... .......... 99% 21.6M 0s 2024-08-24T21:12:11.448 INFO:tasks.workunit.client.0.smithi179.stderr:167350K .......... .......... .......... .......... .......... 99% 43.1M 0s 2024-08-24T21:12:11.450 INFO:tasks.workunit.client.0.smithi179.stderr:167400K .......... .......... .......... .......... .......... 99% 20.5M 0s 2024-08-24T21:12:11.452 INFO:tasks.workunit.client.0.smithi179.stderr:167450K .......... .......... .......... .......... .......... 99% 37.2M 0s 2024-08-24T21:12:11.454 INFO:tasks.workunit.client.0.smithi179.stderr:167500K .......... .......... .......... .......... .......... 99% 24.6M 0s 2024-08-24T21:12:11.456 INFO:tasks.workunit.client.0.smithi179.stderr:167550K .......... .......... .......... .......... .......... 99% 24.0M 0s 2024-08-24T21:12:11.457 INFO:tasks.workunit.client.0.smithi179.stderr:167600K .......... .......... .......... .......... .......... 99% 33.8M 0s 2024-08-24T21:12:11.459 INFO:tasks.workunit.client.0.smithi179.stderr:167650K .......... .......... .......... .......... .......... 99% 28.9M 0s 2024-08-24T21:12:11.461 INFO:tasks.workunit.client.0.smithi179.stderr:167700K .......... .......... .......... .......... .......... 99% 21.5M 0s 2024-08-24T21:12:11.462 INFO:tasks.workunit.client.0.smithi179.stderr:167750K .......... .......... .......... .......... .......... 99% 40.3M 0s 2024-08-24T21:12:11.467 INFO:tasks.workunit.client.0.smithi179.stderr:167800K .......... .......... .......... .......... .......... 99% 24.6M 0s 2024-08-24T21:12:11.467 INFO:tasks.workunit.client.0.smithi179.stderr:167850K .......... .......... .......... .......... .......... 99% 42.1M 0s 2024-08-24T21:12:11.468 INFO:tasks.workunit.client.0.smithi179.stderr:167900K .......... .......... .......... .......... .......... 99% 23.7M 0s 2024-08-24T21:12:11.469 INFO:tasks.workunit.client.0.smithi179.stderr:167950K .......... .......... .......... .......... .......... 99% 25.6M 0s 2024-08-24T21:12:11.471 INFO:tasks.workunit.client.0.smithi179.stderr:168000K .......... .......... .......... .......... .......... 99% 39.8M 0s 2024-08-24T21:12:11.473 INFO:tasks.workunit.client.0.smithi179.stderr:168050K .......... .......... .......... .......... .......... 99% 24.1M 0s 2024-08-24T21:12:11.474 INFO:tasks.workunit.client.0.smithi179.stderr:168100K .......... .......... .......... .......... .......... 99% 33.6M 0s 2024-08-24T21:12:11.476 INFO:tasks.workunit.client.0.smithi179.stderr:168150K .......... .......... .......... .......... .......... 99% 24.4M 0s 2024-08-24T21:12:11.477 INFO:tasks.workunit.client.0.smithi179.stderr:168200K .......... .......... .......... .......... .......... 99% 42.7M 0s 2024-08-24T21:12:11.479 INFO:tasks.workunit.client.0.smithi179.stderr:168250K .......... .......... .......... .......... .......... 99% 22.4M 0s 2024-08-24T21:12:11.482 INFO:tasks.workunit.client.0.smithi179.stderr:168300K .......... .......... .......... .......... .......... 99% 19.7M 0s 2024-08-24T21:12:11.484 INFO:tasks.workunit.client.0.smithi179.stderr:168350K .......... .......... .......... .......... .......... 99% 26.2M 0s 2024-08-24T21:12:11.486 INFO:tasks.workunit.client.0.smithi179.stderr:168400K .......... .......... .......... .......... .......... 99% 24.5M 0s 2024-08-24T21:12:11.487 INFO:tasks.workunit.client.0.smithi179.stderr:168450K .......... .......... .......... .......... .......... 99% 39.7M 0s 2024-08-24T21:12:11.489 INFO:tasks.workunit.client.0.smithi179.stderr:168500K .......... .......... .......... .......... .......... 99% 32.6M 0s 2024-08-24T21:12:11.489 INFO:tasks.workunit.client.0.smithi179.stderr:168550K .......... .......... . 100% 156M=6.1s 2024-08-24T21:12:11.489 INFO:tasks.workunit.client.0.smithi179.stderr: 2024-08-24T21:12:11.490 INFO:tasks.workunit.client.0.smithi179.stderr:2024-08-24 21:12:11 (27.1 MB/s) - ‘linux-5.4.tar.gz’ saved [172616875/172616875] 2024-08-24T21:12:11.490 INFO:tasks.workunit.client.0.smithi179.stderr: 2024-08-24T21:12:11.492 INFO:tasks.workunit.client.0.smithi179.stderr:+ untar_pid=12669 2024-08-24T21:12:11.492 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=1 2024-08-24T21:12:11.492 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap1 2024-08-24T21:12:11.492 INFO:tasks.workunit.client.0.smithi179.stderr:+ untar_workload 2024-08-24T21:12:11.492 INFO:tasks.workunit.client.0.smithi179.stderr:+ local i 2024-08-24T21:12:11.492 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i = 0 )) 2024-08-24T21:12:11.492 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i < 10 )) 2024-08-24T21:12:11.492 INFO:tasks.workunit.client.0.smithi179.stderr:+ pv -L 10M linux-5.4.tar.gz 2024-08-24T21:12:11.767 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:12:11.779 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap1 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap1.diff 2024-08-24T21:12:11.936 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 6% complete... Exporting image: 18% complete... Exporting image: 31% complete... Exporting image: 43% complete... Exporting image: 50% complete... Exporting image: 56% complete... Exporting image: 100% complete...done. 2024-08-24T21:12:11.941 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:12:11.942 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=2 2024-08-24T21:12:11.942 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap2 2024-08-24T21:12:12.772 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:12:12.785 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 1 2024-08-24T21:12:13.788 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap1 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap2 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap2.diff 2024-08-24T21:12:13.865 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 100% complete...done. 2024-08-24T21:12:13.871 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:12:13.871 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=3 2024-08-24T21:12:13.871 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap3 2024-08-24T21:12:14.776 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:12:14.789 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 4 2024-08-24T21:12:18.792 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap2 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap3 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap3.diff 2024-08-24T21:12:18.869 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 100% complete...done. 2024-08-24T21:12:18.876 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:12:18.876 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=4 2024-08-24T21:12:18.876 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap4 2024-08-24T21:12:19.766 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:12:19.780 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 1 2024-08-24T21:12:20.783 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap3 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap4 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap4.diff 2024-08-24T21:12:21.020 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 100% complete...done. 2024-08-24T21:12:21.030 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:12:21.030 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=5 2024-08-24T21:12:21.030 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap5 2024-08-24T21:12:21.772 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:12:21.787 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 4 2024-08-24T21:12:23.875 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-08-24T21:12:23.875 INFO:tasks.ceph.mon.a:Restarting daemon 2024-08-24T21:12:23.875 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-08-24T21:12:23.881 INFO:tasks.ceph.mon.a:Started 2024-08-24T21:12:23.881 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:12:23.881 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:12:25.790 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap4 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap5 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap5.diff 2024-08-24T21:12:27.961 INFO:tasks.workunit.client.0.smithi179.stderr:+ tar -C ac6341a6-6d9d-4017-bb38-7eb07f2860fe-mnt -xzf ac6341a6-6d9d-4017-bb38-7eb07f2860fe-mnt/linux-5.4.tar.gz 2024-08-24T21:12:29.097 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 100% complete...done. 2024-08-24T21:12:29.104 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:12:29.104 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=6 2024-08-24T21:12:29.104 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap6 2024-08-24T21:12:30.262 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":22,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:12:30.286 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:12:30.286 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:12:30.286 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:12:30.340 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:12:30.352 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 3 2024-08-24T21:12:30.472 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:12:30.472 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:12:30.472 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:12:30.472 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:12:30.472 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 22, 2024-08-24T21:12:30.472 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 6433, 2024-08-24T21:12:30.472 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:12:30.473 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:12:30.473 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:12:30.473 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:12:30.473 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:12:30.473 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:12:30.473 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:12:30.473 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:12:30.473 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:12:30.473 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:12:30.473 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:12:30.473 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:12:30.473 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:12:30.474 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:12:30.474 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:12:30.474 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:12:30.474 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:12:30.474 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:12:30.474 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:12:30.474 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:12:30.474 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:12:30.474 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:12:30.474 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:12:30.474 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:12:30.475 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:12:30.475 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:12:30.475 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:12:30.475 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:12:30.475 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:12:30.475 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:12:30.475 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:12:30.475 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:12:30.475 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:12:30.475 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:12:30.475 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:12:30.475 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:30.475 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:12:30.476 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:12:30.476 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:12:30.476 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:12:30.476 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:12:30.476 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:12:30.476 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:12:30.476 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:12:30.476 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:12:30.476 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:12:30.476 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:12:30.476 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:12:30.476 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:12:30.477 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:12:30.477 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:12:30.477 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:12:30.477 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:12:30.477 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:12:30.477 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:12:30.477 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:12:30.477 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:12:30.477 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:12:30.477 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:12:30.477 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:12:30.477 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:12:30.478 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:12:30.478 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:12:30.478 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:12:30.478 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:12:30.478 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:12:30.478 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:30.478 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:12:30.478 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:30.478 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:12:30.478 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:12:30.478 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:12:30.478 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:12:30.479 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:30.479 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:12:30.479 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:12:30.479 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:12:30.479 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:30.479 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:30.479 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:12:30.479 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:12:30.479 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:12:30.479 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:30.479 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:12:30.480 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:30.480 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:12:30.480 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:12:30.480 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:12:30.480 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:12:30.480 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:12:30.480 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:30.480 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:30.480 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:12:30.480 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:12:30.480 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:12:30.480 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:12:30.480 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:30.481 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:12:30.481 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:12:30.481 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:12:30.481 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:30.481 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:30.481 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:12:30.481 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:12:30.481 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:12:30.481 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:30.481 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:12:30.481 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:30.482 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:12:30.482 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:12:30.482 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:12:30.482 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:12:30.482 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:12:30.482 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:30.482 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:30.482 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:12:30.482 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:12:30.482 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:12:30.482 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:12:30.482 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:30.482 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:12:30.483 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:12:30.483 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:12:30.483 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:30.483 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:30.483 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:12:30.483 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:12:30.483 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:12:30.483 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:30.483 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:12:30.483 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:30.483 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:12:30.483 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:12:30.484 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:12:30.484 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:12:30.484 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:12:30.484 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:30.484 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:12:30.484 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:30.484 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:12:30.484 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:12:30.484 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:30.484 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:12:30.484 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:12:30.484 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:12:30.485 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:30.485 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:12:30.485 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:12:30.485 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:30.485 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:12:30.485 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:12:30.485 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:12:30.485 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:30.485 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:12:30.485 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:30.485 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:12:30.485 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:12:30.487 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:12:30.487 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:12:30.487 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:12:30.663 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:12:30.663 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:12:30.663 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:12:30.663 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:12:30.663 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 22, 2024-08-24T21:12:30.663 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 49959, 2024-08-24T21:12:30.663 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:12:30.663 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:12:30.663 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:12:30.663 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:12:30.664 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:12:30.664 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:12:30.664 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:12:30.664 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:12:30.664 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:12:30.664 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:12:30.664 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:12:30.664 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:12:30.664 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:12:30.664 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:12:30.664 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:12:30.664 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:12:30.664 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:12:30.665 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:12:30.665 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:12:30.665 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:12:30.665 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:12:30.665 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:12:30.665 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:12:30.665 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:12:30.665 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:12:30.665 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:12:30.665 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:12:30.665 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:12:30.665 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:12:30.665 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:12:30.666 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:12:30.666 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:12:30.666 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:12:30.666 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:12:30.666 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:12:30.666 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:30.666 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:12:30.666 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:12:30.666 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:12:30.666 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:12:30.666 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:12:30.666 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:12:30.667 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:12:30.667 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:12:30.667 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:12:30.667 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:12:30.667 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:12:30.667 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:12:30.667 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:12:30.667 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:12:30.667 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:12:30.667 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:12:30.667 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:12:30.667 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:12:30.668 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:12:30.668 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:12:30.668 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:12:30.668 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:12:30.668 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:12:30.668 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:12:30.668 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:12:30.668 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:12:30.668 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:12:30.668 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:12:30.668 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:12:30.668 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:12:30.668 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:30.669 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:12:30.669 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:30.669 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:12:30.669 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:12:30.669 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:12:30.669 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:12:30.669 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:30.669 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:12:30.669 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:12:30.669 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:12:30.669 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:30.669 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:30.669 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:12:30.670 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:12:30.670 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:12:30.670 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:30.670 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:12:30.670 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:30.670 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:12:30.670 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:12:30.670 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:12:30.670 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:12:30.670 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:12:30.670 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:30.670 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:30.671 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:12:30.671 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:12:30.671 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:12:30.671 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:12:30.671 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:30.671 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:12:30.671 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:12:30.671 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:12:30.671 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:30.671 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:30.671 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:12:30.671 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:12:30.671 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:12:30.671 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:30.672 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:12:30.672 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:30.672 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:12:30.672 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:12:30.672 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:12:30.672 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:12:30.672 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:12:30.672 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:30.672 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:30.672 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:12:30.672 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:12:30.672 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:12:30.672 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:12:30.673 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:30.673 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:12:30.673 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:12:30.673 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:12:30.673 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:30.673 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:30.673 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:12:30.673 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:12:30.673 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:12:30.673 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:30.673 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:12:30.673 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:30.673 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:12:30.674 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:12:30.674 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:12:30.674 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:12:30.674 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:12:30.674 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:30.674 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:12:30.674 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:30.674 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:12:30.674 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:12:30.674 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:30.674 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:12:30.674 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:12:30.674 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:12:30.674 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:30.675 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:12:30.675 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:12:30.675 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:30.675 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:12:30.675 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:12:30.675 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:12:30.675 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:30.675 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:12:30.675 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:12:30.675 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:30.675 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x2f018fb87aa4aafe", 2024-08-24T21:12:30.675 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "luminous", 2024-08-24T21:12:30.675 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:12:30.675 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:30.676 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:30.676 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:12:30.676 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:12:30.676 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:12:30.676 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:30.676 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:12:30.676 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:30.676 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:12:30.676 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:12:30.678 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:12:30.678 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:12:30.678 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:12:30.855 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:12:30.855 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:12:30.855 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:12:30.855 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:12:30.855 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 22, 2024-08-24T21:12:30.855 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 127237, 2024-08-24T21:12:30.855 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:12:30.855 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:12:30.855 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:12:30.855 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:12:30.855 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:12:30.856 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:12:30.856 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:12:30.856 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:12:30.856 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:12:30.856 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:12:30.856 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:12:30.856 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:12:30.856 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:12:30.856 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:12:30.856 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:12:30.856 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:12:30.856 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:12:30.856 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:12:30.857 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:12:30.857 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:12:30.857 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:12:30.857 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:12:30.857 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:12:30.857 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:12:30.857 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:12:30.857 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:12:30.857 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:12:30.857 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:12:30.857 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:12:30.857 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:12:30.857 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:12:30.858 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:12:30.858 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:12:30.858 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:12:30.858 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:12:30.858 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:30.858 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:12:30.858 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:12:30.858 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:12:30.858 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:12:30.858 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:12:30.858 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:12:30.858 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:12:30.859 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:12:30.859 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:12:30.859 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:12:30.859 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:12:30.859 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:12:30.859 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:12:30.859 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:12:30.859 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:12:30.859 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:12:30.859 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:12:30.860 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:12:30.860 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:12:30.860 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:12:30.860 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:12:30.860 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:12:30.860 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:12:30.860 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:12:30.860 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:12:30.860 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:12:30.860 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:12:30.860 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:12:30.860 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:12:30.861 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:12:30.861 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:30.861 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:12:30.861 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:30.861 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:12:30.861 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:12:30.861 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:12:30.861 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:12:30.861 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:30.861 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:12:30.861 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:12:30.861 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:12:30.862 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:30.862 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:30.862 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:12:30.862 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:12:30.862 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:12:30.862 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:30.862 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:12:30.862 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:30.862 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:12:30.862 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:12:30.862 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:12:30.862 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:12:30.862 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:12:30.863 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:30.863 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:30.863 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:12:30.863 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:12:30.863 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:12:30.863 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:12:30.863 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:30.863 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:12:30.863 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:12:30.863 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:12:30.863 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:30.863 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:30.863 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:12:30.864 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:12:30.864 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:12:30.864 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:30.864 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:12:30.864 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:30.864 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:12:30.864 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:12:30.864 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:12:30.864 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:12:30.864 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:12:30.864 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:30.864 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:30.864 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:12:30.865 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:12:30.865 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:12:30.865 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:12:30.865 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:30.865 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:12:30.865 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:12:30.865 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:12:30.865 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:30.865 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:30.865 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:12:30.865 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:12:30.865 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:12:30.865 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:30.866 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:12:30.866 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:30.866 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:12:30.866 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:12:30.866 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:12:30.866 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:12:30.866 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:12:30.866 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:30.866 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:12:30.866 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:30.866 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:12:30.866 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:12:30.867 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:30.867 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:12:30.867 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:12:30.867 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:12:30.867 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:30.867 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:12:30.867 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:12:30.867 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:30.867 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:12:30.867 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:12:30.867 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:12:30.867 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:30.868 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:12:30.868 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:12:30.868 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:30.868 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:12:30.868 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:12:30.868 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:12:30.868 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:30.868 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:12:30.868 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:12:30.868 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:30.868 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:12:30.868 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:12:30.868 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:12:30.868 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:30.869 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:12:30.869 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:30.869 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:12:30.869 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:12:30.870 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:12:30.870 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-08-24T21:12:30.870 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-08-24T21:12:31.333 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-08-24T21:12:32.334 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:12:32.334 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:12:32.783 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":22,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:12:32.801 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:12:32.801 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-08-24T21:12:32.801 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:12:32.802 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:12:32.976 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:12:32.977 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:12:32.977 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:12:32.977 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:12:32.977 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 22, 2024-08-24T21:12:32.977 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 8938, 2024-08-24T21:12:32.977 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:12:32.977 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:12:32.977 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:12:32.977 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:12:32.977 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:12:32.977 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 2, 2024-08-24T21:12:32.978 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:12:32.978 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:12:32.978 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:12:32.978 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:12:32.978 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:12:32.978 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:12:32.978 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:12:32.978 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:12:32.978 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:12:32.978 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:12:32.978 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:12:32.978 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:12:32.978 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:12:32.978 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:12:32.979 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:12:32.979 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:12:32.979 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:12:32.979 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:12:32.979 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:12:32.979 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:12:32.979 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:12:32.979 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:12:32.979 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:12:32.979 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:12:32.979 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:12:32.979 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:12:32.979 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:12:32.980 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:12:32.980 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:12:32.980 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:32.980 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:12:32.980 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:12:32.980 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:12:32.980 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:12:32.980 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:12:32.980 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:12:32.980 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:12:32.980 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:12:32.980 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:12:32.980 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:12:32.981 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:12:32.981 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:12:32.981 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:12:32.981 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:12:32.981 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:12:32.981 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:12:32.981 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:12:32.981 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:12:32.981 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:12:32.981 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:12:32.981 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:12:32.981 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:12:32.981 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:12:32.981 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:12:32.982 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:12:32.982 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:12:32.982 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:12:32.982 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:12:32.982 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:12:32.982 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:12:32.982 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:32.982 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:12:32.982 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:32.982 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:12:32.982 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:12:32.982 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:12:32.982 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:12:32.982 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:32.983 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:12:32.983 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:12:32.983 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:12:32.983 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:32.983 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:32.983 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:12:32.983 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:12:32.983 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:12:32.983 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:32.983 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:12:32.983 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:32.983 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:12:32.983 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:12:32.984 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:12:32.984 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:12:32.984 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:12:32.984 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:32.984 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:32.984 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:12:32.984 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:12:32.984 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:12:32.984 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:12:32.984 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:32.984 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:12:32.984 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:12:32.984 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:12:32.985 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:32.985 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:32.985 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:12:32.985 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:12:32.985 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:12:32.985 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:32.985 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:12:32.985 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:32.985 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:12:32.985 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:12:32.985 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:12:32.985 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:12:32.985 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:12:32.985 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:32.985 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:32.986 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:12:32.986 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:12:32.986 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:12:32.986 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:12:32.986 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:32.986 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:12:32.986 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:12:32.986 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:12:32.986 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:32.986 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:32.986 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:12:32.986 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:12:32.986 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:12:32.987 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:32.987 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:12:32.987 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:32.987 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:12:32.987 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:12:32.987 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:12:32.987 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:12:32.987 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:12:32.987 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:32.987 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:12:32.987 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:32.987 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:12:32.988 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:12:32.988 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:32.988 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:12:32.988 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:12:32.988 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:12:32.988 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:32.988 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:12:32.988 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:12:32.988 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:32.988 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:12:32.988 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:12:32.988 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:12:32.988 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:32.988 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:12:32.988 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:32.989 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:12:32.989 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:12:32.992 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:12:32.992 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:12:32.992 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:12:33.169 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:12:33.169 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:12:33.169 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:12:33.169 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:12:33.169 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 22, 2024-08-24T21:12:33.169 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 52466, 2024-08-24T21:12:33.169 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:12:33.169 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:12:33.170 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:12:33.170 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:12:33.170 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:12:33.170 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 2, 2024-08-24T21:12:33.170 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:12:33.170 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:12:33.170 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:12:33.170 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:12:33.170 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:12:33.170 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:12:33.170 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:12:33.170 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:12:33.170 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:12:33.170 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:12:33.171 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:12:33.171 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:12:33.171 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:12:33.171 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:12:33.171 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:12:33.171 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:12:33.171 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:12:33.171 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:12:33.171 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:12:33.171 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:12:33.171 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:12:33.171 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:12:33.171 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:12:33.172 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:12:33.172 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:12:33.172 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:12:33.172 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:12:33.172 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:12:33.172 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:12:33.172 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:33.172 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:12:33.172 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:12:33.172 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:12:33.172 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:12:33.172 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:12:33.172 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:12:33.173 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:12:33.173 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:12:33.173 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:12:33.173 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:12:33.173 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:12:33.173 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:12:33.173 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:12:33.173 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:12:33.173 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:12:33.173 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:12:33.173 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:12:33.173 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:12:33.173 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:12:33.174 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:12:33.174 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:12:33.174 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:12:33.174 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:12:33.174 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:12:33.174 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:12:33.174 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:12:33.174 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:12:33.174 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:12:33.174 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:12:33.174 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:12:33.174 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:33.174 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:12:33.175 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:33.175 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:12:33.175 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:12:33.175 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:12:33.175 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:12:33.175 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:33.175 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:12:33.175 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:12:33.175 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:12:33.175 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:33.175 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:33.175 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:12:33.175 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:12:33.176 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:12:33.176 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:33.176 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:12:33.176 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:33.176 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:12:33.176 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:12:33.176 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:12:33.176 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:12:33.176 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:12:33.176 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:33.176 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:33.176 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:12:33.176 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:12:33.177 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:12:33.177 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:12:33.177 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:33.177 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:12:33.177 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:12:33.177 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:12:33.177 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:33.177 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:33.177 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:12:33.177 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:12:33.177 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:12:33.177 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:33.177 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:12:33.177 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:33.178 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:12:33.178 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:12:33.178 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:12:33.178 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:12:33.178 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:12:33.178 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:33.178 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:33.178 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:12:33.178 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:12:33.178 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:12:33.178 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:12:33.178 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:33.178 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:12:33.179 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:12:33.179 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:12:33.179 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:33.179 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:33.179 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:12:33.179 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:12:33.179 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:12:33.179 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:33.179 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:12:33.179 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:33.179 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:12:33.179 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:12:33.179 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:12:33.180 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:12:33.180 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:12:33.180 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:33.180 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:12:33.180 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:33.180 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:12:33.180 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:12:33.180 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:33.180 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:12:33.180 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:12:33.180 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:12:33.180 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:33.180 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:12:33.181 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:12:33.181 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:33.181 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:12:33.181 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:12:33.181 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:12:33.181 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:33.181 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:12:33.181 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:12:33.181 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:33.181 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x2f018fb87aa4aafe", 2024-08-24T21:12:33.181 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "luminous", 2024-08-24T21:12:33.181 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:12:33.181 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:33.181 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:33.182 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:12:33.182 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:12:33.182 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:12:33.182 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:33.182 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:12:33.182 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:33.182 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:12:33.182 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:12:33.183 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:12:33.184 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:12:33.184 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:12:33.354 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap5 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap6 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap6.diff 2024-08-24T21:12:33.456 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:12:33.456 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:12:33.457 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:12:33.457 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:12:33.457 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 22, 2024-08-24T21:12:33.457 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 129838, 2024-08-24T21:12:33.457 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:12:33.457 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:12:33.457 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:12:33.457 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:12:33.457 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:12:33.457 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 3, 2024-08-24T21:12:33.457 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:12:33.457 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:12:33.457 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:12:33.457 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:12:33.458 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:12:33.458 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:12:33.458 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:12:33.458 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:12:33.458 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:12:33.458 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:12:33.458 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:12:33.458 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:12:33.458 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:12:33.458 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:12:33.458 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:12:33.458 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:12:33.458 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:12:33.458 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:12:33.459 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:12:33.459 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:12:33.459 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:12:33.459 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:12:33.459 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:12:33.459 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:12:33.459 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:12:33.459 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:12:33.459 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:12:33.459 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:12:33.459 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:12:33.459 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:33.459 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:12:33.459 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:12:33.460 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:12:33.460 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:12:33.460 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:12:33.460 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:12:33.460 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:12:33.460 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:12:33.460 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:12:33.460 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:12:33.460 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:12:33.460 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:12:33.460 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:12:33.460 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:12:33.460 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:12:33.460 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:12:33.461 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:12:33.461 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:12:33.461 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:12:33.461 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:12:33.461 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:12:33.461 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:12:33.461 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:12:33.461 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:12:33.461 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:12:33.461 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:12:33.461 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:12:33.461 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:12:33.461 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:12:33.461 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:12:33.462 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:33.462 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:12:33.462 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:33.462 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:12:33.462 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:12:33.462 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:12:33.462 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:12:33.462 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:33.462 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:12:33.462 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:12:33.462 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:12:33.462 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:33.462 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:33.463 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:12:33.463 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:12:33.463 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:12:33.463 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:33.463 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:12:33.463 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:33.463 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:12:33.463 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:12:33.463 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:12:33.463 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:12:33.463 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:12:33.463 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:33.464 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:33.464 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:12:33.464 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:12:33.464 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:12:33.464 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:12:33.464 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:33.464 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:12:33.464 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:12:33.464 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:12:33.464 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:33.464 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:33.464 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:12:33.465 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:12:33.465 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:12:33.465 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:33.465 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:12:33.465 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:33.465 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:12:33.465 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:12:33.465 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:12:33.465 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:12:33.465 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:12:33.465 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:33.465 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:33.465 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:12:33.465 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:12:33.466 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:12:33.466 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:12:33.466 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:33.466 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:12:33.466 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:12:33.466 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:12:33.466 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:33.466 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:33.466 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:12:33.466 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:12:33.466 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:12:33.466 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:33.466 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:12:33.467 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:33.467 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:12:33.467 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:12:33.467 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:12:33.467 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:12:33.467 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:12:33.467 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:33.467 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:12:33.467 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:33.467 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:12:33.467 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:12:33.467 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:33.467 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:12:33.467 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:12:33.468 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:12:33.468 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:33.468 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:12:33.468 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:12:33.468 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:33.468 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:12:33.468 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:12:33.468 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:12:33.468 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:33.468 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:12:33.468 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:12:33.468 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:33.468 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:12:33.468 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:12:33.468 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:12:33.469 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:33.469 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:12:33.469 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:12:33.469 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:33.469 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:12:33.469 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:12:33.469 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:12:33.469 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:33.469 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:12:33.469 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:33.469 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:12:33.469 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:12:33.470 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 100% complete...done. 2024-08-24T21:12:33.470 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:12:33.470 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=7 2024-08-24T21:12:33.470 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap7 2024-08-24T21:12:33.481 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:12:33.481 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2024-08-24T21:12:33.481 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-08-24T21:12:33.481 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-08-24T21:12:33.482 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-08-24T21:12:33.482 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-08-24T21:12:33.482 INFO:teuthology.orchestra.run:waiting for 300 2024-08-24T21:12:33.508 INFO:tasks.ceph.mon.b:Stopped 2024-08-24T21:12:33.508 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-08-24T21:12:33.508 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:12:33.956 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":22,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:12:36.974 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:12:37.422 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":22,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:12:40.442 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:12:40.900 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":22,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":10,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:12:43.921 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:12:48.779 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:12:48.786 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":26,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:12:48.794 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 1 2024-08-24T21:12:48.815 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-08-24T21:12:48.815 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-08-24T21:12:48.815 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:12:49.085 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:12:49.085 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:12:49.085 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:12:49.086 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:12:49.086 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 26, 2024-08-24T21:12:49.086 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 25046, 2024-08-24T21:12:49.086 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:12:49.086 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:12:49.086 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:12:49.086 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:12:49.086 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 1, 2024-08-24T21:12:49.086 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:12:49.086 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:12:49.086 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:12:49.086 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:12:49.087 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:12:49.087 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:12:49.087 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:12:49.087 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:12:49.087 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:12:49.087 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:12:49.087 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:12:49.087 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:12:49.087 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:12:49.087 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:12:49.087 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:12:49.087 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:12:49.087 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:12:49.088 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:12:49.088 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:12:49.088 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:12:49.088 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:12:49.088 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:12:49.088 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:12:49.088 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:12:49.088 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:12:49.088 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:12:49.088 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:12:49.088 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:12:49.088 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:12:49.089 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:49.089 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:12:49.089 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:12:49.089 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:12:49.089 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:12:49.089 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:12:49.089 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:12:49.089 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:12:49.089 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:12:49.089 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:12:49.089 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:12:49.089 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:12:49.090 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:12:49.090 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:12:49.090 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:12:49.090 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:12:49.090 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:12:49.090 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:12:49.090 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:12:49.090 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:12:49.090 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:12:49.090 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:12:49.090 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:12:49.090 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:12:49.090 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:12:49.091 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:12:49.091 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:12:49.091 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:12:49.091 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:12:49.091 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:12:49.091 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:12:49.091 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:49.091 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:12:49.091 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:49.091 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:12:49.091 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:12:49.091 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:12:49.091 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:12:49.092 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:49.092 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:12:49.092 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:12:49.092 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:12:49.092 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:49.092 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:49.092 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:12:49.092 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:12:49.092 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:12:49.092 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:49.092 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:12:49.092 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:49.092 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:12:49.093 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:12:49.093 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:12:49.093 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:12:49.093 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:12:49.093 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:49.093 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:49.093 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:12:49.093 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:12:49.093 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:12:49.093 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:12:49.093 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:49.093 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:12:49.093 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:12:49.093 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:12:49.093 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:49.094 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:49.094 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:12:49.094 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:12:49.094 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:12:49.094 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:49.094 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:12:49.094 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:49.094 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:12:49.094 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:12:49.094 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:12:49.095 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:12:49.095 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:12:49.095 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:49.095 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:49.095 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:12:49.095 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:12:49.095 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:12:49.095 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:12:49.095 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:49.095 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:12:49.095 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:12:49.096 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:12:49.096 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:49.096 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:49.096 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:12:49.098 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:12:49.098 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:12:49.098 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:49.098 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:12:49.098 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:49.098 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:12:49.098 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:12:49.098 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:12:49.098 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:12:49.098 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:12:49.099 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:49.099 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:12:49.099 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:49.099 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:12:49.099 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:12:49.099 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:49.099 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:12:49.099 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:12:49.099 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:12:49.099 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:49.099 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:12:49.099 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:12:49.099 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:49.100 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:12:49.100 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:12:49.100 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:12:49.100 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:49.100 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:12:49.100 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:12:49.100 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:49.100 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:12:49.100 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:12:49.100 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-08-24T21:12:49.100 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:49.100 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:12:49.100 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:12:49.101 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:49.101 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:12:49.101 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:12:49.101 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:12:49.101 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:49.101 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:12:49.101 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:49.101 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:12:49.101 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:12:49.105 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:12:49.106 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-08-24T21:12:49.106 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:12:49.347 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:12:49.347 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:12:49.347 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:12:49.348 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:12:49.348 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 26, 2024-08-24T21:12:49.348 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 68644, 2024-08-24T21:12:49.348 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:12:49.348 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:12:49.348 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:12:49.348 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:12:49.348 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 1, 2024-08-24T21:12:49.348 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:12:49.348 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:12:49.348 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:12:49.348 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:12:49.348 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:12:49.349 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:12:49.349 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:12:49.349 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:12:49.349 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:12:49.349 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:12:49.349 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:12:49.349 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:12:49.349 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:12:49.349 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:12:49.349 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:12:49.349 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:12:49.349 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:12:49.350 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:12:49.350 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:12:49.350 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:12:49.350 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:12:49.350 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:12:49.350 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:12:49.350 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:12:49.350 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:12:49.350 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:12:49.350 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:12:49.350 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:12:49.350 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:12:49.351 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:49.351 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:12:49.351 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:12:49.351 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:12:49.351 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:12:49.351 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:12:49.351 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:12:49.351 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:12:49.351 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:12:49.351 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:12:49.351 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:12:49.351 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:12:49.351 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:12:49.352 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:12:49.352 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:12:49.352 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:12:49.352 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:12:49.352 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:12:49.352 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:12:49.352 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:12:49.352 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:12:49.352 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:12:49.352 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:12:49.352 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:12:49.352 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:12:49.353 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:12:49.353 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:12:49.353 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:12:49.353 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:12:49.353 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:12:49.353 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:12:49.353 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:49.353 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:12:49.353 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:49.353 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:12:49.353 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:12:49.353 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:12:49.353 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:12:49.353 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:49.354 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:12:49.354 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:12:49.354 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:12:49.354 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:49.354 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:49.354 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:12:49.354 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:12:49.354 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:12:49.354 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:49.354 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:12:49.354 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:49.354 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:12:49.354 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:12:49.354 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:12:49.355 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:12:49.355 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:12:49.355 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:49.355 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:49.355 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:12:49.355 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:12:49.355 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:12:49.355 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:12:49.355 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:49.355 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:12:49.355 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:12:49.355 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:12:49.356 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:49.356 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:49.356 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:12:49.356 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:12:49.356 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:12:49.356 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:49.356 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:12:49.356 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:49.356 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:12:49.356 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:12:49.356 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:12:49.356 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:12:49.357 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:12:49.357 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:49.357 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:49.357 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:12:49.357 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:12:49.357 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:12:49.357 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:12:49.357 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:49.357 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:12:49.357 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:12:49.357 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:12:49.357 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:49.357 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:49.357 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:12:49.358 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:12:49.358 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:12:49.358 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:49.358 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:12:49.358 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:49.358 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:12:49.358 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:12:49.358 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:12:49.358 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:12:49.358 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:12:49.358 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:49.358 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:12:49.358 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:49.359 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:12:49.359 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:12:49.359 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:49.359 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:12:49.359 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:12:49.359 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:12:49.359 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:49.359 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:12:49.359 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:12:49.359 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:49.359 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:12:49.359 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:12:49.360 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:12:49.360 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:49.360 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:12:49.360 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:12:49.360 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:49.360 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x2f018fb87aa4aafe", 2024-08-24T21:12:49.360 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "luminous", 2024-08-24T21:12:49.360 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:12:49.360 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:49.360 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:12:49.360 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:12:49.360 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:12:49.360 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:12:49.360 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:12:49.361 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:12:49.361 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:12:49.361 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:12:49.361 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:12:49.369 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:12:49.369 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-08-24T21:12:49.796 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap6 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap7 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap7.diff 2024-08-24T21:12:50.559 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 50% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:12:50.580 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:12:50.581 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=8 2024-08-24T21:12:50.581 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap8 2024-08-24T21:12:51.790 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:12:51.805 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 2 2024-08-24T21:12:53.808 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap7 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap8 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap8.diff 2024-08-24T21:12:55.254 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 50% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 100% complete...done. 2024-08-24T21:12:55.297 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:12:55.297 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=9 2024-08-24T21:12:55.297 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap9 2024-08-24T21:12:55.777 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:12:55.790 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 1 2024-08-24T21:12:56.653 INFO:tasks.workunit.client.0.smithi179.stderr:+ sync ac6341a6-6d9d-4017-bb38-7eb07f2860fe-mnt 2024-08-24T21:12:56.792 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap8 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap9 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap9.diff 2024-08-24T21:12:57.018 INFO:tasks.workunit.client.0.smithi179.stderr:+ rm -rf ac6341a6-6d9d-4017-bb38-7eb07f2860fe-mnt/linux-5.4 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-mnt/linux-5.4.tar.gz 2024-08-24T21:12:58.573 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 85% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 100% complete...done. 2024-08-24T21:12:58.611 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:12:58.612 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=10 2024-08-24T21:12:58.612 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap10 2024-08-24T21:12:58.765 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:12:58.777 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 3 2024-08-24T21:13:00.526 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:13:00.527 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i < 10 )) 2024-08-24T21:13:00.527 INFO:tasks.workunit.client.0.smithi179.stderr:+ pv -L 10M linux-5.4.tar.gz 2024-08-24T21:13:01.779 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap9 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap10 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap10.diff 2024-08-24T21:13:02.099 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 100% complete...done. 2024-08-24T21:13:02.110 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:13:02.110 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=11 2024-08-24T21:13:02.110 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap11 2024-08-24T21:13:02.269 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:13:02.282 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 1 2024-08-24T21:13:03.285 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap10 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap11 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap11.diff 2024-08-24T21:13:03.529 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 100% complete...done. 2024-08-24T21:13:03.542 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:13:03.542 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=12 2024-08-24T21:13:03.542 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap12 2024-08-24T21:13:04.281 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:13:04.295 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 1 2024-08-24T21:13:05.298 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap11 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap12 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap12.diff 2024-08-24T21:13:05.374 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 100% complete...done. 2024-08-24T21:13:05.380 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:13:05.380 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=13 2024-08-24T21:13:05.381 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap13 2024-08-24T21:13:06.283 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:13:06.298 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 4 2024-08-24T21:13:09.370 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-08-24T21:13:09.370 INFO:tasks.ceph.mon.b:Restarting daemon 2024-08-24T21:13:09.371 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-08-24T21:13:09.375 INFO:tasks.ceph.mon.b:Started 2024-08-24T21:13:09.375 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:13:09.376 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:13:09.824 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":26,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":22,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:13:10.301 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap12 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap13 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap13.diff 2024-08-24T21:13:10.377 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 100% complete...done. 2024-08-24T21:13:10.383 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:13:10.384 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=14 2024-08-24T21:13:10.384 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap14 2024-08-24T21:13:10.905 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:13:10.919 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 2 2024-08-24T21:13:12.843 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:13:12.922 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap13 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap14 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap14.diff 2024-08-24T21:13:13.015 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 100% complete...done. 2024-08-24T21:13:13.021 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:13:13.021 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=15 2024-08-24T21:13:13.022 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap15 2024-08-24T21:13:13.305 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":26,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":25,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:13:13.914 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:13:13.929 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 3 2024-08-24T21:13:16.324 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:13:16.776 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":28,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:13:16.795 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:13:16.795 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:13:16.795 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:13:16.932 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap14 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap15 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap15.diff 2024-08-24T21:13:16.970 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:13:16.970 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:13:16.970 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:13:16.970 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:13:16.970 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 28, 2024-08-24T21:13:16.970 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 52931, 2024-08-24T21:13:16.970 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:13:16.970 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:13:16.970 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:13:16.970 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:13:16.971 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:13:16.971 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 2, 2024-08-24T21:13:16.971 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:13:16.971 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:13:16.971 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:13:16.971 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:13:16.971 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:13:16.971 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:13:16.971 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:13:16.971 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:13:16.971 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:13:16.971 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:13:16.971 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:13:16.972 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:13:16.972 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:13:16.972 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:13:16.972 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:13:16.972 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:13:16.972 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:13:16.972 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:13:16.972 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:13:16.972 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:13:16.972 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:13:16.972 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:13:16.972 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:13:16.972 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:13:16.972 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:13:16.972 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:13:16.973 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:13:16.973 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:13:16.973 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:13:16.973 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:16.973 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:13:16.973 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:13:16.973 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:13:16.973 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:13:16.973 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:13:16.973 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:13:16.973 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:13:16.973 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:13:16.973 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:13:16.974 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:13:16.974 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:13:16.974 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:13:16.974 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:13:16.974 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:13:16.974 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:13:16.974 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:13:16.974 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:13:16.974 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:13:16.974 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:13:16.974 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:13:16.974 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:13:16.974 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:13:16.975 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:13:16.975 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:13:16.975 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:13:16.975 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:13:16.975 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:13:16.975 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:13:16.975 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:13:16.975 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:13:16.975 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:16.975 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:13:16.975 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:16.975 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:13:16.975 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:13:16.975 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:13:16.976 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:13:16.976 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:16.976 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:13:16.976 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:13:16.976 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:13:16.976 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:16.976 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:16.976 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:13:16.976 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:13:16.976 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:13:16.976 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:13:16.976 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:13:16.976 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:16.977 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:13:16.977 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:13:16.977 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:13:16.977 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:13:16.977 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:13:16.977 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:16.977 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:16.977 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:13:16.977 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:13:16.977 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:13:16.977 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:13:16.977 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:16.977 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:13:16.977 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:13:16.977 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:13:16.978 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:16.978 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:16.978 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:13:16.978 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:13:16.978 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:13:16.978 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:13:16.978 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:13:16.978 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:16.978 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:13:16.978 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:13:16.978 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:13:16.978 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:13:16.978 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:13:16.978 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:16.979 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:16.979 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:13:16.979 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:13:16.979 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:13:16.979 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:13:16.979 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:16.979 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:13:16.979 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:13:16.979 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:13:16.979 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:16.979 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:16.979 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:13:16.980 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:13:16.980 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:13:16.980 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:13:16.980 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:13:16.980 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:16.980 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:13:16.980 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:13:16.980 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:13:16.980 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:13:16.980 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:13:16.980 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:13:16.980 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:13:16.980 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:16.981 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:13:16.981 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:13:16.981 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:16.981 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:13:16.981 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:13:16.981 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:13:16.981 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:13:16.981 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:13:16.981 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:13:16.981 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:16.981 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:13:16.981 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:13:16.981 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:13:16.981 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:13:16.982 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:13:16.982 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:13:16.982 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:16.982 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:13:16.982 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:13:16.982 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-08-24T21:13:16.982 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:13:16.982 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:13:16.982 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:13:16.982 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:16.982 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:13:16.982 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:13:16.983 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:13:16.983 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:13:16.983 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:13:16.983 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:16.983 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:13:16.983 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:13:16.985 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:13:16.985 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:13:16.985 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:13:16.986 INFO:tasks.workunit.client.0.smithi179.stderr:+ tar -C ac6341a6-6d9d-4017-bb38-7eb07f2860fe-mnt -xzf ac6341a6-6d9d-4017-bb38-7eb07f2860fe-mnt/linux-5.4.tar.gz 2024-08-24T21:13:17.040 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 100% complete...done. 2024-08-24T21:13:17.050 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:13:17.050 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=16 2024-08-24T21:13:17.050 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap16 2024-08-24T21:13:17.170 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:13:17.170 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:13:17.170 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:13:17.170 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:13:17.170 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 28, 2024-08-24T21:13:17.170 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 96466, 2024-08-24T21:13:17.170 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:13:17.170 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:13:17.170 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:13:17.170 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:13:17.170 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:13:17.171 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 2, 2024-08-24T21:13:17.171 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:13:17.171 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:13:17.171 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:13:17.171 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:13:17.171 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:13:17.171 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:13:17.171 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:13:17.171 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:13:17.171 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:13:17.171 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:13:17.171 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:13:17.172 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:13:17.172 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:13:17.172 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:13:17.172 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:13:17.172 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:13:17.172 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:13:17.172 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:13:17.172 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:13:17.172 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:13:17.172 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:13:17.172 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:13:17.172 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:13:17.172 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:13:17.173 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:13:17.173 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:13:17.173 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:13:17.173 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:13:17.173 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:13:17.173 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:17.173 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:13:17.173 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:13:17.173 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:13:17.173 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:13:17.173 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:13:17.173 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:13:17.173 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:13:17.174 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:13:17.174 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:13:17.174 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:13:17.174 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:13:17.174 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:13:17.174 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:13:17.174 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:13:17.174 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:13:17.174 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:13:17.174 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:13:17.174 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:13:17.174 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:13:17.174 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:13:17.174 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:13:17.175 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:13:17.175 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:13:17.175 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:13:17.175 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:13:17.175 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:13:17.175 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:13:17.175 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:13:17.175 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:13:17.175 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:13:17.175 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:17.175 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:13:17.175 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:17.175 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:13:17.176 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:13:17.176 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:13:17.176 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:13:17.176 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:17.176 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:13:17.176 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:13:17.176 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:13:17.176 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:17.176 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:17.176 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:13:17.176 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:13:17.176 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:13:17.176 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:13:17.176 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:13:17.177 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:17.177 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:13:17.177 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:13:17.177 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:13:17.177 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:13:17.177 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:13:17.177 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:17.177 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:17.177 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:13:17.177 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:13:17.177 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:13:17.177 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:13:17.177 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:17.177 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:13:17.177 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:13:17.178 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:13:17.178 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:17.178 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:17.178 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:13:17.178 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:13:17.178 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:13:17.178 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:13:17.178 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:13:17.178 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:17.178 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:13:17.178 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:13:17.178 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:13:17.178 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:13:17.179 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:13:17.179 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:17.179 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:17.179 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:13:17.179 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:13:17.179 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:13:17.179 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:13:17.179 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:17.179 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:13:17.179 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:13:17.179 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:13:17.179 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:17.179 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:17.180 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:13:17.180 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:13:17.180 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:13:17.180 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:13:17.180 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:13:17.180 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:17.180 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:13:17.180 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:13:17.180 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:13:17.180 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:13:17.180 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:13:17.180 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:13:17.180 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:13:17.180 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:17.181 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:13:17.181 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:13:17.181 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:17.181 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:13:17.181 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:13:17.181 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:13:17.181 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:13:17.181 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:13:17.181 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:13:17.181 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:17.181 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:13:17.181 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:13:17.181 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:13:17.181 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:13:17.182 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:13:17.182 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:13:17.182 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:17.182 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x2f018fb87aa4aafe", 2024-08-24T21:13:17.182 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "luminous", 2024-08-24T21:13:17.182 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:13:17.182 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:17.182 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:17.182 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:13:17.182 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:13:17.182 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:13:17.182 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:13:17.182 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:13:17.183 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:17.183 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:13:17.183 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:13:17.185 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:13:17.185 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:13:17.185 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:13:17.361 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:13:17.362 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:13:17.362 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:13:17.362 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:13:17.362 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 28, 2024-08-24T21:13:17.362 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 7831, 2024-08-24T21:13:17.362 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:13:17.362 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:13:17.362 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:13:17.362 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:13:17.362 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:13:17.363 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 3, 2024-08-24T21:13:17.363 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:13:17.363 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:13:17.363 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:13:17.363 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:13:17.363 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:13:17.363 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:13:17.363 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:13:17.363 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:13:17.363 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:13:17.363 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:13:17.363 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:13:17.363 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:13:17.363 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:13:17.364 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:13:17.364 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:13:17.364 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:13:17.364 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:13:17.364 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:13:17.364 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:13:17.364 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:13:17.364 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:13:17.364 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:13:17.364 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:13:17.364 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:13:17.364 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:13:17.365 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:13:17.365 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:13:17.365 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:13:17.365 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:13:17.365 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:17.365 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:13:17.365 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:13:17.365 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:13:17.365 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:13:17.365 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:13:17.365 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:13:17.365 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:13:17.365 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:13:17.365 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:13:17.366 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:13:17.366 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:13:17.366 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:13:17.366 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:13:17.366 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:13:17.366 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:13:17.366 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:13:17.366 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:13:17.366 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:13:17.366 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:13:17.366 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:13:17.366 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:13:17.366 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:13:17.366 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:13:17.367 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:13:17.367 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:13:17.367 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:13:17.367 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:13:17.367 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:13:17.367 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:13:17.367 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:13:17.367 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:17.367 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:13:17.367 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:17.367 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:13:17.367 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:13:17.367 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:13:17.368 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:13:17.368 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:17.368 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:13:17.368 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:13:17.368 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:13:17.368 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:17.368 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:17.368 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:13:17.368 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:13:17.368 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:13:17.368 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:13:17.368 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:13:17.368 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:17.368 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:13:17.368 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:13:17.369 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:13:17.369 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:13:17.369 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:13:17.369 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:17.369 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:17.369 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:13:17.369 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:13:17.369 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:13:17.369 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:13:17.369 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:17.369 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:13:17.369 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:13:17.369 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:13:17.369 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:17.370 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:17.370 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:13:17.370 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:13:17.370 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:13:17.370 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:13:17.370 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:13:17.370 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:17.370 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:13:17.370 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:13:17.370 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:13:17.370 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:13:17.370 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:13:17.370 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:17.371 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:17.371 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:13:17.371 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:13:17.371 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:13:17.371 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:13:17.371 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:17.371 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:13:17.371 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:13:17.371 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:13:17.371 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:17.371 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:17.371 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:13:17.372 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:13:17.372 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:13:17.372 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:13:17.372 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:13:17.372 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:17.372 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:13:17.372 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:13:17.372 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:13:17.372 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:13:17.372 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:13:17.372 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:13:17.372 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:13:17.372 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:17.373 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:13:17.373 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:13:17.373 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:17.373 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:13:17.373 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:13:17.373 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:13:17.373 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:13:17.373 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:13:17.373 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:13:17.373 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:17.373 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:13:17.373 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:13:17.373 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:13:17.373 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:13:17.374 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:13:17.374 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:17.374 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:13:17.374 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:13:17.376 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:13:17.376 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-08-24T21:13:17.376 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-08-24T21:13:17.783 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:13:17.796 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 4 2024-08-24T21:13:17.843 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-08-24T21:13:18.844 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:13:18.844 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:13:19.294 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":28,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:13:19.312 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:13:19.312 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-08-24T21:13:19.312 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:13:19.312 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:13:19.487 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:13:19.487 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:13:19.487 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:13:19.487 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:13:19.488 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 28, 2024-08-24T21:13:19.488 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 55449, 2024-08-24T21:13:19.488 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:13:19.488 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:13:19.488 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:13:19.488 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:13:19.488 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:13:19.488 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 5, 2024-08-24T21:13:19.488 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:13:19.488 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:13:19.488 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:13:19.488 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:13:19.488 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:13:19.489 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:13:19.489 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:13:19.489 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:13:19.489 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:13:19.489 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:13:19.489 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:13:19.489 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:13:19.489 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:13:19.489 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:13:19.489 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:13:19.489 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:13:19.489 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:13:19.489 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:13:19.490 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:13:19.490 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:13:19.490 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:13:19.490 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:13:19.490 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:13:19.490 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:13:19.490 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:13:19.490 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:13:19.490 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:13:19.490 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:13:19.490 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:13:19.490 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:19.491 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:13:19.491 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:13:19.491 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:13:19.491 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:13:19.491 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:13:19.491 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:13:19.491 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:13:19.491 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:13:19.491 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:13:19.491 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:13:19.491 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:13:19.491 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:13:19.491 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:13:19.492 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:13:19.492 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:13:19.492 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:13:19.492 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:13:19.492 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:13:19.492 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:13:19.492 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:13:19.492 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:13:19.492 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:13:19.492 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:13:19.492 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:13:19.492 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:13:19.493 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:13:19.493 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:13:19.493 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:13:19.493 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:13:19.493 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:13:19.493 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:19.493 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:13:19.493 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:19.493 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:13:19.493 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:13:19.493 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:13:19.493 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:13:19.493 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:19.493 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:13:19.493 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:13:19.494 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:13:19.494 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:19.494 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:19.494 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:13:19.494 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:13:19.494 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:13:19.494 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:13:19.494 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:13:19.494 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:19.494 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:13:19.494 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:13:19.494 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:13:19.494 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:13:19.494 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:13:19.495 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:19.495 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:19.495 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:13:19.495 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:13:19.495 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:13:19.495 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:13:19.495 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:19.495 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:13:19.495 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:13:19.495 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:13:19.495 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:19.495 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:19.495 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:13:19.496 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:13:19.496 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:13:19.496 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:13:19.496 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:13:19.496 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:19.496 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:13:19.496 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:13:19.496 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:13:19.496 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:13:19.496 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:13:19.496 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:19.496 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:19.496 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:13:19.496 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:13:19.497 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:13:19.497 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:13:19.497 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:19.497 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:13:19.497 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:13:19.497 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:13:19.497 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:19.497 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:19.497 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:13:19.497 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:13:19.497 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:13:19.497 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:13:19.497 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:13:19.498 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:19.498 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:13:19.498 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:13:19.498 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:13:19.498 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:13:19.498 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:13:19.498 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:13:19.498 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:13:19.498 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:19.498 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:13:19.498 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:13:19.498 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:19.498 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:13:19.498 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:13:19.498 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:13:19.499 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:13:19.499 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:13:19.499 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:13:19.499 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:19.499 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:13:19.499 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:13:19.499 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:13:19.499 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:13:19.499 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:13:19.499 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:13:19.499 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:19.499 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:13:19.499 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:13:19.500 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:13:19.500 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:13:19.500 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:13:19.500 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:13:19.500 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:19.500 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:13:19.500 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:13:19.500 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:13:19.500 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:13:19.500 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:13:19.500 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:19.500 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:13:19.500 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:13:19.502 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:13:19.502 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:13:19.502 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:13:19.677 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:13:19.677 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:13:19.677 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:13:19.677 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:13:19.677 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 28, 2024-08-24T21:13:19.677 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 98973, 2024-08-24T21:13:19.677 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:13:19.677 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:13:19.677 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:13:19.677 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:13:19.678 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:13:19.678 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 5, 2024-08-24T21:13:19.678 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:13:19.678 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:13:19.678 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:13:19.678 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:13:19.678 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:13:19.678 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:13:19.678 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:13:19.678 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:13:19.678 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:13:19.678 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:13:19.678 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:13:19.679 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:13:19.679 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:13:19.679 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:13:19.679 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:13:19.679 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:13:19.679 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:13:19.679 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:13:19.679 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:13:19.679 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:13:19.679 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:13:19.679 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:13:19.679 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:13:19.679 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:13:19.680 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:13:19.680 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:13:19.680 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:13:19.680 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:13:19.680 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:13:19.680 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:19.680 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:13:19.680 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:13:19.680 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:13:19.680 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:13:19.680 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:13:19.680 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:13:19.680 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:13:19.680 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:13:19.681 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:13:19.681 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:13:19.681 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:13:19.681 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:13:19.681 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:13:19.681 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:13:19.681 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:13:19.681 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:13:19.681 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:13:19.681 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:13:19.681 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:13:19.681 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:13:19.681 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:13:19.681 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:13:19.682 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:13:19.682 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:13:19.682 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:13:19.682 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:13:19.682 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:13:19.682 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:13:19.682 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:13:19.682 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:13:19.682 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:19.682 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:13:19.682 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:19.682 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:13:19.682 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:13:19.683 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:13:19.683 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:13:19.683 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:19.683 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:13:19.683 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:13:19.683 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:13:19.683 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:19.683 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:19.683 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:13:19.683 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:13:19.683 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:13:19.683 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:13:19.683 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:13:19.684 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:19.684 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:13:19.684 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:13:19.684 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:13:19.684 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:13:19.684 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:13:19.684 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:19.684 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:19.684 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:13:19.684 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:13:19.684 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:13:19.684 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:13:19.685 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:19.685 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:13:19.685 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:13:19.685 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:13:19.685 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:19.685 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:19.685 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:13:19.685 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:13:19.685 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:13:19.685 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:13:19.685 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:13:19.685 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:19.685 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:13:19.685 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:13:19.686 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:13:19.686 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:13:19.686 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:13:19.686 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:19.686 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:19.686 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:13:19.686 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:13:19.686 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:13:19.686 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:13:19.686 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:19.686 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:13:19.686 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:13:19.687 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:13:19.687 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:19.687 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:19.687 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:13:19.687 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:13:19.687 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:13:19.687 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:13:19.687 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:13:19.687 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:19.687 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:13:19.687 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:13:19.687 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:13:19.687 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:13:19.688 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:13:19.688 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:13:19.688 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:13:19.688 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:19.688 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:13:19.688 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:13:19.688 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:19.688 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:13:19.688 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:13:19.688 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:13:19.688 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:13:19.688 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:13:19.688 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:13:19.689 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:19.689 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:13:19.689 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:13:19.689 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:13:19.689 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:13:19.689 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:13:19.689 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:13:19.689 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:19.689 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x2f018fb87aa4aafe", 2024-08-24T21:13:19.689 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "luminous", 2024-08-24T21:13:19.689 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:13:19.689 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:19.690 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:19.690 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:13:19.690 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:13:19.690 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:13:19.690 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:13:19.690 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:13:19.690 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:19.690 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:13:19.690 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:13:19.692 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:13:19.692 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:13:19.692 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:13:19.869 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:13:19.870 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:13:19.870 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:13:19.870 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:13:19.870 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 28, 2024-08-24T21:13:19.870 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 10339, 2024-08-24T21:13:19.870 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:13:19.870 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:13:19.870 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:13:19.870 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:13:19.870 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:13:19.870 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 5, 2024-08-24T21:13:19.870 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:13:19.871 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:13:19.871 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:13:19.871 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:13:19.871 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:13:19.871 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:13:19.871 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:13:19.871 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:13:19.871 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:13:19.871 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:13:19.871 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:13:19.871 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:13:19.871 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:13:19.871 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:13:19.872 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:13:19.872 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:13:19.872 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:13:19.872 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:13:19.872 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:13:19.872 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:13:19.872 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:13:19.872 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:13:19.872 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:13:19.872 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:13:19.872 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:13:19.872 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:13:19.873 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:13:19.873 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:13:19.873 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:13:19.873 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:19.873 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:13:19.873 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:13:19.873 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:13:19.873 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:13:19.873 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:13:19.873 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:13:19.873 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:13:19.873 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:13:19.873 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:13:19.873 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:13:19.874 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:13:19.874 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:13:19.874 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:13:19.874 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:13:19.874 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:13:19.874 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:13:19.874 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:13:19.874 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:13:19.874 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:13:19.874 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:13:19.874 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:13:19.874 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:13:19.874 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:13:19.875 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:13:19.875 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:13:19.875 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:13:19.875 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:13:19.875 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:13:19.875 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:13:19.875 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:13:19.875 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:19.875 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:13:19.875 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:19.875 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:13:19.875 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:13:19.875 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:13:19.875 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:13:19.876 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:19.876 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:13:19.876 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:13:19.876 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:13:19.876 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:19.876 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:19.876 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:13:19.876 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:13:19.876 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:13:19.876 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:13:19.876 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:13:19.876 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:19.876 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:13:19.876 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:13:19.877 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:13:19.877 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:13:19.877 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:13:19.877 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:19.877 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:19.877 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:13:19.877 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:13:19.877 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:13:19.877 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:13:19.877 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:19.877 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:13:19.877 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:13:19.877 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:13:19.877 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:19.878 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:19.878 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:13:19.878 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:13:19.878 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:13:19.878 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:13:19.878 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:13:19.878 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:19.878 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:13:19.878 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:13:19.878 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:13:19.878 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:13:19.878 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:13:19.878 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:19.878 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:19.879 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:13:19.879 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:13:19.879 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:13:19.879 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:13:19.879 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:19.879 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:13:19.879 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:13:19.879 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:13:19.879 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:19.879 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:19.879 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:13:19.879 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:13:19.879 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:13:19.879 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:13:19.880 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:13:19.880 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:19.880 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:13:19.880 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:13:19.880 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:13:19.880 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:13:19.880 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:13:19.880 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:13:19.880 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:13:19.880 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:19.880 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:13:19.880 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:13:19.880 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:19.880 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:13:19.881 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:13:19.881 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:13:19.881 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:13:19.881 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:13:19.881 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:13:19.881 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:19.881 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:13:19.881 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:13:19.881 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:13:19.881 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:13:19.881 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:13:19.881 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:19.881 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:13:19.881 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:13:19.884 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:13:19.884 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2024-08-24T21:13:19.884 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-08-24T21:13:19.885 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-08-24T21:13:19.885 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-08-24T21:13:19.885 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-08-24T21:13:19.885 INFO:teuthology.orchestra.run:waiting for 300 2024-08-24T21:13:19.904 INFO:tasks.ceph.mon.b:Stopped 2024-08-24T21:13:19.904 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-08-24T21:13:19.904 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:13:20.338 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":28,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":6,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:13:21.798 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap15 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap16 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap16.diff 2024-08-24T21:13:21.910 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 100% complete...done. 2024-08-24T21:13:21.919 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:13:21.919 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=17 2024-08-24T21:13:21.919 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap17 2024-08-24T21:13:23.357 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:13:23.804 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":28,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":9,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:13:26.822 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:13:27.267 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":28,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:13:30.286 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:13:35.074 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":32,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:13:35.092 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-08-24T21:13:35.092 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-08-24T21:13:35.092 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:13:35.267 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:13:35.267 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:13:35.268 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:13:35.268 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:13:35.268 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 32, 2024-08-24T21:13:35.268 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 71229, 2024-08-24T21:13:35.268 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:13:35.268 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:13:35.268 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:13:35.268 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:13:35.268 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:13:35.268 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:13:35.268 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:13:35.268 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:13:35.269 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:13:35.269 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:13:35.269 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:13:35.269 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:13:35.269 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:13:35.269 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:13:35.269 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:13:35.269 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:13:35.269 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:13:35.269 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:13:35.269 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:13:35.269 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:13:35.269 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:13:35.270 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:13:35.270 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:13:35.270 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:13:35.270 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:13:35.270 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:13:35.270 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:13:35.270 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:13:35.270 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:13:35.270 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:13:35.270 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:13:35.270 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:13:35.270 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:13:35.271 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:13:35.271 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:35.271 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:13:35.271 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:13:35.271 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:13:35.271 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:13:35.271 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:13:35.271 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:13:35.271 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:13:35.271 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:13:35.271 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:13:35.271 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:13:35.271 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:13:35.272 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:13:35.272 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:13:35.272 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:13:35.272 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:13:35.272 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:13:35.272 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:13:35.272 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:13:35.272 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:13:35.272 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:13:35.272 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:13:35.272 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:13:35.272 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:13:35.272 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:13:35.273 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:13:35.273 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:13:35.273 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:13:35.273 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:13:35.273 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:13:35.273 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:13:35.273 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:35.273 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:13:35.273 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:35.273 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:13:35.273 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:13:35.273 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:13:35.273 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:13:35.274 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:35.274 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:13:35.274 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:13:35.274 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:13:35.274 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:35.274 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:35.274 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:13:35.274 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:13:35.274 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:13:35.274 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:13:35.274 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:13:35.274 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:35.274 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:13:35.275 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:13:35.275 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:13:35.275 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:13:35.275 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:13:35.275 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:35.275 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:35.275 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:13:35.275 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:13:35.275 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:13:35.275 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:13:35.275 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:35.275 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:13:35.276 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:13:35.276 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:13:35.276 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:35.276 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:35.276 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:13:35.276 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:13:35.276 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:13:35.276 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:13:35.276 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:13:35.276 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:35.276 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:13:35.276 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:13:35.276 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:13:35.276 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:13:35.277 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:13:35.277 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:35.277 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:35.277 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:13:35.277 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:13:35.277 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:13:35.277 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:13:35.277 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:35.277 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:13:35.277 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:13:35.277 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:13:35.277 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:35.277 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:35.277 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:13:35.278 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:13:35.278 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:13:35.278 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:13:35.278 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:13:35.278 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:35.278 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:13:35.278 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:13:35.278 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:13:35.278 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:13:35.278 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:13:35.278 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:13:35.279 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:13:35.279 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:35.279 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:13:35.279 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:13:35.279 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:35.279 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:13:35.279 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:13:35.279 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:13:35.279 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:13:35.279 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:13:35.279 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:13:35.279 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:35.279 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:13:35.280 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:13:35.280 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:13:35.280 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:13:35.280 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:13:35.280 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:13:35.280 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:35.280 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:13:35.280 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:13:35.280 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:13:35.280 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:13:35.280 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:13:35.280 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:13:35.280 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:35.281 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:13:35.281 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:13:35.281 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:13:35.281 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:13:35.281 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:13:35.281 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:35.281 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:13:35.281 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:13:35.283 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:13:35.283 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-08-24T21:13:35.283 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:13:35.458 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:13:35.459 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:13:35.459 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:13:35.459 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:13:35.459 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 32, 2024-08-24T21:13:35.459 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 114754, 2024-08-24T21:13:35.459 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:13:35.459 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:13:35.459 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:13:35.459 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:13:35.459 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:13:35.460 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:13:35.460 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:13:35.460 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:13:35.460 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:13:35.460 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:13:35.460 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:13:35.460 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:13:35.460 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:13:35.460 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:13:35.460 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:13:35.460 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:13:35.460 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:13:35.461 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:13:35.461 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:13:35.461 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:13:35.461 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:13:35.461 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:13:35.461 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:13:35.461 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:13:35.461 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:13:35.461 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:13:35.461 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:13:35.461 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:13:35.461 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:13:35.461 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:13:35.462 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:13:35.462 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:13:35.462 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:13:35.462 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:13:35.462 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:35.462 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:13:35.462 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:13:35.462 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:13:35.462 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:13:35.462 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:13:35.462 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:13:35.462 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:13:35.462 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:13:35.463 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:13:35.463 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:13:35.463 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:13:35.463 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:13:35.463 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:13:35.463 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:13:35.463 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:13:35.463 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:13:35.463 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:13:35.463 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:13:35.463 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:13:35.463 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:13:35.464 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:13:35.464 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:13:35.464 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:13:35.464 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:13:35.464 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:13:35.464 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:13:35.464 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:13:35.464 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:13:35.464 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:13:35.464 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:13:35.464 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:35.464 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:13:35.465 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:35.465 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:13:35.465 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:13:35.465 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:13:35.465 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:13:35.465 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:35.465 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:13:35.465 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:13:35.465 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:13:35.465 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:35.465 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:35.465 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:13:35.465 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:13:35.465 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:13:35.466 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:13:35.466 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:13:35.466 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:35.466 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:13:35.466 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:13:35.466 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:13:35.466 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:13:35.466 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:13:35.466 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:35.466 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:35.466 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:13:35.466 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:13:35.466 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:13:35.467 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:13:35.467 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:35.467 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:13:35.467 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:13:35.467 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:13:35.467 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:35.467 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:35.467 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:13:35.467 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:13:35.467 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:13:35.467 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:13:35.467 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:13:35.467 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:35.468 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:13:35.468 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:13:35.468 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:13:35.468 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:13:35.468 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:13:35.468 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:35.468 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:35.468 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:13:35.468 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:13:35.468 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:13:35.468 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:13:35.468 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:35.468 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:13:35.469 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:13:35.469 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:13:35.469 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:35.469 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:35.469 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:13:35.469 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:13:35.469 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:13:35.469 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:13:35.469 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:13:35.469 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:35.469 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:13:35.469 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:13:35.469 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:13:35.469 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:13:35.470 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:13:35.470 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:13:35.470 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:13:35.470 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:35.470 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:13:35.470 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:13:35.470 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:35.470 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:13:35.470 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:13:35.470 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:13:35.470 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:13:35.470 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:13:35.470 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:13:35.471 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:35.471 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:13:35.471 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:13:35.471 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:13:35.471 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:13:35.471 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:13:35.471 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:13:35.471 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:35.471 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x2f018fb87aa4aafe", 2024-08-24T21:13:35.471 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "luminous", 2024-08-24T21:13:35.471 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:13:35.471 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:35.472 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:13:35.472 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:13:35.472 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:13:35.472 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:13:35.472 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:13:35.472 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:13:35.472 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:13:35.472 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:13:35.472 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:13:35.474 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:13:35.474 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-08-24T21:13:35.804 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:13:35.821 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 1 2024-08-24T21:13:36.824 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap16 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap17 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap17.diff 2024-08-24T21:13:37.006 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 50% complete... Exporting image: 100% complete...done. 2024-08-24T21:13:37.015 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:13:37.015 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=18 2024-08-24T21:13:37.015 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap18 2024-08-24T21:13:37.812 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:13:37.830 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 3 2024-08-24T21:13:40.832 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap17 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap18 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap18.diff 2024-08-24T21:13:42.349 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 50% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 100% complete...done. 2024-08-24T21:13:42.393 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:13:42.393 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=19 2024-08-24T21:13:42.393 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap19 2024-08-24T21:13:45.785 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:13:45.805 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 4 2024-08-24T21:13:49.807 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap18 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap19 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap19.diff 2024-08-24T21:13:51.107 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete...+ sync ac6341a6-6d9d-4017-bb38-7eb07f2860fe-mnt 2024-08-24T21:13:51.142 INFO:tasks.workunit.client.0.smithi179.stderr:+ rm -rf ac6341a6-6d9d-4017-bb38-7eb07f2860fe-mnt/linux-5.4 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-mnt/linux-5.4.tar.gz 2024-08-24T21:13:52.373 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 100% complete...done. 2024-08-24T21:13:52.431 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:13:52.431 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=20 2024-08-24T21:13:52.431 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap20 2024-08-24T21:13:52.607 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:13:52.623 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 1 2024-08-24T21:13:53.626 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap19 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap20 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap20.diff 2024-08-24T21:13:54.724 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 39% complete... Exporting image: 42% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 81% complete...+ (( i++ )) 2024-08-24T21:13:54.725 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i < 10 )) 2024-08-24T21:13:54.725 INFO:tasks.workunit.client.0.smithi179.stderr:+ pv -L 10M linux-5.4.tar.gz 2024-08-24T21:13:54.912 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 100% complete...done. 2024-08-24T21:13:54.947 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:13:54.947 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=21 2024-08-24T21:13:54.947 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap21 2024-08-24T21:13:55.475 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-08-24T21:13:55.475 INFO:tasks.ceph.mon.b:Restarting daemon 2024-08-24T21:13:55.475 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-08-24T21:13:55.480 INFO:tasks.ceph.mon.b:Started 2024-08-24T21:13:55.480 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:13:55.480 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:13:55.791 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:13:55.809 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 1 2024-08-24T21:13:55.937 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":32,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:13:56.811 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap20 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap21 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap21.diff 2024-08-24T21:13:56.887 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 100% complete...done. 2024-08-24T21:13:56.893 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:13:56.893 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=22 2024-08-24T21:13:56.893 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap22 2024-08-24T21:13:57.799 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:13:57.819 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 4 2024-08-24T21:13:58.957 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:13:59.408 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":32,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":24,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:14:01.821 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap21 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap22 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap22.diff 2024-08-24T21:14:02.092 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 100% complete...done. 2024-08-24T21:14:02.104 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:14:02.104 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=23 2024-08-24T21:14:02.104 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap23 2024-08-24T21:14:02.428 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:14:02.652 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:14:02.670 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 4 2024-08-24T21:14:02.877 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":34,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:14:02.895 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:14:02.895 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:14:02.895 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:14:03.071 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:14:03.071 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:14:03.072 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:14:03.072 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:14:03.072 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 34, 2024-08-24T21:14:03.072 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 99034, 2024-08-24T21:14:03.072 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:14:03.072 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:14:03.072 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:14:03.072 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:14:03.072 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:03.072 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 2, 2024-08-24T21:14:03.072 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:14:03.073 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:14:03.073 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:14:03.073 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:14:03.073 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:14:03.073 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:14:03.073 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:14:03.073 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:14:03.073 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:14:03.073 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:14:03.073 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:14:03.073 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:14:03.073 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:14:03.073 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:14:03.074 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:03.074 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:14:03.074 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:14:03.074 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:14:03.074 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:14:03.074 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:14:03.074 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:14:03.074 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:14:03.074 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:14:03.074 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:14:03.074 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:14:03.074 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:14:03.075 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:14:03.075 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:14:03.075 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:03.075 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:03.075 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:14:03.075 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:14:03.075 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:14:03.075 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:14:03.075 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:14:03.075 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:14:03.075 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:14:03.075 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:14:03.076 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:14:03.076 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:14:03.076 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:14:03.076 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:14:03.076 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:14:03.076 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:14:03.076 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:14:03.076 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:14:03.076 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:14:03.076 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:14:03.076 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:14:03.076 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:14:03.077 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:14:03.077 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:14:03.077 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:14:03.077 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:14:03.077 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:14:03.077 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:14:03.077 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:14:03.077 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:14:03.077 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:03.077 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:14:03.077 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:03.077 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:14:03.077 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:03.077 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:14:03.078 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:14:03.078 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:14:03.078 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:14:03.078 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:03.078 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:14:03.078 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:14:03.078 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:03.078 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:03.078 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:03.078 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:14:03.078 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:14:03.078 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:03.079 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:03.079 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:03.079 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:03.079 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:14:03.079 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:14:03.079 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:14:03.079 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:14:03.079 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:14:03.079 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:03.080 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:03.080 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:14:03.080 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:14:03.080 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:14:03.080 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:14:03.080 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:03.080 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:14:03.080 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:14:03.080 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:03.080 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:03.080 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:03.080 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:14:03.080 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:14:03.080 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:03.081 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:03.081 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:03.081 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:03.081 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:14:03.081 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:14:03.081 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:14:03.081 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:14:03.081 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:14:03.081 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:03.081 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:03.081 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:14:03.081 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:14:03.081 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:14:03.082 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:14:03.082 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:03.082 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:14:03.082 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:14:03.082 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:03.082 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:03.082 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:03.082 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:14:03.082 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:14:03.082 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:03.082 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:03.082 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:03.082 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:03.082 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:14:03.083 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:14:03.083 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:14:03.083 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:14:03.083 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:14:03.083 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:03.083 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:03.083 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:03.083 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:14:03.083 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:14:03.083 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:03.083 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:14:03.083 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:14:03.083 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:14:03.084 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:03.084 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:03.084 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:14:03.084 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:03.084 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:14:03.084 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:14:03.084 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:14:03.084 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:03.084 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:03.084 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:14:03.084 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:03.084 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:14:03.084 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:14:03.085 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-08-24T21:14:03.085 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:03.085 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:03.085 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:14:03.085 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:03.085 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:14:03.085 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:14:03.085 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:14:03.085 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:03.085 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:03.085 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:03.085 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:14:03.085 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:14:03.087 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:14:03.087 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:14:03.087 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:14:03.262 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:14:03.262 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:14:03.262 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:14:03.262 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:14:03.262 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 34, 2024-08-24T21:14:03.262 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 142558, 2024-08-24T21:14:03.263 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:14:03.263 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:14:03.263 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:14:03.263 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:14:03.263 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:03.263 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 2, 2024-08-24T21:14:03.263 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:14:03.263 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:14:03.263 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:14:03.263 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:14:03.263 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:14:03.263 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:14:03.263 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:14:03.264 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:14:03.264 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:14:03.264 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:14:03.264 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:14:03.264 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:14:03.264 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:14:03.264 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:14:03.264 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:03.264 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:14:03.264 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:14:03.264 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:14:03.264 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:14:03.265 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:14:03.265 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:14:03.265 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:14:03.265 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:14:03.265 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:14:03.265 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:14:03.265 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:14:03.265 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:14:03.265 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:14:03.265 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:03.265 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:03.265 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:14:03.265 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:14:03.265 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:14:03.266 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:14:03.266 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:14:03.266 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:14:03.266 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:14:03.266 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:14:03.266 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:14:03.266 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:14:03.266 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:14:03.266 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:14:03.266 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:14:03.266 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:14:03.266 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:14:03.266 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:14:03.267 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:14:03.267 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:14:03.267 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:14:03.267 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:14:03.267 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:14:03.267 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:14:03.267 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:14:03.267 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:14:03.267 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:14:03.267 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:14:03.267 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:14:03.267 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:14:03.268 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:03.268 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:14:03.268 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:03.268 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:14:03.268 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:03.268 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:14:03.268 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:14:03.268 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:14:03.268 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:14:03.268 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:03.268 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:14:03.268 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:14:03.268 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:03.268 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:03.268 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:03.269 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:14:03.269 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:14:03.269 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:03.269 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:03.269 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:03.269 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:03.269 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:14:03.269 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:14:03.269 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:14:03.269 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:14:03.269 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:14:03.269 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:03.269 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:03.269 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:14:03.270 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:14:03.270 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:14:03.270 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:14:03.270 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:03.270 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:14:03.270 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:14:03.270 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:03.270 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:03.270 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:03.270 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:14:03.270 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:14:03.270 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:03.270 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:03.271 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:03.271 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:03.271 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:14:03.271 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:14:03.271 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:14:03.271 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:14:03.271 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:14:03.271 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:03.271 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:03.271 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:14:03.271 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:14:03.271 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:14:03.271 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:14:03.272 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:03.272 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:14:03.272 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:14:03.272 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:03.272 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:03.272 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:03.272 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:14:03.272 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:14:03.272 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:03.272 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:03.272 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:03.272 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:03.272 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:14:03.272 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:14:03.273 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:14:03.273 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:14:03.273 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:14:03.273 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:03.273 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:03.273 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:03.273 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:14:03.273 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:14:03.273 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:03.273 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:14:03.273 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:14:03.273 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:14:03.274 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:03.274 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:03.274 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:14:03.274 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:03.274 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:14:03.274 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:14:03.274 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:14:03.274 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:03.274 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:03.274 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:14:03.274 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:03.274 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x2f018fb87aa4aafe", 2024-08-24T21:14:03.274 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "luminous", 2024-08-24T21:14:03.274 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:14:03.275 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:03.275 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:03.275 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:14:03.275 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:14:03.275 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:14:03.275 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:03.275 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:03.275 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:03.275 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:14:03.275 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:14:03.276 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:14:03.276 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:14:03.277 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:14:03.453 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:14:03.453 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:14:03.454 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:14:03.454 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:14:03.454 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 34, 2024-08-24T21:14:03.454 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 7837, 2024-08-24T21:14:03.454 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:14:03.454 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:14:03.454 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:14:03.454 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:14:03.454 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:03.454 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 2, 2024-08-24T21:14:03.454 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:14:03.454 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:14:03.455 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:14:03.455 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:14:03.455 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:14:03.455 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:14:03.455 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:14:03.455 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:14:03.455 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:14:03.455 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:14:03.455 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:14:03.455 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:14:03.455 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:14:03.455 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:14:03.455 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:03.456 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:14:03.456 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:14:03.456 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:14:03.456 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:14:03.456 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:14:03.456 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:14:03.456 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:14:03.456 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:14:03.456 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:14:03.456 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:14:03.456 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:14:03.456 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:14:03.456 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:14:03.457 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:03.457 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:03.457 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:14:03.457 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:14:03.457 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:14:03.457 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:14:03.457 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:14:03.457 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:14:03.457 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:14:03.457 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:14:03.457 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:14:03.457 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:14:03.457 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:14:03.458 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:14:03.458 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:14:03.458 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:14:03.458 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:14:03.458 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:14:03.458 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:14:03.458 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:14:03.458 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:14:03.458 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:14:03.458 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:14:03.458 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:14:03.459 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:14:03.459 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:14:03.459 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:14:03.459 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:14:03.459 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:14:03.459 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:14:03.459 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:03.459 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:14:03.459 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:03.459 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:14:03.459 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:03.459 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:14:03.459 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:14:03.460 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:14:03.460 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:14:03.460 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:03.460 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:14:03.460 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:14:03.460 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:03.460 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:03.460 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:03.460 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:14:03.460 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:14:03.460 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:03.460 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:03.460 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:03.461 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:03.461 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:14:03.461 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:14:03.461 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:14:03.461 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:14:03.461 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:14:03.461 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:03.461 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:03.461 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:14:03.461 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:14:03.461 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:14:03.461 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:14:03.462 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:03.462 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:14:03.462 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:14:03.462 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:03.462 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:03.462 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:03.462 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:14:03.462 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:14:03.462 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:03.462 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:03.462 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:03.462 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:03.462 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:14:03.463 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:14:03.463 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:14:03.463 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:14:03.463 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:14:03.463 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:03.463 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:03.463 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:14:03.463 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:14:03.463 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:14:03.463 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:14:03.463 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:03.463 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:14:03.464 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:14:03.464 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:03.464 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:03.464 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:03.464 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:14:03.464 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:14:03.464 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:03.464 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:03.464 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:03.464 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:03.464 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:14:03.464 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:14:03.464 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:14:03.465 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:14:03.465 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:14:03.465 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:03.465 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:03.465 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:03.465 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:14:03.465 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:14:03.465 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:03.465 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:14:03.465 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:14:03.465 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:14:03.465 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:03.465 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:03.465 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:14:03.466 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:03.466 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:14:03.466 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:14:03.466 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:14:03.466 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:03.466 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:03.466 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:03.466 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:14:03.466 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:14:03.468 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:14:03.468 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-08-24T21:14:03.468 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-08-24T21:14:03.936 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-08-24T21:14:04.937 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:14:04.938 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:14:05.392 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":34,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:14:05.410 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:14:05.410 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-08-24T21:14:05.410 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:14:05.411 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:14:05.586 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:14:05.587 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:14:05.587 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:14:05.587 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:14:05.587 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 34, 2024-08-24T21:14:05.587 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 101549, 2024-08-24T21:14:05.587 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:14:05.587 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:14:05.587 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:14:05.587 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:14:05.587 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:05.587 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 4, 2024-08-24T21:14:05.588 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:14:05.588 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:14:05.588 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:14:05.588 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:14:05.588 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:14:05.588 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:14:05.588 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:14:05.588 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:14:05.588 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:14:05.588 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:14:05.588 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:14:05.588 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:14:05.589 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:14:05.589 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:14:05.589 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:05.589 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:14:05.589 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:14:05.589 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:14:05.589 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:14:05.589 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:14:05.589 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:14:05.589 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:14:05.589 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:14:05.589 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:14:05.589 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:14:05.590 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:14:05.590 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:14:05.590 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:14:05.590 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:05.590 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:05.590 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:14:05.590 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:14:05.590 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:14:05.590 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:14:05.590 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:14:05.590 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:14:05.590 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:14:05.590 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:14:05.591 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:14:05.591 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:14:05.591 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:14:05.591 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:14:05.591 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:14:05.591 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:14:05.591 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:14:05.591 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:14:05.591 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:14:05.591 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:14:05.591 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:14:05.591 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:14:05.592 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:14:05.592 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:14:05.592 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:14:05.592 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:14:05.592 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:14:05.592 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:14:05.592 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:14:05.592 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:14:05.592 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:05.592 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:14:05.592 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:05.592 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:14:05.593 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:05.593 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:14:05.593 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:14:05.593 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:14:05.593 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:14:05.593 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:05.593 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:14:05.593 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:14:05.593 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:05.593 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:05.593 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:05.593 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:14:05.594 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:14:05.594 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:05.594 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:05.594 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:05.594 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:05.594 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:14:05.594 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:14:05.594 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:14:05.594 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:14:05.594 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:14:05.594 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:05.594 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:05.594 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:14:05.595 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:14:05.595 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:14:05.595 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:14:05.595 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:05.595 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:14:05.595 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:14:05.595 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:05.595 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:05.595 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:05.595 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:14:05.595 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:14:05.595 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:05.595 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:05.596 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:05.596 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:05.596 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:14:05.596 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:14:05.596 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:14:05.596 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:14:05.596 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:14:05.596 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:05.596 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:05.596 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:14:05.596 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:14:05.596 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:14:05.596 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:14:05.596 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:05.596 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:14:05.597 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:14:05.597 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:05.597 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:05.597 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:05.597 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:14:05.597 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:14:05.597 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:05.597 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:05.597 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:05.597 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:05.597 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:14:05.597 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:14:05.597 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:14:05.597 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:14:05.597 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:14:05.598 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:05.598 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:05.598 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:05.598 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:14:05.598 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:14:05.598 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:05.598 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:14:05.598 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:14:05.598 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:14:05.598 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:05.598 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:05.598 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:14:05.598 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:05.599 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:14:05.599 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:14:05.599 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:14:05.599 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:05.599 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:05.599 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:14:05.599 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:05.599 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:14:05.599 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:14:05.599 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:14:05.599 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:05.599 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:05.599 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:14:05.599 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:05.600 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:14:05.600 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:14:05.600 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:14:05.600 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:05.600 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:05.600 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:05.600 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:14:05.600 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:14:05.601 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:14:05.601 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:14:05.601 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:14:05.777 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:14:05.777 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:14:05.777 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:14:05.777 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:14:05.778 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 34, 2024-08-24T21:14:05.778 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 145074, 2024-08-24T21:14:05.778 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:14:05.778 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:14:05.778 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:14:05.778 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:14:05.778 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:05.778 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 5, 2024-08-24T21:14:05.778 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:14:05.778 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:14:05.778 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:14:05.778 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:14:05.779 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:14:05.779 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:14:05.779 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:14:05.779 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:14:05.779 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:14:05.779 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:14:05.779 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:14:05.779 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:14:05.779 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:14:05.779 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:14:05.779 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:05.779 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:14:05.779 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:14:05.780 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:14:05.780 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:14:05.780 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:14:05.780 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:14:05.780 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:14:05.780 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:14:05.780 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:14:05.780 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:14:05.780 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:14:05.780 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:14:05.780 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:14:05.780 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:05.780 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:05.781 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:14:05.781 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:14:05.781 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:14:05.781 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:14:05.781 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:14:05.781 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:14:05.781 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:14:05.781 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:14:05.781 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:14:05.781 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:14:05.781 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:14:05.781 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:14:05.781 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:14:05.782 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:14:05.782 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:14:05.782 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:14:05.782 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:14:05.782 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:14:05.782 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:14:05.782 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:14:05.782 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:14:05.782 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:14:05.782 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:14:05.782 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:14:05.782 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:14:05.783 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:14:05.783 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:14:05.783 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:14:05.783 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:05.783 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:14:05.783 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:05.783 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:14:05.783 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:05.783 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:14:05.783 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:14:05.783 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:14:05.783 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:14:05.783 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:05.784 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:14:05.784 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:14:05.784 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:05.784 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:05.784 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:05.784 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:14:05.784 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:14:05.784 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:05.784 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:05.784 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:05.784 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:05.784 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:14:05.784 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:14:05.785 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:14:05.785 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:14:05.785 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:14:05.785 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:05.785 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:05.785 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:14:05.785 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:14:05.785 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:14:05.785 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:14:05.785 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:05.785 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:14:05.785 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:14:05.786 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:05.786 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:05.786 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:05.786 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:14:05.786 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:14:05.786 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:05.786 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:05.786 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:05.786 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:05.786 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:14:05.786 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:14:05.786 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:14:05.786 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:14:05.787 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:14:05.787 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:05.787 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:05.787 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:14:05.787 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:14:05.787 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:14:05.787 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:14:05.787 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:05.787 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:14:05.787 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:14:05.787 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:05.787 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:05.787 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:05.788 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:14:05.788 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:14:05.788 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:05.788 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:05.788 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:05.788 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:05.788 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:14:05.788 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:14:05.788 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:14:05.788 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:14:05.788 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:14:05.788 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:05.788 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:05.789 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:05.789 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:14:05.789 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:14:05.789 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:05.789 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:14:05.789 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:14:05.789 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:14:05.789 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:05.789 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:05.789 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:14:05.789 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:05.790 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:14:05.790 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:14:05.790 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:14:05.790 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:05.790 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:05.790 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:14:05.790 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:05.790 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x2f018fb87aa4aafe", 2024-08-24T21:14:05.790 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "luminous", 2024-08-24T21:14:05.790 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:14:05.790 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:05.790 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:05.790 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:14:05.791 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:14:05.791 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:14:05.791 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:05.791 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:05.791 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:05.791 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:14:05.791 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:14:05.792 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:14:05.792 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:14:05.792 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:14:05.970 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:14:05.970 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:14:05.970 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:14:05.970 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:14:05.970 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 34, 2024-08-24T21:14:05.970 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 10353, 2024-08-24T21:14:05.971 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:14:05.971 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:14:05.971 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:14:05.971 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:14:05.971 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:05.971 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 5, 2024-08-24T21:14:05.971 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:14:05.971 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:14:05.971 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:14:05.971 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:14:05.971 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:14:05.971 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:14:05.971 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:14:05.972 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:14:05.972 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:14:05.972 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:14:05.972 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:14:05.972 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:14:05.972 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:14:05.972 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:14:05.972 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:05.972 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:14:05.972 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:14:05.972 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:14:05.972 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:14:05.972 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:14:05.973 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:14:05.973 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:14:05.973 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:14:05.973 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:14:05.973 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:14:05.973 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:14:05.973 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:14:05.973 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:14:05.973 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:05.973 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:05.973 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:14:05.973 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:14:05.973 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:14:05.974 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:14:05.974 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:14:05.974 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:14:05.974 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:14:05.974 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:14:05.974 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:14:05.974 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:14:05.974 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:14:05.974 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:14:05.974 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:14:05.974 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:14:05.974 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:14:05.974 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:14:05.975 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:14:05.975 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:14:05.975 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:14:05.975 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:14:05.975 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:14:05.975 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:14:05.975 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:14:05.975 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:14:05.975 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:14:05.975 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:14:05.975 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:14:05.975 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:14:05.976 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:05.976 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:14:05.976 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:05.976 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:14:05.976 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:05.976 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:14:05.976 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:14:05.976 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:14:05.976 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:14:05.976 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:05.976 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:14:05.976 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:14:05.976 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:05.977 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:05.977 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:05.977 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:14:05.977 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:14:05.977 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:05.977 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:05.977 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:05.977 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:05.977 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:14:05.977 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:14:05.977 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:14:05.977 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:14:05.977 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:14:05.978 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:05.978 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:05.978 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:14:05.978 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:14:05.978 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:14:05.978 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:14:05.978 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:05.978 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:14:05.978 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:14:05.978 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:05.978 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:05.978 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:05.978 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:14:05.979 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:14:05.979 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:05.979 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:05.979 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:05.979 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:05.979 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:14:05.979 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:14:05.979 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:14:05.979 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:14:05.979 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:14:05.979 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:05.979 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:05.979 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:14:05.980 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:14:05.980 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:14:05.980 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:14:05.980 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:05.980 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:14:05.980 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:14:05.980 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:05.980 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:05.980 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:05.980 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:14:05.980 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:14:05.980 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:05.981 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:05.981 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:05.981 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:05.981 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:14:05.981 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:14:05.981 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:14:05.981 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:14:05.981 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:14:05.981 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:05.981 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:05.981 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:05.981 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:14:05.982 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:14:05.982 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:05.982 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:14:05.982 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:14:05.982 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:14:05.982 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:05.982 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:05.982 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:14:05.982 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:05.982 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:14:05.982 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:14:05.982 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:14:05.982 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:05.982 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:05.983 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:05.983 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:14:05.983 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:14:05.984 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:14:05.984 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2024-08-24T21:14:05.985 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-08-24T21:14:05.985 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-08-24T21:14:05.985 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-08-24T21:14:05.985 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-08-24T21:14:05.985 INFO:teuthology.orchestra.run:waiting for 300 2024-08-24T21:14:06.004 INFO:tasks.ceph.mon.c:Stopped 2024-08-24T21:14:06.005 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-08-24T21:14:06.005 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:14:06.483 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":34,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:14:06.672 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap22 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap23 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap23.diff 2024-08-24T21:14:06.785 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 100% complete...done. 2024-08-24T21:14:06.792 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:14:06.792 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=24 2024-08-24T21:14:06.792 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap24 2024-08-24T21:14:09.502 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:14:09.950 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":34,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":9,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:14:11.162 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete...+ tar -C ac6341a6-6d9d-4017-bb38-7eb07f2860fe-mnt -xzf ac6341a6-6d9d-4017-bb38-7eb07f2860fe-mnt/linux-5.4.tar.gz 2024-08-24T21:14:12.969 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:14:13.416 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":34,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:14:16.436 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:14:20.945 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":38,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:14:20.963 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-08-24T21:14:20.963 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-08-24T21:14:20.964 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:14:21.140 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:14:21.140 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:14:21.140 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:14:21.140 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:14:21.140 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 38, 2024-08-24T21:14:21.140 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 117101, 2024-08-24T21:14:21.140 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:14:21.140 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:14:21.141 INFO:teuthology.orchestra.run.smithi060.stdout: 1 2024-08-24T21:14:21.141 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:21.141 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:14:21.141 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:14:21.141 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:14:21.141 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:14:21.141 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:14:21.141 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:14:21.141 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:14:21.141 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:14:21.141 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:14:21.141 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:14:21.141 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:14:21.141 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:14:21.141 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:14:21.142 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:14:21.142 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:14:21.142 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:21.142 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:14:21.142 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:14:21.142 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:14:21.142 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:14:21.142 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:14:21.142 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:14:21.142 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:14:21.142 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:14:21.142 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:14:21.142 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:14:21.143 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:14:21.143 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:14:21.143 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:14:21.143 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:21.143 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:21.143 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:14:21.143 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:14:21.143 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:14:21.143 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:14:21.143 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:14:21.143 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:14:21.143 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:14:21.143 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:14:21.143 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:14:21.144 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:14:21.144 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:14:21.144 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:14:21.144 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:14:21.144 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:14:21.144 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:14:21.144 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:14:21.144 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:14:21.144 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:14:21.145 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:14:21.145 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:14:21.145 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:14:21.145 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:14:21.145 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:14:21.145 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:14:21.145 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:14:21.145 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:14:21.145 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:14:21.145 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:14:21.145 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:21.145 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:14:21.146 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:21.146 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:14:21.146 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:21.146 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:14:21.146 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:14:21.146 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:14:21.146 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:14:21.146 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:21.146 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:14:21.146 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:14:21.146 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:21.146 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:21.146 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:21.146 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:14:21.147 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:14:21.147 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:21.147 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:21.147 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:21.147 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:21.147 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:14:21.147 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:14:21.147 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:14:21.147 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:14:21.147 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:14:21.147 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:21.147 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:21.147 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:14:21.147 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:14:21.148 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:14:21.148 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:14:21.148 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:21.148 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:14:21.148 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:14:21.148 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:21.148 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:21.148 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:21.148 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:14:21.148 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:14:21.148 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:21.148 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:21.148 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:21.149 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:21.149 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:14:21.149 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:14:21.149 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:14:21.149 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:14:21.149 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:14:21.149 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:21.149 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:21.149 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:14:21.149 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:14:21.149 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:14:21.149 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:14:21.149 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:21.150 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:14:21.150 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:14:21.150 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:21.150 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:21.150 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:21.150 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:14:21.150 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:14:21.150 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:21.150 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:21.150 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:21.150 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:21.150 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:14:21.150 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:14:21.150 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:14:21.151 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:14:21.151 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:14:21.151 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:21.151 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:21.151 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:21.151 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:14:21.151 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:14:21.151 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:21.151 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:14:21.151 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:14:21.151 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:14:21.151 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:21.151 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:21.151 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:14:21.152 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:21.152 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:14:21.152 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:14:21.152 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 7 2024-08-24T21:14:21.152 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:21.152 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:21.152 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:14:21.152 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:21.152 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:14:21.152 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:14:21.152 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 7 2024-08-24T21:14:21.152 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:21.152 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:21.152 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:14:21.152 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:21.153 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:14:21.153 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:14:21.153 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:14:21.153 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:21.153 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:21.153 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:21.153 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:14:21.153 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:14:21.155 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:14:21.156 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-08-24T21:14:21.156 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:14:21.333 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:14:21.333 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:14:21.333 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:14:21.333 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:14:21.333 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 38, 2024-08-24T21:14:21.333 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 25716, 2024-08-24T21:14:21.333 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:14:21.333 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:14:21.333 INFO:teuthology.orchestra.run.smithi060.stdout: 1 2024-08-24T21:14:21.334 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:21.334 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:14:21.334 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:14:21.334 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:14:21.334 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:14:21.334 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:14:21.334 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:14:21.334 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:14:21.334 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:14:21.334 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:14:21.334 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:14:21.334 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:14:21.334 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:14:21.335 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:14:21.335 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:14:21.335 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:14:21.335 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:21.335 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:14:21.335 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:14:21.335 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:14:21.335 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:14:21.335 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:14:21.335 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:14:21.335 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:14:21.335 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:14:21.335 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:14:21.336 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:14:21.336 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:14:21.336 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:14:21.336 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:14:21.336 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:21.336 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:21.336 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:14:21.336 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:14:21.336 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:14:21.336 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:14:21.336 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:14:21.336 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:14:21.336 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:14:21.337 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:14:21.337 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:14:21.337 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:14:21.337 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:14:21.337 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:14:21.337 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:14:21.337 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:14:21.337 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:14:21.337 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:14:21.337 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:14:21.337 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:14:21.337 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:14:21.337 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:14:21.338 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:14:21.338 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:14:21.338 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:14:21.338 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:14:21.338 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:14:21.338 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:14:21.338 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:14:21.338 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:14:21.338 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:21.338 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:14:21.338 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:21.338 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:14:21.339 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:21.339 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:14:21.339 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:14:21.339 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:14:21.339 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:14:21.339 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:21.339 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:14:21.339 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:14:21.340 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:21.340 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:21.340 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:21.340 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:14:21.340 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:14:21.340 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:21.340 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:21.340 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:21.340 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:21.340 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:14:21.340 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:14:21.340 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:14:21.340 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:14:21.341 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:14:21.341 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:21.341 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:21.341 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:14:21.341 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:14:21.341 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:14:21.341 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:14:21.341 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:21.341 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:14:21.341 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:14:21.341 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:21.341 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:21.341 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:21.342 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:14:21.342 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:14:21.342 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:21.342 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:21.342 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:21.342 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:21.342 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:14:21.342 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:14:21.342 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:14:21.342 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:14:21.342 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:14:21.342 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:21.342 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:21.343 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:14:21.343 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:14:21.343 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:14:21.343 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:14:21.343 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:21.343 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:14:21.343 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:14:21.343 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:21.343 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:21.343 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:21.343 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:14:21.343 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:14:21.344 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:21.344 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:21.344 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:21.344 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:21.344 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:14:21.344 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:14:21.344 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:14:21.344 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:14:21.344 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:14:21.344 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:21.344 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:21.344 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:21.344 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:14:21.344 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:14:21.344 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:21.345 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:14:21.345 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:14:21.345 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:14:21.345 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:21.345 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:21.345 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:14:21.345 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:21.345 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:14:21.345 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:14:21.345 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:14:21.346 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:21.346 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:21.346 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:14:21.346 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:21.346 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x2f018fb87aa4aafe", 2024-08-24T21:14:21.346 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "luminous", 2024-08-24T21:14:21.346 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:14:21.346 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:21.346 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:21.346 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:14:21.346 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:14:21.346 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:14:21.346 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:21.347 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:21.347 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:21.347 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:14:21.347 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:14:21.348 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:14:21.348 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-08-24T21:14:21.682 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 100% complete...done. 2024-08-24T21:14:21.702 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 3 2024-08-24T21:14:24.704 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap23 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap24 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap24.diff 2024-08-24T21:14:24.806 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 100% complete...done. 2024-08-24T21:14:24.817 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:14:24.817 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=25 2024-08-24T21:14:24.817 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap25 2024-08-24T21:14:25.799 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:14:25.820 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 3 2024-08-24T21:14:28.823 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap24 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap25 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap25.diff 2024-08-24T21:14:29.126 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 50% complete... Exporting image: 75% complete... Exporting image: 100% complete...done. 2024-08-24T21:14:29.144 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:14:29.144 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=26 2024-08-24T21:14:29.144 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap26 2024-08-24T21:14:29.795 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:14:29.816 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 2 2024-08-24T21:14:31.819 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap25 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap26 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap26.diff 2024-08-24T21:14:35.053 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 39% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 100% complete...done. 2024-08-24T21:14:35.101 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:14:35.101 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=27 2024-08-24T21:14:35.101 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap27 2024-08-24T21:14:39.800 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:14:39.821 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 1 2024-08-24T21:14:40.824 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap26 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap27 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap27.diff 2024-08-24T21:14:41.349 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-08-24T21:14:41.349 INFO:tasks.ceph.mon.c:Restarting daemon 2024-08-24T21:14:41.350 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-08-24T21:14:41.355 INFO:tasks.ceph.mon.c:Started 2024-08-24T21:14:41.355 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:14:41.355 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:14:42.048 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":38,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:14:43.767 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 39% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 57% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 75% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 100% complete...done. 2024-08-24T21:14:43.815 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:14:43.815 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=28 2024-08-24T21:14:43.815 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap28 2024-08-24T21:14:45.083 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:14:45.780 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":38,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":25,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:14:47.871 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:14:47.890 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 4 2024-08-24T21:14:48.808 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:14:48.820 INFO:tasks.workunit.client.0.smithi179.stderr:+ sync ac6341a6-6d9d-4017-bb38-7eb07f2860fe-mnt 2024-08-24T21:14:49.201 INFO:tasks.workunit.client.0.smithi179.stderr:+ rm -rf ac6341a6-6d9d-4017-bb38-7eb07f2860fe-mnt/linux-5.4 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-mnt/linux-5.4.tar.gz 2024-08-24T21:14:49.381 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":40,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:14:49.399 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:14:49.399 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:14:49.399 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:14:49.576 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:14:49.576 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:14:49.576 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:14:49.576 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:14:49.576 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 40, 2024-08-24T21:14:49.576 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 145538, 2024-08-24T21:14:49.577 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:14:49.577 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:14:49.577 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:14:49.577 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:14:49.577 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:49.577 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 2, 2024-08-24T21:14:49.577 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:14:49.577 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:14:49.577 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:14:49.577 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:14:49.577 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:14:49.577 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:14:49.577 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:14:49.578 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:14:49.578 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:14:49.578 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:14:49.578 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:14:49.578 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:14:49.578 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:14:49.578 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:14:49.578 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:49.578 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:14:49.578 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:14:49.578 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:14:49.578 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:14:49.578 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:14:49.579 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:14:49.579 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:14:49.579 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:14:49.579 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:14:49.579 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:14:49.579 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:14:49.579 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:14:49.579 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:14:49.579 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:49.579 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:49.579 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:14:49.579 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:14:49.580 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:14:49.580 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:14:49.580 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:14:49.580 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:14:49.580 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:14:49.580 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:14:49.580 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:14:49.580 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:14:49.580 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:14:49.580 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:14:49.580 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:14:49.580 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:14:49.580 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:14:49.580 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:14:49.581 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:14:49.581 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:14:49.581 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:14:49.581 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:14:49.581 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:14:49.581 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:14:49.581 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:14:49.581 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:14:49.581 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:14:49.581 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:14:49.581 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:14:49.581 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:14:49.581 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:49.581 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:14:49.582 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:49.582 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:14:49.582 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:49.582 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:14:49.582 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:14:49.582 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:14:49.582 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:14:49.582 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:49.582 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:14:49.582 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:14:49.582 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:49.582 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:49.582 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:49.582 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:14:49.583 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:14:49.583 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:49.583 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:49.583 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:49.583 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:49.583 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:14:49.583 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:14:49.583 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:14:49.583 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:14:49.583 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:14:49.583 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:49.583 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:49.583 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:14:49.584 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:14:49.584 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:14:49.584 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:14:49.584 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:49.584 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:14:49.584 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:14:49.584 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:49.584 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:49.584 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:49.584 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:14:49.584 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:14:49.584 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:49.584 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:49.585 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:49.585 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:49.585 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:14:49.585 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:14:49.585 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:14:49.585 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:14:49.585 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:14:49.585 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:49.585 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:49.585 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:14:49.585 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:14:49.585 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:14:49.585 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:14:49.586 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:49.586 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:14:49.586 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:14:49.586 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:49.586 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:49.586 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:49.586 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:14:49.586 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:14:49.586 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:49.586 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:49.586 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:49.586 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:49.586 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:14:49.587 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:14:49.587 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:14:49.587 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:14:49.587 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:14:49.587 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:49.587 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:49.587 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:49.587 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:14:49.587 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:14:49.587 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:49.587 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:14:49.587 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:14:49.587 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:14:49.588 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:49.588 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:49.588 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:14:49.588 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:49.588 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:14:49.588 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:14:49.588 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 7 2024-08-24T21:14:49.588 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:49.588 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:49.588 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:14:49.588 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:49.588 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:14:49.588 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:14:49.588 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 6 2024-08-24T21:14:49.589 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:49.589 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:49.589 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:14:49.589 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:49.589 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:14:49.589 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:14:49.589 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:14:49.589 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:49.589 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:49.589 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:49.589 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:14:49.589 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:14:49.590 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:14:49.590 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:14:49.590 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:14:51.892 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap27 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap28 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap28.diff 2024-08-24T21:14:52.548 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 23% complete...+ (( i++ )) 2024-08-24T21:14:52.548 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i < 10 )) 2024-08-24T21:14:52.548 INFO:tasks.workunit.client.0.smithi179.stderr:+ pv -L 10M linux-5.4.tar.gz 2024-08-24T21:14:52.776 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:14:52.776 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:14:52.776 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:14:52.776 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:14:52.776 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 40, 2024-08-24T21:14:52.776 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 11244, 2024-08-24T21:14:52.776 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:14:52.776 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:14:52.776 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:14:52.776 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:14:52.777 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:52.777 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 6, 2024-08-24T21:14:52.777 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:14:52.777 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:14:52.777 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:14:52.777 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:14:52.777 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:14:52.777 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:14:52.777 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:14:52.777 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:14:52.777 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:14:52.777 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:14:52.778 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:14:52.778 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:14:52.778 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:14:52.778 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:14:52.778 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:52.778 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:14:52.778 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:14:52.778 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:14:52.778 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:14:52.778 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:14:52.778 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:14:52.778 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:14:52.778 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:14:52.779 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:14:52.779 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:14:52.779 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:14:52.779 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:14:52.779 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:14:52.779 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:52.779 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:52.779 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:14:52.779 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:14:52.779 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:14:52.779 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:14:52.779 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:14:52.780 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:14:52.780 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:14:52.780 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:14:52.780 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:14:52.780 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:14:52.780 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:14:52.780 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:14:52.780 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:14:52.780 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:14:52.780 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:14:52.780 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:14:52.780 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:14:52.781 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:14:52.781 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:14:52.781 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:14:52.781 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:14:52.781 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:14:52.781 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:14:52.781 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:14:52.781 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:14:52.781 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:14:52.781 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:14:52.781 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:14:52.781 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:52.781 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:14:52.782 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:52.782 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:14:52.782 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:52.782 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:14:52.782 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:14:52.782 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:14:52.782 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:14:52.782 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:52.782 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:14:52.782 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:14:52.782 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:52.782 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:52.782 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:52.783 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:14:52.783 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:14:52.783 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:52.783 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:52.783 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:52.783 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:52.783 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:14:52.783 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:14:52.783 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:14:52.783 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:14:52.783 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:14:52.783 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:52.784 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:52.784 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:14:52.784 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:14:52.784 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:14:52.784 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:14:52.784 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:52.784 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:14:52.784 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:14:52.784 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:52.784 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:52.784 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:52.784 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:14:52.784 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:14:52.785 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:52.785 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:52.785 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:52.785 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:52.785 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:14:52.785 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:14:52.785 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:14:52.785 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:14:52.785 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:14:52.785 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:52.785 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:52.785 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:14:52.785 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:14:52.786 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:14:52.786 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:14:52.786 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:52.786 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:14:52.786 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:14:52.786 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:52.786 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:52.786 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:52.786 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:14:52.786 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:14:52.786 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:52.786 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:52.786 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:52.787 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:52.787 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:14:52.787 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:14:52.787 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:14:52.787 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:14:52.787 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:14:52.787 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:52.787 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:52.787 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:52.787 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:14:52.787 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:14:52.787 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:52.787 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:14:52.788 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:14:52.788 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:14:52.788 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:52.788 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:52.788 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:14:52.788 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:52.788 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:14:52.788 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:14:52.788 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:14:52.788 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:52.788 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:52.788 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:52.788 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:14:52.788 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:14:52.793 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:14:52.793 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:14:52.793 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:14:52.972 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:14:52.972 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:14:52.972 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:14:52.972 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:14:52.973 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 40, 2024-08-24T21:14:52.973 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 57355, 2024-08-24T21:14:52.973 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:14:52.973 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:14:52.973 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:14:52.973 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:14:52.973 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:52.973 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 6, 2024-08-24T21:14:52.973 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:14:52.973 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:14:52.973 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:14:52.973 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:14:52.974 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:14:52.974 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:14:52.974 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:14:52.974 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:14:52.974 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:14:52.974 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:14:52.974 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:14:52.974 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:14:52.974 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:14:52.974 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:14:52.974 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:52.974 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:14:52.974 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:14:52.975 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:14:52.975 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:14:52.975 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:14:52.975 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:14:52.975 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:14:52.975 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:14:52.975 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:14:52.975 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:14:52.975 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:14:52.975 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:14:52.975 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:14:52.975 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:52.975 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:52.976 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:14:52.976 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:14:52.976 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:14:52.976 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:14:52.976 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:14:52.976 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:14:52.976 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:14:52.976 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:14:52.976 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:14:52.976 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:14:52.976 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:14:52.976 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:14:52.976 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:14:52.976 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:14:52.977 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:14:52.977 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:14:52.977 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:14:52.977 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:14:52.977 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:14:52.977 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:14:52.977 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:14:52.977 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:14:52.977 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:14:52.977 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:14:52.977 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:14:52.977 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:14:52.977 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:14:52.977 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:14:52.978 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:52.978 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:14:52.978 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:52.978 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:14:52.978 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:52.978 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:14:52.978 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:14:52.978 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:14:52.978 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:14:52.978 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:52.978 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:14:52.978 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:14:52.979 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:52.979 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:52.979 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:52.979 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:14:52.979 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:14:52.979 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:52.979 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:52.979 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:52.979 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:52.979 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:14:52.979 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:14:52.979 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:14:52.980 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:14:52.980 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:14:52.980 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:52.980 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:52.980 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:14:52.980 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:14:52.980 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:14:52.980 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:14:52.980 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:52.980 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:14:52.980 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:14:52.980 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:52.980 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:52.981 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:52.981 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:14:52.981 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:14:52.981 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:52.981 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:52.981 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:52.981 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:52.981 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:14:52.981 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:14:52.981 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:14:52.981 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:14:52.981 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:14:52.981 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:52.982 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:52.982 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:14:52.982 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:14:52.982 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:14:52.982 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:14:52.982 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:52.982 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:14:52.982 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:14:52.982 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:52.982 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:52.982 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:52.982 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:14:52.982 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:14:52.983 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:52.983 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:52.983 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:52.983 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:52.983 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:14:52.983 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:14:52.983 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:14:52.983 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:14:52.983 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:14:52.983 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:52.983 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:52.983 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:52.984 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:14:52.984 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:14:52.984 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:52.984 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:14:52.984 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:14:52.984 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:14:52.984 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:52.984 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:52.984 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:14:52.984 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:52.984 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:14:52.984 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:14:52.984 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:14:52.985 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:52.985 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:52.985 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:14:52.985 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:52.985 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x2f018fb87aa4aafe", 2024-08-24T21:14:52.985 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "luminous", 2024-08-24T21:14:52.985 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:14:52.985 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:52.985 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:52.985 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:14:52.985 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:14:52.985 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:14:52.985 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:52.985 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:52.986 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:52.986 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:14:52.986 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:14:52.987 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:14:52.987 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-08-24T21:14:52.987 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-08-24T21:14:53.288 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 51% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 100% complete...done. 2024-08-24T21:14:53.325 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:14:53.325 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=29 2024-08-24T21:14:53.325 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap29 2024-08-24T21:14:53.469 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-08-24T21:14:53.804 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:14:53.822 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 1 2024-08-24T21:14:54.470 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:14:54.471 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:14:54.825 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap28 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap29 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap29.diff 2024-08-24T21:14:54.923 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":40,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":8,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:14:54.943 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:14:54.943 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-08-24T21:14:54.943 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:14:54.943 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:14:55.106 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 100% complete...done. 2024-08-24T21:14:55.115 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:14:55.116 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=30 2024-08-24T21:14:55.116 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap30 2024-08-24T21:14:55.126 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:14:55.126 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:14:55.126 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:14:55.126 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:14:55.126 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 40, 2024-08-24T21:14:55.126 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 151087, 2024-08-24T21:14:55.126 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:14:55.126 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:14:55.126 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:14:55.126 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:14:55.126 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:55.126 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 8, 2024-08-24T21:14:55.127 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:14:55.127 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:14:55.127 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:14:55.127 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:14:55.127 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:14:55.127 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:14:55.127 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:14:55.127 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:14:55.127 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:14:55.127 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:14:55.127 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:14:55.127 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:14:55.127 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:14:55.128 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:14:55.128 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:55.128 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:14:55.128 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:14:55.128 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:14:55.128 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:14:55.128 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:14:55.128 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:14:55.128 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:14:55.128 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:14:55.128 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:14:55.128 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:14:55.128 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:14:55.129 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:14:55.129 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:14:55.129 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:55.129 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:55.129 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:14:55.129 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:14:55.129 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:14:55.129 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:14:55.129 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:14:55.129 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:14:55.129 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:14:55.129 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:14:55.130 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:14:55.130 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:14:55.130 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:14:55.130 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:14:55.130 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:14:55.130 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:14:55.130 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:14:55.130 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:14:55.130 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:14:55.130 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:14:55.130 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:14:55.130 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:14:55.130 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:14:55.131 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:14:55.131 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:14:55.131 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:14:55.131 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:14:55.131 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:14:55.131 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:14:55.131 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:14:55.131 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:55.131 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:14:55.131 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:55.131 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:14:55.132 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:55.132 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:14:55.132 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:14:55.132 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:14:55.132 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:14:55.132 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:55.132 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:14:55.132 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:14:55.132 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:55.132 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:55.132 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:55.132 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:14:55.132 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:14:55.132 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:55.133 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:55.133 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:55.133 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:55.133 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:14:55.133 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:14:55.133 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:14:55.133 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:14:55.133 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:14:55.133 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:55.133 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:55.133 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:14:55.133 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:14:55.134 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:14:55.134 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:14:55.134 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:55.134 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:14:55.134 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:14:55.134 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:55.134 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:55.134 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:55.134 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:14:55.134 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:14:55.134 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:55.134 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:55.134 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:55.134 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:55.135 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:14:55.135 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:14:55.135 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:14:55.135 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:14:55.135 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:14:55.135 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:55.135 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:55.135 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:14:55.135 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:14:55.135 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:14:55.135 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:14:55.135 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:55.135 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:14:55.136 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:14:55.136 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:55.136 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:55.136 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:55.136 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:14:55.136 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:14:55.136 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:55.136 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:55.136 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:55.136 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:55.136 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:14:55.136 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:14:55.136 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:14:55.137 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:14:55.137 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:14:55.137 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:55.137 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:55.137 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:55.137 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:14:55.137 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:14:55.137 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:55.137 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:14:55.137 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:14:55.137 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:14:55.137 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:55.137 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:55.137 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:14:55.138 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:55.138 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:14:55.138 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:14:55.138 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 7 2024-08-24T21:14:55.138 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:55.138 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:55.138 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:14:55.138 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:55.138 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:14:55.138 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:14:55.138 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 6 2024-08-24T21:14:55.138 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:55.138 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:55.139 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:14:55.139 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:55.139 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:14:55.139 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:14:55.139 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:14:55.139 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:55.139 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:55.139 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:55.139 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:14:55.139 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:14:55.140 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:14:55.141 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:14:55.141 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:14:55.322 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:14:55.322 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:14:55.322 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:14:55.322 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:14:55.322 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 40, 2024-08-24T21:14:55.323 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 13791, 2024-08-24T21:14:55.323 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:14:55.323 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:14:55.323 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:14:55.323 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:14:55.323 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:55.323 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 8, 2024-08-24T21:14:55.323 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:14:55.323 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:14:55.323 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:14:55.323 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:14:55.323 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:14:55.323 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:14:55.324 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:14:55.324 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:14:55.324 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:14:55.324 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:14:55.324 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:14:55.324 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:14:55.324 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:14:55.324 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:14:55.324 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:55.324 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:14:55.324 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:14:55.324 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:14:55.325 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:14:55.325 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:14:55.325 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:14:55.325 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:14:55.325 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:14:55.325 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:14:55.325 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:14:55.325 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:14:55.325 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:14:55.325 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:14:55.325 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:55.325 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:55.325 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:14:55.325 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:14:55.326 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:14:55.326 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:14:55.326 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:14:55.326 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:14:55.326 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:14:55.326 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:14:55.326 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:14:55.326 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:14:55.326 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:14:55.326 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:14:55.326 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:14:55.326 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:14:55.327 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:14:55.327 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:14:55.327 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:14:55.327 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:14:55.327 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:14:55.327 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:14:55.327 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:14:55.327 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:14:55.327 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:14:55.327 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:14:55.327 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:14:55.328 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:14:55.328 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:14:55.328 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:14:55.328 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:55.328 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:14:55.328 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:55.328 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:14:55.328 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:55.328 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:14:55.328 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:14:55.328 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:14:55.328 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:14:55.328 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:55.328 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:14:55.329 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:14:55.329 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:55.329 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:55.329 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:55.329 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:14:55.329 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:14:55.329 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:55.329 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:55.329 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:55.329 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:55.329 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:14:55.329 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:14:55.329 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:14:55.330 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:14:55.330 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:14:55.330 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:55.330 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:55.330 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:14:55.330 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:14:55.330 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:14:55.330 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:14:55.330 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:55.330 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:14:55.330 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:14:55.330 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:55.330 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:55.330 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:55.331 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:14:55.331 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:14:55.331 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:55.331 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:55.331 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:55.331 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:55.331 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:14:55.331 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:14:55.331 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:14:55.331 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:14:55.331 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:14:55.331 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:55.332 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:55.332 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:14:55.332 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:14:55.332 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:14:55.332 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:14:55.332 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:55.332 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:14:55.332 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:14:55.332 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:55.332 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:55.332 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:55.332 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:14:55.332 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:14:55.333 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:55.333 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:55.333 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:55.333 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:55.333 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:14:55.333 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:14:55.333 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:14:55.333 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:14:55.333 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:14:55.333 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:55.333 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:55.333 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:55.333 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:14:55.333 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:14:55.334 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:55.334 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:14:55.334 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:14:55.334 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:14:55.334 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:55.334 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:55.334 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:14:55.334 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:55.334 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:14:55.334 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:14:55.334 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:14:55.334 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:55.334 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:55.335 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:55.335 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:14:55.335 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:14:55.337 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:14:55.337 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:14:55.337 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:14:55.513 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:14:55.514 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:14:55.514 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:14:55.514 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:14:55.514 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 40, 2024-08-24T21:14:55.514 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 59897, 2024-08-24T21:14:55.514 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:14:55.514 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:14:55.514 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:14:55.514 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:14:55.514 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:55.514 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 8, 2024-08-24T21:14:55.514 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:14:55.514 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:14:55.515 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:14:55.515 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:14:55.515 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:14:55.515 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:14:55.515 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:14:55.515 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:14:55.515 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:14:55.515 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:14:55.515 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:14:55.515 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:14:55.515 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:14:55.515 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:14:55.516 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:55.516 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:14:55.516 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:14:55.516 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:14:55.516 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:14:55.516 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:14:55.516 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:14:55.516 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:14:55.516 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:14:55.516 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:14:55.516 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:14:55.516 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:14:55.516 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:14:55.517 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:14:55.517 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:55.517 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:55.517 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:14:55.517 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:14:55.517 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:14:55.517 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:14:55.517 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:14:55.517 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:14:55.517 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:14:55.517 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:14:55.517 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:14:55.518 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:14:55.518 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:14:55.518 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:14:55.518 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:14:55.518 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:14:55.518 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:14:55.518 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:14:55.518 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:14:55.518 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:14:55.518 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:14:55.518 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:14:55.518 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:14:55.518 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:14:55.519 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:14:55.519 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:14:55.519 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:14:55.519 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:14:55.519 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:14:55.519 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:14:55.519 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:55.519 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:14:55.519 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:55.519 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:14:55.519 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:55.519 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:14:55.520 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:14:55.520 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:14:55.520 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:14:55.520 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:55.520 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:14:55.520 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:14:55.520 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:55.520 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:55.520 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:55.520 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:14:55.520 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:14:55.520 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:55.520 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:55.520 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:55.521 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:55.521 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:14:55.521 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:14:55.521 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:14:55.521 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:14:55.521 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:14:55.521 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:55.521 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:55.521 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:14:55.521 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:14:55.521 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:14:55.521 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:14:55.521 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:55.522 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:14:55.522 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:14:55.522 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:55.522 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:55.522 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:55.522 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:14:55.522 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:14:55.522 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:55.522 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:55.522 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:55.522 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:55.522 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:14:55.522 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:14:55.523 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:14:55.523 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:14:55.523 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:14:55.523 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:55.523 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:55.523 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:14:55.523 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:14:55.523 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:14:55.523 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:14:55.523 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:55.523 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:14:55.523 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:14:55.523 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:55.524 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:55.524 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:55.524 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:14:55.524 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:14:55.524 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:14:55.524 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:55.524 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:55.524 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:55.524 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:14:55.524 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:14:55.524 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:14:55.524 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:14:55.524 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:14:55.524 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:55.524 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:55.525 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:55.525 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:14:55.525 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:14:55.525 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:55.525 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:14:55.525 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:14:55.525 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:14:55.525 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:55.525 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:55.525 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:14:55.525 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:55.525 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:14:55.525 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:14:55.525 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:14:55.526 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:55.526 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:14:55.526 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:14:55.526 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:55.526 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x2f018fb87aa4aafe", 2024-08-24T21:14:55.526 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "luminous", 2024-08-24T21:14:55.526 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:14:55.526 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:55.526 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:14:55.526 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:14:55.526 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:14:55.526 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:14:55.526 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:14:55.526 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:14:55.527 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:14:55.527 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:14:55.527 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:14:55.528 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:14:55.528 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2024-08-24T21:14:55.528 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-08-24T21:14:55.528 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-08-24T21:14:55.528 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-08-24T21:14:55.529 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-08-24T21:14:55.529 INFO:teuthology.orchestra.run:waiting for 300 2024-08-24T21:14:55.547 INFO:tasks.ceph.mon.b:Stopped 2024-08-24T21:14:55.547 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-08-24T21:14:55.547 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:14:55.989 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":40,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":9,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:14:59.008 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:14:59.460 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":40,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:15:02.479 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:15:02.932 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":40,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:15:05.950 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:15:10.816 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":44,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:15:10.822 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:15:10.838 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-08-24T21:15:10.839 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-08-24T21:15:10.839 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:15:10.848 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 3 2024-08-24T21:15:11.017 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:15:11.017 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:15:11.017 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:15:11.017 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:15:11.017 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 44, 2024-08-24T21:15:11.017 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 166978, 2024-08-24T21:15:11.017 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:15:11.018 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:15:11.018 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:15:11.018 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:15:11.018 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 1, 2024-08-24T21:15:11.018 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:15:11.018 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:15:11.018 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:15:11.018 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:15:11.018 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:15:11.018 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:15:11.018 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:15:11.018 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:15:11.018 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:15:11.018 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:15:11.019 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:15:11.019 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:15:11.019 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:15:11.019 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:15:11.019 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:15:11.019 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:15:11.019 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:15:11.019 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:15:11.019 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:15:11.019 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:15:11.019 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:15:11.019 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:15:11.020 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:15:11.020 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:15:11.020 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:15:11.020 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:15:11.020 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:15:11.020 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:15:11.020 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:15:11.020 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:11.020 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:15:11.020 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:15:11.020 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:15:11.020 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:15:11.020 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:15:11.020 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:15:11.021 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:15:11.021 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:15:11.021 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:15:11.021 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:15:11.021 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:15:11.021 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:15:11.021 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:15:11.021 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:15:11.021 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:15:11.021 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:15:11.021 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:15:11.021 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:15:11.021 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:15:11.022 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:15:11.022 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:15:11.022 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:15:11.022 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:15:11.022 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:15:11.022 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:15:11.022 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:15:11.022 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:15:11.022 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:15:11.022 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:15:11.022 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:15:11.022 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:11.023 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:15:11.023 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:11.023 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:15:11.023 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:15:11.023 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:15:11.023 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:15:11.024 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:11.024 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:15:11.024 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:15:11.024 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:15:11.024 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:11.024 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:11.024 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:15:11.025 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:15:11.025 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:15:11.025 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:11.025 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:15:11.025 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:11.025 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:15:11.025 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:15:11.025 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:15:11.025 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:15:11.025 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:15:11.025 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:11.026 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:11.026 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:15:11.026 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:15:11.026 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:15:11.026 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:15:11.026 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:11.026 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:15:11.026 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:15:11.026 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:15:11.026 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:11.026 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:11.026 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:15:11.027 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:15:11.027 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:15:11.027 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:11.027 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:15:11.027 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:11.027 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:15:11.027 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:15:11.027 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:15:11.027 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:15:11.027 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:15:11.027 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:11.027 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:11.027 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:15:11.028 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:15:11.028 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:15:11.028 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:15:11.028 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:11.028 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:15:11.028 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:15:11.028 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:15:11.028 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:11.028 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:11.028 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:15:11.028 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:15:11.028 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:15:11.029 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:11.029 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:15:11.029 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:11.029 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:15:11.029 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:15:11.029 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:15:11.029 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:15:11.029 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:15:11.029 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:11.029 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:15:11.029 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:11.029 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:15:11.029 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:15:11.029 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:11.029 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:15:11.030 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:15:11.030 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:15:11.030 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:11.030 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:15:11.030 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:15:11.030 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:11.030 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:15:11.030 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:15:11.030 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 7 2024-08-24T21:15:11.030 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:11.030 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:15:11.031 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:15:11.031 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:11.031 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x2f018fb87aa4aafe", 2024-08-24T21:15:11.031 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "luminous", 2024-08-24T21:15:11.031 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:15:11.031 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:11.031 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:11.031 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:15:11.031 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:15:11.031 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 6 2024-08-24T21:15:11.031 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:11.032 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:15:11.032 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:15:11.032 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:11.032 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:15:11.032 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:15:11.032 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:15:11.032 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:11.032 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:15:11.032 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:11.032 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:15:11.032 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:15:11.033 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:15:11.034 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-08-24T21:15:11.034 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:15:11.042 INFO:tasks.workunit.client.0.smithi179.stderr:+ tar -C ac6341a6-6d9d-4017-bb38-7eb07f2860fe-mnt -xzf ac6341a6-6d9d-4017-bb38-7eb07f2860fe-mnt/linux-5.4.tar.gz 2024-08-24T21:15:11.209 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:15:11.210 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:15:11.210 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:15:11.210 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:15:11.210 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 44, 2024-08-24T21:15:11.210 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 29678, 2024-08-24T21:15:11.210 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:15:11.210 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:15:11.210 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:15:11.210 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:15:11.210 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 1, 2024-08-24T21:15:11.211 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:15:11.211 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:15:11.211 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:15:11.211 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:15:11.211 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:15:11.211 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:15:11.211 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:15:11.211 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:15:11.211 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:15:11.211 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:15:11.211 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:15:11.211 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:15:11.211 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:15:11.212 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:15:11.212 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:15:11.212 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:15:11.212 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:15:11.212 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:15:11.212 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:15:11.212 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:15:11.212 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:15:11.212 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:15:11.212 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:15:11.212 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:15:11.213 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:15:11.213 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:15:11.213 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:15:11.213 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:15:11.213 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:15:11.213 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:11.213 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:15:11.213 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:15:11.213 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:15:11.213 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:15:11.213 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:15:11.213 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:15:11.214 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:15:11.214 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:15:11.214 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:15:11.214 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:15:11.214 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:15:11.214 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:15:11.214 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:15:11.214 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:15:11.214 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:15:11.214 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:15:11.215 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:15:11.215 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:15:11.215 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:15:11.215 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:15:11.215 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:15:11.215 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:15:11.215 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:15:11.215 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:15:11.215 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:15:11.215 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:15:11.215 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:15:11.216 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:15:11.216 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:15:11.216 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:15:11.216 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:11.216 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:15:11.216 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:11.216 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:15:11.216 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:15:11.216 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:15:11.216 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:15:11.216 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:11.217 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:15:11.217 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:15:11.217 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:15:11.217 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:11.217 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:11.217 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:15:11.217 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:15:11.217 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:15:11.217 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:11.217 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:15:11.217 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:11.217 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:15:11.217 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:15:11.218 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:15:11.218 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:15:11.218 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:15:11.218 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:11.218 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:11.218 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:15:11.218 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:15:11.218 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:15:11.218 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:15:11.218 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:11.218 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:15:11.218 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:15:11.218 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:15:11.219 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:11.219 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:11.219 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:15:11.219 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:15:11.219 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:15:11.219 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:11.219 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:15:11.219 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:11.219 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:15:11.219 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:15:11.219 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:15:11.219 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:15:11.220 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:15:11.220 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:11.220 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:11.220 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:15:11.220 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:15:11.220 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:15:11.220 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:15:11.220 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:11.220 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:15:11.221 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:15:11.221 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:15:11.221 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:11.221 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:11.221 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:15:11.221 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:15:11.221 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:15:11.221 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:11.221 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:15:11.221 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:11.221 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:15:11.221 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:15:11.221 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:15:11.221 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:15:11.222 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:15:11.222 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:11.222 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:15:11.222 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:11.222 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:15:11.222 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:15:11.222 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:11.222 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:15:11.222 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:15:11.222 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:15:11.222 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:11.222 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:15:11.222 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:15:11.222 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:11.223 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:15:11.223 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:15:11.223 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:15:11.223 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:11.223 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:15:11.223 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:15:11.223 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:11.223 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:15:11.223 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:15:11.223 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:15:11.223 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:11.223 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:15:11.223 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:11.223 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:15:11.224 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:15:11.225 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:15:11.225 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-08-24T21:15:13.850 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap29 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap30 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap30.diff 2024-08-24T21:15:14.101 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 100% complete...done. 2024-08-24T21:15:14.119 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:15:14.119 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=31 2024-08-24T21:15:14.119 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap31 2024-08-24T21:15:14.303 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:15:14.322 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 3 2024-08-24T21:15:17.324 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap30 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap31 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap31.diff 2024-08-24T21:15:17.742 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 100% complete...done. 2024-08-24T21:15:17.750 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:15:17.750 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=32 2024-08-24T21:15:17.750 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap32 2024-08-24T21:15:20.163 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:15:20.185 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 2 2024-08-24T21:15:22.187 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap31 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap32 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap32.diff 2024-08-24T21:15:26.547 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 17% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 59% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 81% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 100% complete...done. 2024-08-24T21:15:26.582 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:15:26.583 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=33 2024-08-24T21:15:26.583 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap33 2024-08-24T21:15:31.225 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-08-24T21:15:31.226 INFO:tasks.ceph.mon.b:Restarting daemon 2024-08-24T21:15:31.226 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-08-24T21:15:31.232 INFO:tasks.ceph.mon.b:Started 2024-08-24T21:15:31.232 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:15:31.232 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:15:31.832 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":44,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":22,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:15:34.854 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:15:35.488 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":44,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":25,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:15:37.088 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:15:37.109 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 4 2024-08-24T21:15:37.250 INFO:tasks.workunit.client.0.smithi179.stderr:+ sync ac6341a6-6d9d-4017-bb38-7eb07f2860fe-mnt 2024-08-24T21:15:37.355 INFO:tasks.workunit.client.0.smithi179.stderr:+ rm -rf ac6341a6-6d9d-4017-bb38-7eb07f2860fe-mnt/linux-5.4 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-mnt/linux-5.4.tar.gz 2024-08-24T21:15:38.529 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:15:38.975 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":46,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:15:38.992 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:15:38.993 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:15:38.993 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:15:39.170 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:15:39.170 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:15:39.170 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:15:39.170 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:15:39.171 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 46, 2024-08-24T21:15:39.171 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 195133, 2024-08-24T21:15:39.171 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:15:39.171 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:15:39.171 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:15:39.171 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:15:39.171 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:15:39.171 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 3, 2024-08-24T21:15:39.171 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:15:39.171 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:15:39.171 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:15:39.171 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:15:39.171 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:15:39.171 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:15:39.172 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:15:39.172 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:15:39.172 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:15:39.172 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:15:39.172 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:15:39.172 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:15:39.172 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:15:39.172 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:15:39.172 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:15:39.172 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:15:39.172 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:15:39.172 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:15:39.172 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:15:39.173 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:15:39.173 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:15:39.173 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:15:39.173 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:15:39.173 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:15:39.173 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:15:39.173 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:15:39.173 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:15:39.173 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:15:39.173 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:15:39.173 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:39.174 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:15:39.174 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:15:39.174 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:15:39.174 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:15:39.174 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:15:39.174 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:15:39.174 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:15:39.174 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:15:39.174 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:15:39.174 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:15:39.174 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:15:39.174 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:15:39.174 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:15:39.175 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:15:39.175 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:15:39.175 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:15:39.175 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:15:39.175 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:15:39.175 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:15:39.175 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:15:39.175 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:15:39.175 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:15:39.175 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:15:39.175 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:15:39.176 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:15:39.176 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:15:39.176 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:15:39.176 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:15:39.176 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:15:39.176 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:15:39.176 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:39.176 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:15:39.176 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:39.176 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:15:39.176 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:15:39.177 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:15:39.177 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:15:39.177 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:39.177 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:15:39.177 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:15:39.177 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:15:39.177 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:39.177 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:39.177 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:15:39.177 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:15:39.177 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:15:39.178 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:39.178 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:15:39.178 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:39.178 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:15:39.178 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:15:39.178 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:15:39.178 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:15:39.178 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:15:39.178 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:39.178 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:39.178 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:15:39.178 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:15:39.179 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:15:39.179 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:15:39.179 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:39.179 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:15:39.179 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:15:39.179 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:15:39.179 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:39.179 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:39.179 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:15:39.179 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:15:39.179 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:15:39.179 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:39.179 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:15:39.180 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:39.180 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:15:39.180 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:15:39.180 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:15:39.180 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:15:39.180 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:15:39.180 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:39.180 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:39.180 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:15:39.180 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:15:39.180 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:15:39.181 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:15:39.181 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:39.181 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:15:39.181 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:15:39.181 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:15:39.181 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:39.181 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:39.181 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:15:39.181 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:15:39.181 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:15:39.181 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:39.181 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:15:39.181 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:39.182 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:15:39.182 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:15:39.182 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:15:39.182 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:15:39.182 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:15:39.182 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:39.182 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:15:39.182 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:39.182 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:15:39.182 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:15:39.182 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:39.182 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:15:39.182 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:15:39.183 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:15:39.183 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:39.183 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:15:39.183 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:15:39.183 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:39.183 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:15:39.183 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:15:39.183 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 7 2024-08-24T21:15:39.183 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:39.183 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:15:39.183 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:15:39.183 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:39.183 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x2f018fb87aa4aafe", 2024-08-24T21:15:39.184 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "luminous", 2024-08-24T21:15:39.184 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:15:39.184 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:39.184 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:39.184 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:15:39.184 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:15:39.184 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 6 2024-08-24T21:15:39.184 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:39.184 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:15:39.184 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:15:39.184 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:39.185 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:15:39.185 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:15:39.185 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:15:39.185 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:39.185 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:15:39.185 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:39.185 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:15:39.185 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:15:39.186 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:15:39.186 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:15:39.186 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:15:39.363 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:15:39.363 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:15:39.363 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:15:39.363 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:15:39.363 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 46, 2024-08-24T21:15:39.363 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 57832, 2024-08-24T21:15:39.363 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:15:39.363 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:15:39.363 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:15:39.363 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:15:39.364 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:15:39.364 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 3, 2024-08-24T21:15:39.364 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:15:39.364 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:15:39.364 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:15:39.364 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:15:39.364 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:15:39.364 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:15:39.364 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:15:39.364 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:15:39.364 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:15:39.364 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:15:39.364 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:15:39.365 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:15:39.365 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:15:39.365 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:15:39.365 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:15:39.365 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:15:39.365 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:15:39.365 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:15:39.365 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:15:39.365 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:15:39.365 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:15:39.365 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:15:39.365 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:15:39.365 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:15:39.366 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:15:39.366 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:15:39.366 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:15:39.366 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:15:39.366 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:15:39.366 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:39.366 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:15:39.366 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:15:39.366 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:15:39.366 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:15:39.366 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:15:39.366 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:15:39.367 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:15:39.367 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:15:39.367 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:15:39.367 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:15:39.367 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:15:39.367 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:15:39.367 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:15:39.367 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:15:39.367 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:15:39.367 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:15:39.367 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:15:39.367 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:15:39.368 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:15:39.368 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:15:39.368 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:15:39.368 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:15:39.368 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:15:39.368 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:15:39.368 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:15:39.368 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:15:39.368 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:15:39.368 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:15:39.368 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:15:39.368 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:15:39.368 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:39.368 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:15:39.369 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:39.369 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:15:39.369 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:15:39.369 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:15:39.369 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:15:39.369 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:39.369 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:15:39.369 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:15:39.369 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:15:39.369 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:39.369 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:39.369 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:15:39.369 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:15:39.369 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:15:39.370 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:39.370 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:15:39.370 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:39.370 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:15:39.370 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:15:39.370 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:15:39.370 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:15:39.370 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:15:39.370 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:39.370 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:39.370 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:15:39.370 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:15:39.370 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:15:39.371 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:15:39.371 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:39.371 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:15:39.371 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:15:39.371 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:15:39.371 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:39.371 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:39.371 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:15:39.371 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:15:39.371 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:15:39.371 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:39.371 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:15:39.371 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:39.372 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:15:39.372 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:15:39.372 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:15:39.372 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:15:39.372 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:15:39.372 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:39.372 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:39.372 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:15:39.372 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:15:39.372 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:15:39.372 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:15:39.372 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:39.372 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:15:39.373 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:15:39.373 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:15:39.373 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:39.373 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:39.373 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:15:39.373 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:15:39.373 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:15:39.373 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:39.373 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:15:39.373 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:39.373 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:15:39.374 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:15:39.374 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:15:39.374 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:15:39.374 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:15:39.374 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:39.374 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:15:39.374 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:39.374 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:15:39.374 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:15:39.374 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:39.374 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:15:39.374 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:15:39.374 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:15:39.374 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:39.375 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:15:39.375 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:15:39.375 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:39.375 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:15:39.375 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:15:39.375 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:15:39.375 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:39.375 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:15:39.375 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:15:39.375 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:39.375 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:15:39.375 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:15:39.375 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:15:39.375 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:39.376 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:15:39.376 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:39.376 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:15:39.376 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:15:39.378 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:15:39.378 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:15:39.378 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:15:39.556 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:15:39.556 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:15:39.556 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:15:39.556 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:15:39.556 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 46, 2024-08-24T21:15:39.556 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 8122, 2024-08-24T21:15:39.556 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:15:39.556 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:15:39.556 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:15:39.556 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:15:39.557 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:15:39.557 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 3, 2024-08-24T21:15:39.557 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:15:39.557 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:15:39.557 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:15:39.557 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:15:39.557 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:15:39.557 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:15:39.557 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:15:39.557 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:15:39.557 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:15:39.557 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:15:39.557 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:15:39.558 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:15:39.558 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:15:39.558 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:15:39.558 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:15:39.558 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:15:39.558 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:15:39.558 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:15:39.558 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:15:39.558 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:15:39.558 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:15:39.558 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:15:39.558 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:15:39.558 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:15:39.558 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:15:39.559 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:15:39.559 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:15:39.559 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:15:39.559 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:15:39.559 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:39.559 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:15:39.559 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:15:39.559 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:15:39.559 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:15:39.559 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:15:39.559 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:15:39.559 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:15:39.559 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:15:39.560 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:15:39.560 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:15:39.560 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:15:39.560 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:15:39.560 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:15:39.560 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:15:39.560 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:15:39.560 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:15:39.560 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:15:39.560 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:15:39.560 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:15:39.560 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:15:39.561 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:15:39.561 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:15:39.561 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:15:39.561 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:15:39.561 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:15:39.561 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:15:39.561 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:15:39.561 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:15:39.561 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:15:39.561 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:15:39.561 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:39.561 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:15:39.561 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:39.562 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:15:39.562 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:15:39.562 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:15:39.562 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:15:39.562 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:39.562 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:15:39.562 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:15:39.562 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:15:39.562 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:39.562 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:39.562 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:15:39.562 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:15:39.562 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:15:39.563 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:39.563 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:15:39.563 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:39.563 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:15:39.563 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:15:39.563 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:15:39.563 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:15:39.563 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:15:39.563 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:39.563 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:39.563 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:15:39.563 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:15:39.564 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:15:39.564 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:15:39.564 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:39.564 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:15:39.564 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:15:39.564 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:15:39.564 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:39.564 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:39.564 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:15:39.564 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:15:39.564 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:15:39.564 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:39.564 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:15:39.564 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:39.565 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:15:39.565 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:15:39.565 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:15:39.565 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:15:39.565 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:15:39.565 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:39.565 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:39.565 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:15:39.565 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:15:39.565 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:15:39.565 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:15:39.565 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:39.565 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:15:39.565 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:15:39.566 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:15:39.566 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:39.566 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:39.566 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:15:39.566 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:15:39.566 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:15:39.566 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:39.566 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:15:39.566 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:39.566 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:15:39.566 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:15:39.566 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:15:39.566 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:15:39.566 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:15:39.567 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:39.567 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:15:39.567 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:39.567 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:15:39.567 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:15:39.567 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:39.567 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:15:39.567 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:15:39.567 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:15:39.567 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:39.567 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:15:39.567 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:15:39.567 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:39.568 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:15:39.568 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:15:39.568 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:15:39.568 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:39.568 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:15:39.568 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:39.568 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:15:39.568 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:15:39.570 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:15:39.570 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-08-24T21:15:39.570 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-08-24T21:15:40.034 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-08-24T21:15:40.657 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:15:40.657 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i < 10 )) 2024-08-24T21:15:40.657 INFO:tasks.workunit.client.0.smithi179.stderr:+ pv -L 10M linux-5.4.tar.gz 2024-08-24T21:15:41.035 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:15:41.035 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:15:41.111 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap32 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap33 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap33.diff 2024-08-24T21:15:41.541 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":46,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:15:41.559 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:15:41.560 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-08-24T21:15:41.560 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:15:41.560 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:15:41.736 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:15:41.736 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:15:41.736 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:15:41.736 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:15:41.736 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 46, 2024-08-24T21:15:41.736 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 197698, 2024-08-24T21:15:41.736 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:15:41.736 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:15:41.736 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:15:41.737 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:15:41.737 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:15:41.737 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 5, 2024-08-24T21:15:41.737 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:15:41.737 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:15:41.737 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:15:41.737 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:15:41.737 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:15:41.737 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:15:41.737 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:15:41.737 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:15:41.737 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:15:41.738 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:15:41.738 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:15:41.738 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:15:41.738 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:15:41.738 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:15:41.738 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:15:41.738 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:15:41.738 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:15:41.738 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:15:41.738 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:15:41.738 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:15:41.738 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:15:41.738 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:15:41.739 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:15:41.739 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:15:41.739 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:15:41.739 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:15:41.739 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:15:41.739 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:15:41.739 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:15:41.739 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:41.739 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:15:41.739 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:15:41.739 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:15:41.739 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:15:41.740 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:15:41.740 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:15:41.740 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:15:41.740 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:15:41.740 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:15:41.740 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:15:41.740 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:15:41.740 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:15:41.742 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:15:41.742 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:15:41.742 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:15:41.742 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:15:41.742 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:15:41.742 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:15:41.742 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:15:41.742 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:15:41.742 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:15:41.742 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:15:41.742 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:15:41.742 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:15:41.743 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:15:41.743 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:15:41.743 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:15:41.743 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:15:41.743 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:15:41.743 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:15:41.743 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:41.743 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:15:41.743 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:41.743 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:15:41.743 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:15:41.744 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:15:41.744 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:15:41.744 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:41.744 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:15:41.744 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:15:41.744 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:15:41.744 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:41.744 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:41.744 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:15:41.744 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:15:41.744 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:15:41.744 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:41.744 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:15:41.745 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:41.745 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:15:41.745 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:15:41.745 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:15:41.745 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:15:41.745 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:15:41.745 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:41.745 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:41.745 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:15:41.745 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:15:41.745 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:15:41.745 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:15:41.745 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:41.746 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:15:41.746 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:15:41.746 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:15:41.746 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:41.746 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:41.746 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:15:41.746 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:15:41.746 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:15:41.746 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:41.746 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:15:41.746 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:41.746 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:15:41.746 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:15:41.747 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:15:41.747 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:15:41.747 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:15:41.747 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:41.747 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:41.747 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:15:41.747 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:15:41.747 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:15:41.747 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:15:41.747 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:41.747 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:15:41.747 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:15:41.748 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:15:41.748 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:41.748 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:41.748 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:15:41.748 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:15:41.748 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:15:41.748 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:41.748 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:15:41.748 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:41.748 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:15:41.748 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:15:41.748 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:15:41.748 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:15:41.749 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:15:41.749 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:41.749 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:15:41.749 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:41.749 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:15:41.749 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:15:41.749 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:41.749 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:15:41.749 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:15:41.749 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:15:41.749 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:41.749 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:15:41.749 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:15:41.750 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:41.750 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:15:41.750 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:15:41.750 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 7 2024-08-24T21:15:41.750 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:41.750 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:15:41.750 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:15:41.750 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:41.750 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x2f018fb87aa4aafe", 2024-08-24T21:15:41.750 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "luminous", 2024-08-24T21:15:41.750 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:15:41.750 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:41.750 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:41.751 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:15:41.751 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:15:41.751 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 6 2024-08-24T21:15:41.751 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:41.751 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:15:41.751 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:15:41.751 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:41.751 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:15:41.751 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:15:41.751 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:15:41.751 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:41.751 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:15:41.751 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:41.751 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:15:41.752 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:15:41.752 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:15:41.753 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:15:41.753 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:15:41.929 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:15:41.929 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:15:41.929 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:15:41.929 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:15:41.929 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 46, 2024-08-24T21:15:41.929 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 60398, 2024-08-24T21:15:41.929 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:15:41.929 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:15:41.929 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:15:41.929 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:15:41.930 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:15:41.930 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 5, 2024-08-24T21:15:41.930 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:15:41.930 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:15:41.930 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:15:41.930 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:15:41.930 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:15:41.930 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:15:41.930 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:15:41.930 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:15:41.930 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:15:41.930 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:15:41.931 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:15:41.931 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:15:41.931 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:15:41.931 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:15:41.931 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:15:41.931 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:15:41.931 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:15:41.931 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:15:41.931 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:15:41.931 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:15:41.931 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:15:41.931 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:15:41.931 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:15:41.932 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:15:41.932 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:15:41.932 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:15:41.932 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:15:41.932 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:15:41.932 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:15:41.932 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:41.932 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:15:41.932 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:15:41.932 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:15:41.932 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:15:41.932 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:15:41.933 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:15:41.933 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:15:41.933 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:15:41.933 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:15:41.933 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:15:41.933 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:15:41.933 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:15:41.933 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:15:41.933 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:15:41.933 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:15:41.933 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:15:41.933 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:15:41.933 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:15:41.934 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:15:41.934 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:15:41.934 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:15:41.934 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:15:41.934 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:15:41.934 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:15:41.934 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:15:41.934 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:15:41.934 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:15:41.934 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:15:41.934 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:15:41.934 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:15:41.935 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:41.935 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:15:41.935 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:41.935 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:15:41.935 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:15:41.935 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:15:41.935 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:15:41.935 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:41.935 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:15:41.935 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:15:41.935 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:15:41.935 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:41.935 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:41.936 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:15:41.936 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:15:41.936 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:15:41.936 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:41.936 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:15:41.936 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:41.936 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:15:41.936 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:15:41.936 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:15:41.936 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:15:41.936 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:15:41.936 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:41.937 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:41.937 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:15:41.937 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:15:41.937 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:15:41.937 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:15:41.937 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:41.937 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:15:41.937 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:15:41.937 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:15:41.937 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:41.937 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:41.937 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:15:41.937 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:15:41.937 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:15:41.938 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:41.938 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:15:41.938 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:41.938 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:15:41.938 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:15:41.938 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:15:41.938 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:15:41.938 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:15:41.938 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:41.938 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:41.938 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:15:41.938 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:15:41.938 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:15:41.938 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:15:41.939 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:41.939 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:15:41.939 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:15:41.939 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:15:41.939 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:41.939 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:41.939 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:15:41.939 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:15:41.939 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:15:41.939 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:41.939 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:15:41.939 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:41.940 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:15:41.940 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:15:41.940 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:15:41.940 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:15:41.940 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:15:41.940 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:41.940 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:15:41.940 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:41.940 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:15:41.940 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:15:41.940 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:41.940 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:15:41.940 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:15:41.941 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:15:41.941 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:41.941 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:15:41.941 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:15:41.941 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:41.941 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:15:41.941 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:15:41.941 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:15:41.941 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:41.941 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:15:41.941 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:15:41.941 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:41.942 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:15:41.942 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:15:41.942 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:15:41.942 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:41.942 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:15:41.942 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:41.942 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:15:41.942 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:15:41.951 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:15:41.951 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:15:41.951 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:15:42.155 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:15:42.155 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:15:42.155 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:15:42.155 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:15:42.155 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 46, 2024-08-24T21:15:42.155 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 10721, 2024-08-24T21:15:42.155 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:15:42.155 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:15:42.155 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:15:42.155 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:15:42.156 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:15:42.156 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 6, 2024-08-24T21:15:42.156 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:15:42.156 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:15:42.156 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:15:42.156 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:15:42.156 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:15:42.156 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:15:42.156 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:15:42.156 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:15:42.156 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:15:42.156 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:15:42.157 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:15:42.157 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:15:42.157 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:15:42.157 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:15:42.157 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:15:42.157 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:15:42.157 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:15:42.157 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:15:42.157 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:15:42.157 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:15:42.157 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:15:42.157 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:15:42.157 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:15:42.157 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:15:42.158 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:15:42.158 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:15:42.158 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:15:42.158 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:15:42.158 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:15:42.158 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:42.158 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:15:42.159 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:15:42.159 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:15:42.159 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:15:42.159 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:15:42.159 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:15:42.159 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:15:42.159 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:15:42.159 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:15:42.159 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:15:42.159 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:15:42.159 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:15:42.159 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:15:42.159 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:15:42.160 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:15:42.160 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:15:42.160 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:15:42.160 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:15:42.160 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:15:42.160 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:15:42.160 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:15:42.160 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:15:42.160 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:15:42.160 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:15:42.160 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:15:42.160 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:15:42.160 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:15:42.161 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:15:42.161 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:15:42.161 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:15:42.161 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:42.161 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:15:42.161 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:42.161 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:15:42.161 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:15:42.161 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:15:42.161 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:15:42.161 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:42.161 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:15:42.162 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:15:42.162 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:15:42.162 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:42.162 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:42.162 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:15:42.162 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:15:42.162 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:15:42.162 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:42.162 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:15:42.162 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:42.162 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:15:42.162 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:15:42.162 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:15:42.163 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:15:42.163 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:15:42.163 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:42.163 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:42.163 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:15:42.163 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:15:42.163 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:15:42.163 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:15:42.163 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:42.163 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:15:42.163 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:15:42.163 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:15:42.163 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:42.163 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:42.164 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:15:42.164 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:15:42.164 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:15:42.164 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:42.164 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:15:42.164 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:42.164 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:15:42.164 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:15:42.164 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:15:42.164 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:15:42.164 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:15:42.164 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:42.165 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:42.165 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:15:42.165 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:15:42.165 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:15:42.165 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:15:42.165 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:42.165 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:15:42.165 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:15:42.165 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:15:42.165 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:42.165 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:42.165 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:15:42.165 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:15:42.165 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:15:42.165 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:42.166 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:15:42.166 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:42.166 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:15:42.166 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:15:42.166 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:15:42.166 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:15:42.166 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:15:42.166 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:42.166 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:15:42.166 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:42.166 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:15:42.166 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:15:42.166 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:42.166 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:15:42.167 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:15:42.167 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:15:42.167 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:42.167 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:15:42.167 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:15:42.167 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:42.167 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:15:42.167 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:15:42.167 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:15:42.167 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:42.167 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:15:42.167 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:42.167 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:15:42.168 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:15:42.170 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:15:42.170 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-08-24T21:15:42.170 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-08-24T21:15:42.170 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-08-24T21:15:42.170 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-08-24T21:15:42.171 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-08-24T21:15:42.171 INFO:teuthology.orchestra.run:waiting for 300 2024-08-24T21:15:42.194 INFO:tasks.ceph.mon.a:Stopped 2024-08-24T21:15:42.194 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-08-24T21:15:42.194 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:15:42.720 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":46,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":6,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:15:43.701 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 51% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:15:43.768 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:15:43.768 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=34 2024-08-24T21:15:43.768 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap34 2024-08-24T21:15:45.741 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:15:46.192 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":46,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":10,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:15:49.211 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:15:49.657 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":46,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:15:52.676 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:15:57.171 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:15:57.198 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 3 2024-08-24T21:15:57.454 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":48,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:15:57.472 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-08-24T21:15:57.472 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-08-24T21:15:57.473 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:15:57.483 INFO:tasks.workunit.client.0.smithi179.stderr:+ tar -C ac6341a6-6d9d-4017-bb38-7eb07f2860fe-mnt -xzf ac6341a6-6d9d-4017-bb38-7eb07f2860fe-mnt/linux-5.4.tar.gz 2024-08-24T21:15:57.648 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:15:57.648 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:15:57.648 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:15:57.649 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:15:57.649 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 48, 2024-08-24T21:15:57.649 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 76118, 2024-08-24T21:15:57.649 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:15:57.649 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:15:57.649 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:15:57.649 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:15:57.649 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:15:57.649 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:15:57.649 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:15:57.649 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:15:57.649 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:15:57.649 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:15:57.649 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:15:57.650 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:15:57.650 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:15:57.650 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:15:57.650 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:15:57.650 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:15:57.650 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:15:57.650 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:15:57.650 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:15:57.650 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:15:57.650 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:15:57.650 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:15:57.650 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:15:57.650 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:15:57.651 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:15:57.651 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:15:57.651 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:15:57.651 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:15:57.651 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:15:57.651 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:15:57.651 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:15:57.651 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:15:57.651 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:15:57.651 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:15:57.651 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:57.651 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:15:57.651 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:15:57.652 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:15:57.652 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:15:57.652 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:15:57.652 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:15:57.652 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:15:57.652 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:15:57.652 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:15:57.652 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:15:57.652 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:15:57.652 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:15:57.652 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:15:57.652 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:15:57.652 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:15:57.652 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:15:57.653 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:15:57.653 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:15:57.653 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:15:57.653 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:15:57.653 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:15:57.653 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:15:57.653 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:15:57.653 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:15:57.653 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:15:57.653 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:15:57.653 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:15:57.653 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:15:57.653 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:15:57.653 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:15:57.654 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:57.654 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:15:57.654 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:57.654 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:15:57.654 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:15:57.654 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:15:57.654 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:15:57.654 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:57.654 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:15:57.654 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:15:57.654 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:15:57.654 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:57.654 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:57.654 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:15:57.655 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:15:57.655 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:15:57.655 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:57.655 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:15:57.655 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:57.655 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:15:57.655 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:15:57.655 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:15:57.655 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:15:57.655 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:15:57.655 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:57.655 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:57.655 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:15:57.656 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:15:57.656 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:15:57.656 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:15:57.656 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:57.656 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:15:57.656 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:15:57.656 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:15:57.656 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:57.656 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:57.656 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:15:57.656 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:15:57.656 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:15:57.656 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:57.656 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:15:57.656 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:57.657 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:15:57.657 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:15:57.657 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:15:57.657 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:15:57.657 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:15:57.657 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:57.657 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:57.657 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:15:57.657 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:15:57.657 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:15:57.657 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:15:57.657 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:57.657 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:15:57.657 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:15:57.658 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:15:57.658 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:57.658 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:57.658 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:15:57.658 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:15:57.658 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:15:57.658 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:57.658 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:15:57.658 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:57.658 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:15:57.658 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:15:57.658 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:15:57.659 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:15:57.659 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:15:57.659 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:57.659 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:15:57.659 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:57.659 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:15:57.659 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:15:57.659 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:57.659 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:15:57.659 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:15:57.659 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:15:57.659 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:57.659 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:15:57.660 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:15:57.660 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:57.660 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:15:57.660 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:15:57.660 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 6 2024-08-24T21:15:57.660 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:57.660 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:15:57.660 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:15:57.660 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:57.660 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x2f018fb87aa4aafe", 2024-08-24T21:15:57.660 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "luminous", 2024-08-24T21:15:57.660 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:15:57.661 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:57.661 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:57.661 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:15:57.661 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:15:57.661 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:15:57.661 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:57.661 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:15:57.661 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:15:57.661 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:57.661 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:15:57.661 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:15:57.661 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:15:57.661 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:57.661 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:15:57.662 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:57.662 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:15:57.662 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:15:57.663 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:15:57.663 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-08-24T21:15:57.663 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:15:57.840 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:15:57.840 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:15:57.840 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:15:57.840 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:15:57.841 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 48, 2024-08-24T21:15:57.841 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 26407, 2024-08-24T21:15:57.841 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:15:57.841 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:15:57.841 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:15:57.841 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:15:57.841 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:15:57.841 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:15:57.841 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:15:57.841 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:15:57.841 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:15:57.842 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:15:57.842 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:15:57.842 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:15:57.842 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:15:57.842 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:15:57.842 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:15:57.842 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:15:57.842 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:15:57.842 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:15:57.842 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:15:57.842 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:15:57.842 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:15:57.842 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:15:57.842 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:15:57.843 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:15:57.843 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:15:57.843 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:15:57.843 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:15:57.843 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:15:57.843 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:15:57.843 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:15:57.843 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:15:57.843 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:15:57.843 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:15:57.843 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:15:57.844 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:57.844 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:15:57.844 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:15:57.844 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:15:57.844 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:15:57.844 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:15:57.844 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:15:57.844 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:15:57.844 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:15:57.844 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:15:57.844 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:15:57.844 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:15:57.844 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:15:57.844 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:15:57.845 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:15:57.845 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:15:57.845 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:15:57.845 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:15:57.845 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:15:57.845 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:15:57.845 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:15:57.845 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:15:57.845 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:15:57.845 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:15:57.845 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:15:57.845 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:15:57.845 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:15:57.845 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:15:57.846 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:15:57.846 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:15:57.846 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:15:57.846 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:57.846 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:15:57.846 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:57.846 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:15:57.846 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:15:57.846 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:15:57.846 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:15:57.846 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:57.846 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:15:57.846 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:15:57.847 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:15:57.847 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:57.847 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:57.847 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:15:57.847 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:15:57.847 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:15:57.847 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:57.847 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:15:57.847 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:57.847 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:15:57.847 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:15:57.847 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:15:57.848 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:15:57.848 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:15:57.848 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:57.848 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:57.848 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:15:57.848 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:15:57.848 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:15:57.848 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:15:57.848 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:57.848 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:15:57.848 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:15:57.848 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:15:57.848 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:57.848 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:57.848 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:15:57.849 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:15:57.849 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:15:57.849 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:57.849 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:15:57.849 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:57.849 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:15:57.849 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:15:57.849 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:15:57.849 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:15:57.849 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:15:57.849 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:57.849 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:57.849 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:15:57.849 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:15:57.850 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:15:57.850 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:15:57.850 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:57.850 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:15:57.850 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:15:57.850 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:15:57.850 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:57.850 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:57.850 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:15:57.850 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:15:57.850 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:15:57.850 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:57.850 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:15:57.850 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:57.851 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:15:57.851 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:15:57.851 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:15:57.851 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:15:57.851 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:15:57.851 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:57.851 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:15:57.851 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:57.851 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:15:57.851 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:15:57.851 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:57.851 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:15:57.851 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:15:57.852 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:15:57.852 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:57.852 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:15:57.852 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:15:57.852 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:57.852 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:15:57.852 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:15:57.852 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:15:57.852 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:57.852 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:15:57.852 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:15:57.852 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:15:57.852 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:15:57.852 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:15:57.852 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-08-24T21:15:57.852 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:15:57.853 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:15:57.853 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:15:57.853 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:15:57.853 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:15:57.855 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:15:57.855 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-08-24T21:16:00.201 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap33 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap34 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap34.diff 2024-08-24T21:16:00.483 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 100% complete...done. 2024-08-24T21:16:00.497 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:16:00.498 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=35 2024-08-24T21:16:00.498 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap35 2024-08-24T21:16:01.181 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:16:01.205 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 3 2024-08-24T21:16:04.115 INFO:tasks.workunit.client.0.smithi179.stderr:+ sync ac6341a6-6d9d-4017-bb38-7eb07f2860fe-mnt 2024-08-24T21:16:04.183 INFO:tasks.workunit.client.0.smithi179.stderr:+ rm -rf ac6341a6-6d9d-4017-bb38-7eb07f2860fe-mnt/linux-5.4 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-mnt/linux-5.4.tar.gz 2024-08-24T21:16:04.207 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap34 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap35 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap35.diff 2024-08-24T21:16:04.579 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 43% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 100% complete...done. 2024-08-24T21:16:04.591 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:16:04.591 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=36 2024-08-24T21:16:04.591 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap36 2024-08-24T21:16:06.202 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:16:06.228 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 1 2024-08-24T21:16:07.231 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap35 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap36 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap36.diff 2024-08-24T21:16:08.707 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 34% complete... Exporting image: 45% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:16:08.748 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:16:08.749 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=37 2024-08-24T21:16:08.749 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap37 2024-08-24T21:16:09.097 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete...+ (( i++ )) 2024-08-24T21:16:09.098 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i < 10 )) 2024-08-24T21:16:09.098 INFO:tasks.workunit.client.0.smithi179.stderr:+ pv -L 10M linux-5.4.tar.gz 2024-08-24T21:16:09.214 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 100% complete...done. 2024-08-24T21:16:09.234 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 1 2024-08-24T21:16:10.237 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap36 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap37 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap37.diff 2024-08-24T21:16:10.701 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 100% complete...done. 2024-08-24T21:16:10.715 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:16:10.715 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=38 2024-08-24T21:16:10.715 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap38 2024-08-24T21:16:11.231 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:16:11.257 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 2 2024-08-24T21:16:13.259 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap37 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap38 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap38.diff 2024-08-24T21:16:13.340 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 100% complete...done. 2024-08-24T21:16:13.347 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:16:13.347 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=39 2024-08-24T21:16:13.347 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap39 2024-08-24T21:16:14.236 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:16:14.259 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 4 2024-08-24T21:16:17.855 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-08-24T21:16:17.856 INFO:tasks.ceph.mon.a:Restarting daemon 2024-08-24T21:16:17.856 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-08-24T21:16:17.861 INFO:tasks.ceph.mon.a:Started 2024-08-24T21:16:17.861 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:16:17.861 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:16:18.262 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap38 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap39 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap39.diff 2024-08-24T21:16:18.307 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":48,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":21,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:16:18.503 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 51% complete... Exporting image: 100% complete...done. 2024-08-24T21:16:18.515 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:16:18.515 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=40 2024-08-24T21:16:18.515 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap40 2024-08-24T21:16:19.259 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:16:19.279 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 1 2024-08-24T21:16:20.282 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap39 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap40 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap40.diff 2024-08-24T21:16:20.398 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 100% complete...done. 2024-08-24T21:16:20.405 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:16:20.405 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=41 2024-08-24T21:16:20.405 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap41 2024-08-24T21:16:21.268 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:16:21.296 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 1 2024-08-24T21:16:21.328 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:16:21.767 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":48,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":24,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:16:22.298 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap40 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap41 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap41.diff 2024-08-24T21:16:22.379 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 100% complete...done. 2024-08-24T21:16:22.385 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:16:22.386 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=42 2024-08-24T21:16:22.386 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap42 2024-08-24T21:16:23.275 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:16:23.297 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 2 2024-08-24T21:16:24.787 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:16:25.235 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":48,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":28,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:16:25.300 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap41 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap42 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap42.diff 2024-08-24T21:16:25.417 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 100% complete...done. 2024-08-24T21:16:25.425 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:16:25.425 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=43 2024-08-24T21:16:25.425 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap43 2024-08-24T21:16:25.546 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete...+ tar -C ac6341a6-6d9d-4017-bb38-7eb07f2860fe-mnt -xzf ac6341a6-6d9d-4017-bb38-7eb07f2860fe-mnt/linux-5.4.tar.gz 2024-08-24T21:16:26.287 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 100% complete...done. 2024-08-24T21:16:26.314 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 2 2024-08-24T21:16:28.255 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:16:28.316 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap42 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap43 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap43.diff 2024-08-24T21:16:28.394 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 100% complete...done. 2024-08-24T21:16:28.403 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:16:28.404 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=44 2024-08-24T21:16:28.404 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap44 2024-08-24T21:16:28.708 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":48,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":31,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:16:29.301 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:16:29.323 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 3 2024-08-24T21:16:31.727 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:16:32.326 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap43 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap44 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap44.diff 2024-08-24T21:16:32.434 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":48,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":35,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:16:32.487 INFO:tasks.workunit.client.0.smithi179.stderr:+ sync ac6341a6-6d9d-4017-bb38-7eb07f2860fe-mnt 2024-08-24T21:16:32.533 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete...+ rm -rf ac6341a6-6d9d-4017-bb38-7eb07f2860fe-mnt/linux-5.4 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-mnt/linux-5.4.tar.gz 2024-08-24T21:16:33.221 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 43% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 100% complete...done. 2024-08-24T21:16:33.235 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:16:33.236 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=45 2024-08-24T21:16:33.236 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap45 2024-08-24T21:16:34.323 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:16:34.343 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 3 2024-08-24T21:16:35.466 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:16:35.613 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:16:35.613 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i < 10 )) 2024-08-24T21:16:35.613 INFO:tasks.workunit.client.0.smithi179.stderr:+ pv -L 10M linux-5.4.tar.gz 2024-08-24T21:16:35.918 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":48,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":38,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:16:37.346 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap44 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap45 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap45.diff 2024-08-24T21:16:38.487 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 100% complete...done. 2024-08-24T21:16:38.525 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:16:38.525 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=46 2024-08-24T21:16:38.525 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap46 2024-08-24T21:16:38.937 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:16:39.333 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:16:39.355 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 3 2024-08-24T21:16:39.386 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":48,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":42,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:16:42.358 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap45 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap46 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap46.diff 2024-08-24T21:16:42.405 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:16:42.553 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 100% complete...done. 2024-08-24T21:16:42.563 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:16:42.564 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=47 2024-08-24T21:16:42.564 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap47 2024-08-24T21:16:42.884 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":48,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":45,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:16:43.354 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:16:43.375 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 2 2024-08-24T21:16:45.377 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap46 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap47 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap47.diff 2024-08-24T21:16:45.491 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 100% complete...done. 2024-08-24T21:16:45.498 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:16:45.498 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=48 2024-08-24T21:16:45.498 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap48 2024-08-24T21:16:45.903 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:16:46.352 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":52,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:16:46.370 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:16:46.370 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:16:46.371 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:16:46.554 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:16:46.554 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:16:46.555 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:16:46.555 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:16:46.555 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 52, 2024-08-24T21:16:46.555 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 28537, 2024-08-24T21:16:46.555 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:16:46.555 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:16:46.555 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:16:46.555 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:16:46.555 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:16:46.555 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 3, 2024-08-24T21:16:46.555 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:16:46.555 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:16:46.556 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:16:46.556 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:16:46.556 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:16:46.556 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:16:46.556 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:16:46.556 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:16:46.556 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:16:46.556 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:16:46.556 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:16:46.556 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:16:46.556 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:16:46.556 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:16:46.556 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:16:46.557 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:16:46.557 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:16:46.557 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:16:46.557 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:16:46.557 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:16:46.557 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:16:46.557 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:16:46.557 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:16:46.557 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:16:46.557 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:16:46.557 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:16:46.558 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:16:46.558 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:16:46.558 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:16:46.558 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:46.558 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:16:46.558 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:16:46.558 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:16:46.558 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:16:46.558 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:16:46.558 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:16:46.558 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:16:46.559 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:16:46.559 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:16:46.559 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:16:46.559 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:16:46.559 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:16:46.559 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:16:46.559 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:16:46.559 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:16:46.559 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:16:46.559 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:16:46.559 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:16:46.559 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:16:46.560 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:16:46.560 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:16:46.560 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:16:46.560 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:16:46.560 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:16:46.560 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:16:46.560 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:16:46.560 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:16:46.560 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:16:46.560 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:16:46.560 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:16:46.560 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:46.560 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:16:46.561 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:46.561 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:16:46.561 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:16:46.561 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:16:46.561 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:16:46.561 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:46.561 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:16:46.561 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:16:46.561 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:16:46.561 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:46.561 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:46.562 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:16:46.562 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:16:46.562 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:16:46.562 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:16:46.562 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:16:46.562 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:46.562 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:16:46.562 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:16:46.562 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:16:46.562 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:16:46.562 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:16:46.562 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:46.563 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:46.563 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:16:46.563 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:16:46.563 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:16:46.563 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:16:46.563 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:46.563 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:16:46.563 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:16:46.563 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:16:46.563 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:46.563 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:46.563 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:16:46.563 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:16:46.564 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:16:46.564 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:16:46.564 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:16:46.564 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:46.564 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:16:46.564 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:16:46.564 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:16:46.564 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:16:46.564 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:16:46.564 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:46.565 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:46.565 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:16:46.565 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:16:46.565 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:16:46.565 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:16:46.565 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:46.565 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:16:46.565 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:16:46.565 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:16:46.565 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:46.565 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:46.565 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:16:46.565 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:16:46.566 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:16:46.566 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:16:46.566 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:16:46.566 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:46.566 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:16:46.566 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:16:46.566 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:16:46.566 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:16:46.566 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:16:46.566 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:16:46.566 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:16:46.566 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:46.566 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:16:46.567 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:16:46.567 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:46.567 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:16:46.567 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:16:46.567 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:16:46.567 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:16:46.567 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:16:46.567 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:16:46.567 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:46.567 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:16:46.567 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:16:46.567 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:16:46.567 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:16:46.568 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:16:46.568 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:46.568 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:16:46.568 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:16:46.568 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:16:46.571 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:16:46.571 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:16:46.571 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:16:46.585 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 4 2024-08-24T21:16:46.747 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:16:46.748 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:16:46.748 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:16:46.748 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:16:46.748 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 52, 2024-08-24T21:16:46.748 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 125216, 2024-08-24T21:16:46.748 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:16:46.748 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:16:46.748 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:16:46.748 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:16:46.748 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:16:46.748 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 3, 2024-08-24T21:16:46.749 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:16:46.749 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:16:46.749 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:16:46.749 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:16:46.749 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:16:46.749 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:16:46.749 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:16:46.749 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:16:46.749 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:16:46.749 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:16:46.749 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:16:46.749 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:16:46.750 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:16:46.750 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:16:46.750 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:16:46.750 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:16:46.750 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:16:46.750 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:16:46.750 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:16:46.750 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:16:46.750 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:16:46.750 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:16:46.750 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:16:46.750 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:16:46.751 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:16:46.751 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:16:46.751 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:16:46.751 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:16:46.751 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:16:46.751 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:46.751 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:16:46.751 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:16:46.751 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:16:46.751 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:16:46.751 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:16:46.751 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:16:46.751 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:16:46.752 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:16:46.752 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:16:46.752 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:16:46.752 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:16:46.752 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:16:46.752 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:16:46.752 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:16:46.752 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:16:46.752 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:16:46.752 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:16:46.752 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:16:46.752 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:16:46.752 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:16:46.753 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:16:46.753 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:16:46.753 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:16:46.753 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:16:46.753 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:16:46.753 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:16:46.753 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:16:46.753 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:16:46.753 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:16:46.753 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:16:46.753 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:46.753 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:16:46.754 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:46.754 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:16:46.754 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:16:46.754 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:16:46.754 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:16:46.754 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:46.754 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:16:46.754 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:16:46.754 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:16:46.754 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:46.754 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:46.754 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:16:46.754 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:16:46.755 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:16:46.755 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:16:46.755 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:16:46.755 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:46.755 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:16:46.755 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:16:46.755 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:16:46.755 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:16:46.755 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:16:46.755 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:46.755 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:46.755 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:16:46.755 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:16:46.756 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:16:46.756 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:16:46.756 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:46.756 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:16:46.756 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:16:46.756 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:16:46.756 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:46.756 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:46.756 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:16:46.756 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:16:46.756 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:16:46.756 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:16:46.756 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:16:46.757 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:46.757 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:16:46.757 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:16:46.757 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:16:46.757 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:16:46.757 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:16:46.757 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:46.757 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:46.757 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:16:46.757 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:16:46.757 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:16:46.757 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:16:46.757 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:46.758 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:16:46.758 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:16:46.758 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:16:46.758 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:46.758 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:46.758 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:16:46.758 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:16:46.758 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:16:46.758 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:16:46.758 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:16:46.758 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:46.758 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:16:46.759 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:16:46.759 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:16:46.759 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:16:46.759 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:16:46.759 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:16:46.759 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:16:46.759 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:46.759 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:16:46.759 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:16:46.759 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:46.759 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:16:46.759 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:16:46.759 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:16:46.760 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:16:46.760 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:16:46.760 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:16:46.760 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:46.760 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:16:46.760 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:16:46.760 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 6 2024-08-24T21:16:46.760 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:16:46.760 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:16:46.760 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:16:46.760 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:46.760 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x2f018fb87aa4aafe", 2024-08-24T21:16:46.760 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "luminous", 2024-08-24T21:16:46.760 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:16:46.761 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:46.761 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:46.761 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:16:46.761 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:16:46.761 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:16:46.761 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:16:46.761 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:16:46.761 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:16:46.761 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:46.761 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:16:46.761 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:16:46.762 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:16:46.762 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:16:46.762 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:16:46.762 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:46.762 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:16:46.762 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:16:46.763 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:16:46.763 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:16:46.763 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:16:46.940 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:16:46.940 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:16:46.941 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:16:46.941 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:16:46.941 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 52, 2024-08-24T21:16:46.941 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 75508, 2024-08-24T21:16:46.941 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:16:46.941 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:16:46.941 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:16:46.941 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:16:46.941 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:16:46.941 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 3, 2024-08-24T21:16:46.941 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:16:46.941 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:16:46.941 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:16:46.942 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:16:46.942 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:16:46.942 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:16:46.942 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:16:46.942 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:16:46.942 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:16:46.942 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:16:46.942 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:16:46.942 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:16:46.942 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:16:46.942 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:16:46.942 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:16:46.943 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:16:46.943 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:16:46.943 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:16:46.943 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:16:46.943 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:16:46.943 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:16:46.943 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:16:46.943 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:16:46.943 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:16:46.943 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:16:46.943 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:16:46.943 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:16:46.943 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:16:46.944 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:16:46.944 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:46.944 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:16:46.944 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:16:46.944 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:16:46.944 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:16:46.944 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:16:46.944 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:16:46.944 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:16:46.944 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:16:46.944 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:16:46.944 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:16:46.945 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:16:46.945 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:16:46.945 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:16:46.945 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:16:46.945 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:16:46.945 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:16:46.945 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:16:46.945 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:16:46.945 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:16:46.945 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:16:46.945 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:16:46.945 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:16:46.945 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:16:46.946 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:16:46.946 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:16:46.946 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:16:46.946 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:16:46.946 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:16:46.946 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:16:46.946 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:16:46.946 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:46.946 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:16:46.946 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:46.946 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:16:46.946 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:16:46.947 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:16:46.947 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:16:46.947 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:46.947 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:16:46.947 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:16:46.947 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:16:46.947 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:46.947 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:46.947 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:16:46.947 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:16:46.947 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:16:46.947 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:16:46.947 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:16:46.948 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:46.948 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:16:46.948 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:16:46.948 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:16:46.948 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:16:46.948 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:16:46.948 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:46.948 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:46.948 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:16:46.948 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:16:46.948 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:16:46.948 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:16:46.948 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:46.948 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:16:46.949 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:16:46.949 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:16:46.949 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:46.949 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:46.949 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:16:46.949 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:16:46.949 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:16:46.949 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:16:46.949 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:16:46.949 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:46.949 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:16:46.949 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:16:46.949 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:16:46.950 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:16:46.950 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:16:46.950 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:46.950 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:46.950 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:16:46.950 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:16:46.950 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:16:46.950 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:16:46.950 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:46.950 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:16:46.950 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:16:46.950 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:16:46.950 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:46.951 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:46.951 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:16:46.951 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:16:46.951 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:16:46.951 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:16:46.951 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:16:46.951 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:46.951 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:16:46.951 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:16:46.951 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:16:46.951 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:16:46.951 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:16:46.951 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:16:46.951 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:16:46.952 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:46.952 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:16:46.952 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:16:46.952 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:46.952 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:16:46.952 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:16:46.952 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:16:46.952 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:16:46.952 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:16:46.952 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:16:46.952 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:46.952 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:16:46.952 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:16:46.953 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:16:46.953 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:16:46.953 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:16:46.953 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:16:46.953 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:46.953 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:16:46.953 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:16:46.953 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-08-24T21:16:46.953 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:16:46.953 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:16:46.953 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:46.953 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:16:46.953 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:16:46.955 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:16:46.955 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-08-24T21:16:46.955 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-08-24T21:16:47.417 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-08-24T21:16:48.418 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:16:48.418 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:16:48.867 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":52,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:16:48.885 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:16:48.885 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-08-24T21:16:48.885 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:16:48.885 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:16:49.088 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:16:49.089 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:16:49.089 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:16:49.089 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:16:49.089 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 52, 2024-08-24T21:16:49.089 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 31070, 2024-08-24T21:16:49.089 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:16:49.089 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:16:49.089 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:16:49.089 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:16:49.089 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:16:49.089 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 5, 2024-08-24T21:16:49.089 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:16:49.089 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:16:49.090 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:16:49.090 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:16:49.090 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:16:49.090 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:16:49.090 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:16:49.090 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:16:49.090 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:16:49.090 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:16:49.090 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:16:49.090 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:16:49.090 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:16:49.090 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:16:49.090 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:16:49.091 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:16:49.091 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:16:49.091 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:16:49.091 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:16:49.091 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:16:49.091 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:16:49.091 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:16:49.091 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:16:49.091 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:16:49.091 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:16:49.091 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:16:49.091 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:16:49.091 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:16:49.092 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:16:49.092 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:49.092 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:16:49.092 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:16:49.092 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:16:49.092 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:16:49.092 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:16:49.092 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:16:49.092 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:16:49.092 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:16:49.092 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:16:49.092 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:16:49.092 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:16:49.092 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:16:49.093 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:16:49.093 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:16:49.093 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:16:49.093 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:16:49.093 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:16:49.093 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:16:49.093 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:16:49.093 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:16:49.093 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:16:49.093 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:16:49.093 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:16:49.093 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:16:49.093 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:16:49.093 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:16:49.094 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:16:49.094 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:16:49.094 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:16:49.094 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:16:49.094 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:49.094 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:16:49.094 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:49.094 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:16:49.094 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:16:49.094 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:16:49.094 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:16:49.094 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:49.095 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:16:49.095 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:16:49.095 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:16:49.095 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:49.095 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:49.095 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:16:49.095 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:16:49.095 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:16:49.095 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:16:49.095 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:16:49.095 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:49.095 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:16:49.095 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:16:49.096 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:16:49.096 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:16:49.096 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:16:49.096 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:49.096 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:49.096 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:16:49.096 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:16:49.096 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:16:49.096 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:16:49.096 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:49.096 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:16:49.096 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:16:49.096 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:16:49.096 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:49.097 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:49.097 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:16:49.097 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:16:49.097 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:16:49.097 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:16:49.097 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:16:49.097 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:49.097 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:16:49.097 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:16:49.097 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:16:49.097 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:16:49.097 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:16:49.097 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:49.098 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:49.098 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:16:49.098 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:16:49.098 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:16:49.098 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:16:49.098 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:49.098 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:16:49.098 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:16:49.098 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:16:49.098 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:49.098 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:49.098 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:16:49.098 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:16:49.098 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:16:49.099 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:16:49.099 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:16:49.099 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:49.099 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:16:49.099 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:16:49.099 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:16:49.099 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:16:49.099 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:16:49.099 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:16:49.099 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:16:49.099 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:49.099 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:16:49.099 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:16:49.099 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:49.100 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:16:49.100 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:16:49.100 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:16:49.100 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:16:49.100 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:16:49.100 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:16:49.100 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:49.100 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:16:49.100 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:16:49.100 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:16:49.100 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:16:49.100 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:16:49.100 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:49.100 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:16:49.101 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:16:49.109 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:16:49.109 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:16:49.109 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:16:49.287 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:16:49.287 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:16:49.287 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:16:49.287 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:16:49.287 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 52, 2024-08-24T21:16:49.287 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 127755, 2024-08-24T21:16:49.287 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:16:49.287 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:16:49.288 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:16:49.288 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:16:49.288 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:16:49.288 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 5, 2024-08-24T21:16:49.288 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:16:49.288 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:16:49.288 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:16:49.288 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:16:49.288 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:16:49.288 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:16:49.288 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:16:49.288 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:16:49.288 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:16:49.288 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:16:49.289 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:16:49.289 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:16:49.289 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:16:49.289 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:16:49.289 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:16:49.289 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:16:49.289 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:16:49.289 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:16:49.289 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:16:49.289 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:16:49.289 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:16:49.289 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:16:49.289 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:16:49.290 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:16:49.290 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:16:49.290 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:16:49.290 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:16:49.290 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:16:49.290 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:16:49.290 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:49.290 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:16:49.290 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:16:49.290 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:16:49.290 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:16:49.290 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:16:49.290 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:16:49.291 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:16:49.291 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:16:49.291 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:16:49.291 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:16:49.291 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:16:49.291 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:16:49.291 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:16:49.291 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:16:49.291 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:16:49.291 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:16:49.291 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:16:49.291 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:16:49.292 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:16:49.292 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:16:49.292 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:16:49.292 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:16:49.292 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:16:49.292 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:16:49.292 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:16:49.292 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:16:49.292 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:16:49.292 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:16:49.292 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:16:49.292 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:16:49.292 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:49.292 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:16:49.293 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:49.293 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:16:49.293 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:16:49.293 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:16:49.293 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:16:49.293 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:49.293 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:16:49.293 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:16:49.293 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:16:49.293 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:49.293 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:49.293 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:16:49.293 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:16:49.294 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:16:49.294 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:16:49.294 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:16:49.294 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:49.294 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:16:49.294 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:16:49.294 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:16:49.294 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:16:49.294 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:16:49.294 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:49.294 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:49.294 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:16:49.294 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:16:49.295 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:16:49.295 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:16:49.295 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:49.295 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:16:49.295 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:16:49.295 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:16:49.295 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:49.295 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:49.295 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:16:49.295 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:16:49.295 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:16:49.295 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:16:49.295 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:16:49.296 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:49.296 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:16:49.296 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:16:49.296 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:16:49.296 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:16:49.296 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:16:49.296 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:49.296 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:49.296 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:16:49.296 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:16:49.296 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:16:49.296 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:16:49.296 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:49.297 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:16:49.297 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:16:49.297 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:16:49.297 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:49.297 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:49.297 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:16:49.297 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:16:49.297 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:16:49.297 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:16:49.297 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:16:49.297 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:49.297 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:16:49.297 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:16:49.298 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:16:49.298 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:16:49.298 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:16:49.298 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:16:49.298 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:16:49.298 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:49.298 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:16:49.298 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:16:49.298 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:49.298 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:16:49.298 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:16:49.298 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:16:49.298 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:16:49.299 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:16:49.299 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:16:49.299 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:49.299 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:16:49.299 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:16:49.299 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 6 2024-08-24T21:16:49.299 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:16:49.299 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:16:49.299 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:16:49.299 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:49.299 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x2f018fb87aa4aafe", 2024-08-24T21:16:49.299 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "luminous", 2024-08-24T21:16:49.299 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:16:49.300 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:49.300 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:49.300 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:16:49.300 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:16:49.300 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:16:49.300 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:16:49.300 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:16:49.300 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:16:49.300 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:49.300 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:16:49.300 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:16:49.300 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:16:49.300 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:16:49.301 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:16:49.301 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:49.301 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:16:49.301 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:16:49.302 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:16:49.302 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:16:49.302 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:16:49.479 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:16:49.479 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:16:49.480 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:16:49.480 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:16:49.480 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 52, 2024-08-24T21:16:49.480 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 78047, 2024-08-24T21:16:49.480 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:16:49.480 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:16:49.480 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:16:49.480 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:16:49.480 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:16:49.480 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 6, 2024-08-24T21:16:49.480 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:16:49.480 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:16:49.480 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:16:49.481 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:16:49.481 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:16:49.481 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:16:49.481 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:16:49.481 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:16:49.481 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:16:49.481 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:16:49.481 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:16:49.481 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:16:49.481 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:16:49.481 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:16:49.481 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:16:49.481 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:16:49.481 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:16:49.482 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:16:49.482 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:16:49.482 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:16:49.482 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:16:49.482 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:16:49.482 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:16:49.482 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:16:49.482 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:16:49.482 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:16:49.482 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:16:49.482 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:16:49.482 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:16:49.483 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:49.483 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:16:49.483 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:16:49.483 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:16:49.483 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:16:49.483 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:16:49.483 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:16:49.483 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:16:49.483 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:16:49.483 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:16:49.483 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:16:49.483 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:16:49.483 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:16:49.484 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:16:49.484 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:16:49.484 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:16:49.484 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:16:49.484 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:16:49.484 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:16:49.484 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:16:49.484 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:16:49.484 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:16:49.484 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:16:49.484 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:16:49.484 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:16:49.484 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:16:49.485 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:16:49.485 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:16:49.485 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:16:49.485 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:16:49.485 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:16:49.485 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:49.485 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:16:49.485 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:49.485 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:16:49.485 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:16:49.485 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:16:49.486 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:16:49.486 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:49.486 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:16:49.486 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:16:49.486 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:16:49.486 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:49.486 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:49.486 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:16:49.486 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:16:49.486 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:16:49.486 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:16:49.486 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:16:49.486 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:49.486 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:16:49.487 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:16:49.487 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:16:49.487 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:16:49.487 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:16:49.487 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:49.487 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:49.487 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:16:49.487 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:16:49.487 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:16:49.487 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:16:49.487 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:49.487 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:16:49.487 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:16:49.488 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:16:49.488 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:49.488 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:49.488 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:16:49.488 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:16:49.488 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:16:49.488 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:16:49.488 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:16:49.488 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:49.488 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:16:49.488 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:16:49.488 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:16:49.488 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:16:49.488 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:16:49.489 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:49.489 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:49.489 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:16:49.489 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:16:49.489 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:16:49.489 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:16:49.489 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:49.489 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:16:49.489 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:16:49.489 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:16:49.489 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:49.489 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:49.489 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:16:49.489 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:16:49.489 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:16:49.490 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:16:49.490 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:16:49.490 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:49.490 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:16:49.490 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:16:49.490 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:16:49.490 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:16:49.490 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:16:49.490 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:16:49.490 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:16:49.490 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:49.490 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:16:49.490 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:16:49.490 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:49.491 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:16:49.491 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:16:49.491 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:16:49.491 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:16:49.491 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:16:49.491 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:16:49.491 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:49.491 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:16:49.491 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:16:49.491 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:16:49.491 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:16:49.491 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:16:49.491 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:16:49.491 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:16:49.492 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:16:49.492 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:16:49.492 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-08-24T21:16:49.492 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:16:49.492 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:16:49.492 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:16:49.492 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:16:49.492 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:16:49.494 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:16:49.494 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2024-08-24T21:16:49.494 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-08-24T21:16:49.494 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-08-24T21:16:49.494 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-08-24T21:16:49.494 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-08-24T21:16:49.494 INFO:teuthology.orchestra.run:waiting for 300 2024-08-24T21:16:49.514 INFO:tasks.ceph.mon.b:Stopped 2024-08-24T21:16:49.514 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-08-24T21:16:49.515 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:16:49.953 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":52,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":6,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:16:50.588 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap47 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap48 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap48.diff 2024-08-24T21:16:50.817 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 43% complete... Exporting image: 100% complete...done. 2024-08-24T21:16:50.828 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:16:50.828 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=49 2024-08-24T21:16:50.828 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap49 2024-08-24T21:16:52.061 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete...+ tar -C ac6341a6-6d9d-4017-bb38-7eb07f2860fe-mnt -xzf ac6341a6-6d9d-4017-bb38-7eb07f2860fe-mnt/linux-5.4.tar.gz 2024-08-24T21:16:52.973 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:16:53.424 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":52,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":9,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:16:56.443 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:16:56.893 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":52,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:16:59.912 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:17:03.841 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":56,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:17:03.859 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-08-24T21:17:03.859 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-08-24T21:17:03.859 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:17:04.035 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:17:04.035 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:17:04.035 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:17:04.035 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:17:04.035 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 56, 2024-08-24T21:17:04.035 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 46017, 2024-08-24T21:17:04.035 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:17:04.035 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:17:04.035 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:17:04.036 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:17:04.036 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:17:04.036 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:17:04.036 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:17:04.036 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:17:04.036 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:17:04.036 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:17:04.036 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:17:04.036 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:17:04.036 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:17:04.036 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:17:04.037 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:17:04.037 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:17:04.037 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:17:04.037 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:17:04.037 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:17:04.037 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:17:04.037 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:17:04.037 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:17:04.037 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:17:04.037 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:17:04.037 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:17:04.038 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:17:04.038 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:17:04.038 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:17:04.038 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:17:04.038 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:17:04.038 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:17:04.038 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:17:04.038 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:17:04.038 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:17:04.038 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:04.038 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:17:04.039 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:17:04.039 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:17:04.039 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:17:04.039 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:17:04.039 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:17:04.039 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:17:04.039 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:17:04.039 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:17:04.039 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:17:04.039 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:17:04.039 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:17:04.040 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:17:04.040 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:17:04.040 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:17:04.040 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:17:04.040 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:17:04.040 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:17:04.040 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:17:04.040 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:17:04.040 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:17:04.040 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:17:04.040 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:17:04.041 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:17:04.041 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:17:04.041 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:17:04.041 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:17:04.041 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:17:04.041 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:17:04.041 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:17:04.041 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:04.041 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:17:04.041 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:04.041 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:17:04.042 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:17:04.042 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:17:04.042 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:17:04.042 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:04.042 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:17:04.042 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:17:04.042 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:17:04.042 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:04.042 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:04.042 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:17:04.042 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:17:04.043 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:17:04.043 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:04.043 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:17:04.043 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:04.043 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:17:04.043 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:17:04.043 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:17:04.043 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:17:04.043 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:17:04.043 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:04.043 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:04.043 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:17:04.044 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:17:04.044 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:17:04.044 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:17:04.044 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:04.044 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:17:04.044 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:17:04.044 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:17:04.044 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:04.044 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:04.044 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:17:04.044 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:17:04.045 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:17:04.045 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:04.045 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:17:04.045 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:04.045 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:17:04.045 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:17:04.045 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:17:04.045 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:17:04.045 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:17:04.045 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:04.045 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:04.046 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:17:04.046 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:17:04.046 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:17:04.046 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:17:04.046 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:04.046 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:17:04.046 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:17:04.046 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:17:04.046 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:04.046 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:04.046 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:17:04.047 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:17:04.047 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:17:04.047 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:04.047 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:17:04.047 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:04.047 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:17:04.047 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:17:04.047 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:17:04.047 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:17:04.047 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:17:04.047 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:04.048 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:17:04.048 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:04.048 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:17:04.048 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:17:04.048 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:04.048 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:17:04.048 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:17:04.048 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:17:04.048 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:04.048 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:17:04.048 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:17:04.049 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:04.049 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:17:04.049 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:17:04.049 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:17:04.049 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:04.049 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:17:04.049 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:17:04.049 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:04.049 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:17:04.049 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:17:04.049 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-08-24T21:17:04.050 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:04.050 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:17:04.050 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:04.050 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:17:04.050 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:17:04.051 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:17:04.051 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-08-24T21:17:04.051 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:17:04.228 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:17:04.229 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:17:04.229 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:17:04.229 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:17:04.229 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 56, 2024-08-24T21:17:04.229 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 142697, 2024-08-24T21:17:04.229 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:17:04.229 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:17:04.229 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:17:04.229 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:17:04.229 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:17:04.230 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:17:04.230 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:17:04.230 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:17:04.230 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:17:04.230 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:17:04.230 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:17:04.230 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:17:04.230 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:17:04.231 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:17:04.231 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:17:04.231 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:17:04.231 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:17:04.231 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:17:04.231 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:17:04.231 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:17:04.231 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:17:04.231 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:17:04.231 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:17:04.231 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:17:04.232 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:17:04.232 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:17:04.232 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:17:04.232 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:17:04.232 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:17:04.232 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:17:04.232 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:17:04.232 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:17:04.232 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:17:04.232 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:17:04.232 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:04.233 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:17:04.233 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:17:04.233 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:17:04.233 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:17:04.233 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:17:04.233 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:17:04.233 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:17:04.233 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:17:04.233 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:17:04.233 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:17:04.233 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:17:04.234 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:17:04.234 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:17:04.234 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:17:04.234 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:17:04.234 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:17:04.234 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:17:04.234 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:17:04.234 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:17:04.234 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:17:04.234 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:17:04.234 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:17:04.235 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:17:04.235 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:17:04.235 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:17:04.235 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:17:04.235 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:17:04.235 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:17:04.235 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:17:04.235 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:17:04.235 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:04.235 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:17:04.236 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:04.236 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:17:04.236 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:17:04.236 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:17:04.236 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:17:04.236 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:04.236 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:17:04.236 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:17:04.236 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:17:04.236 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:04.236 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:04.237 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:17:04.237 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:17:04.237 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:17:04.237 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:04.237 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:17:04.237 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:04.237 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:17:04.237 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:17:04.237 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:17:04.238 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:17:04.238 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:17:04.238 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:04.238 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:04.238 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:17:04.238 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:17:04.238 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:17:04.238 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:17:04.238 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:04.238 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:17:04.238 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:17:04.239 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:17:04.239 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:04.239 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:04.239 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:17:04.239 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:17:04.239 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:17:04.239 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:04.239 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:17:04.239 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:04.239 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:17:04.239 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:17:04.239 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:17:04.240 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:17:04.240 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:17:04.240 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:04.240 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:04.240 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:17:04.240 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:17:04.240 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:17:04.240 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:17:04.240 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:04.240 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:17:04.240 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:17:04.241 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:17:04.241 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:04.241 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:04.241 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:17:04.241 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:17:04.241 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:17:04.241 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:04.241 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:17:04.241 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:04.241 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:17:04.241 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:17:04.242 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:17:04.242 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:17:04.242 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:17:04.242 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:04.242 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:17:04.242 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:04.242 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:17:04.242 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:17:04.242 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:04.242 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:17:04.242 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:17:04.243 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:17:04.243 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:04.243 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:17:04.243 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:17:04.243 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:04.243 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:17:04.243 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:17:04.243 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 7 2024-08-24T21:17:04.243 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:04.243 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:17:04.243 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:17:04.244 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:04.244 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x2f018fb87aa4aafe", 2024-08-24T21:17:04.244 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "luminous", 2024-08-24T21:17:04.244 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:17:04.244 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:04.244 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:04.244 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:17:04.244 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:17:04.244 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:17:04.244 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:04.244 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:17:04.244 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:17:04.245 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:04.245 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:17:04.245 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:17:04.245 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:17:04.245 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:04.245 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:17:04.245 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:04.245 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:17:04.245 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:17:04.246 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:17:04.247 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-08-24T21:17:04.582 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 100% complete...done. 2024-08-24T21:17:04.609 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 4 2024-08-24T21:17:08.612 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap48 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap49 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap49.diff 2024-08-24T21:17:09.027 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 100% complete...done. 2024-08-24T21:17:09.039 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:17:09.039 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=50 2024-08-24T21:17:09.040 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap50 2024-08-24T21:17:09.597 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:17:09.623 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 3 2024-08-24T21:17:12.626 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap49 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap50 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap50.diff 2024-08-24T21:17:13.644 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 21% complete... Exporting image: 45% complete... Exporting image: 51% complete... Exporting image: 73% complete... Exporting image: 100% complete...done. 2024-08-24T21:17:13.655 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:17:13.655 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=51 2024-08-24T21:17:13.655 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap51 2024-08-24T21:17:24.247 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-08-24T21:17:24.248 INFO:tasks.ceph.mon.b:Restarting daemon 2024-08-24T21:17:24.248 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-08-24T21:17:24.253 INFO:tasks.ceph.mon.b:Started 2024-08-24T21:17:24.253 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:17:24.253 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:17:24.913 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":56,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:17:27.943 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:17:28.719 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":56,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":25,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:17:31.740 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:17:32.423 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":58,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:17:32.443 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:17:32.443 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:17:32.444 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:17:32.713 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:17:32.713 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:17:32.714 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:17:32.714 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:17:32.714 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 58, 2024-08-24T21:17:32.714 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 74697, 2024-08-24T21:17:32.714 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:17:32.714 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:17:32.714 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:17:32.714 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:17:32.714 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:17:32.714 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 2, 2024-08-24T21:17:32.714 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:17:32.714 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:17:32.714 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:17:32.715 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:17:32.715 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:17:32.715 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:17:32.715 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:17:32.715 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:17:32.715 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:17:32.715 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:17:32.715 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:17:32.715 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:17:32.715 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:17:32.715 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:17:32.715 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:17:32.715 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:17:32.716 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:17:32.716 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:17:32.716 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:17:32.716 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:17:32.716 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:17:32.716 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:17:32.716 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:17:32.716 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:17:32.716 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:17:32.716 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:17:32.716 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:17:32.716 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:17:32.716 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:17:32.717 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:32.717 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:17:32.717 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:17:32.717 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:17:32.717 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:17:32.717 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:17:32.717 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:17:32.717 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:17:32.717 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:17:32.717 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:17:32.717 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:17:32.717 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:17:32.717 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:17:32.718 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:17:32.718 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:17:32.718 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:17:32.718 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:17:32.718 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:17:32.718 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:17:32.718 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:17:32.718 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:17:32.718 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:17:32.718 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:17:32.718 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:17:32.718 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:17:32.719 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:17:32.719 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:17:32.719 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:17:32.719 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:17:32.719 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:17:32.719 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:17:32.719 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:32.719 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:17:32.719 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:32.719 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:17:32.719 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:17:32.719 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:17:32.719 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:17:32.720 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:32.720 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:17:32.720 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:17:32.720 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:17:32.720 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:32.720 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:32.720 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:17:32.720 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:17:32.720 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:17:32.720 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:32.720 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:17:32.720 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:32.720 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:17:32.720 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:17:32.721 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:17:32.721 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:17:32.721 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:17:32.721 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:32.721 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:32.721 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:17:32.721 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:17:32.721 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:17:32.721 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:17:32.721 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:32.721 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:17:32.721 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:17:32.721 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:17:32.722 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:32.722 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:32.722 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:17:32.722 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:17:32.722 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:17:32.722 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:32.722 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:17:32.722 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:32.722 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:17:32.722 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:17:32.722 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:17:32.722 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:17:32.722 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:17:32.723 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:32.723 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:32.723 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:17:32.723 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:17:32.723 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:17:32.723 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:17:32.723 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:32.723 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:17:32.723 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:17:32.723 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:17:32.723 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:32.723 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:32.723 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:17:32.724 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:17:32.724 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:17:32.724 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:32.724 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:17:32.724 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:32.724 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:17:32.724 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:17:32.724 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:17:32.724 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:17:32.724 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:17:32.724 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:32.724 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:17:32.724 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:32.724 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:17:32.725 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:17:32.725 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:32.725 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:17:32.725 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:17:32.725 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:17:32.725 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:32.725 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:17:32.725 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:17:32.725 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:32.725 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:17:32.725 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:17:32.725 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:17:32.725 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:32.725 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:17:32.726 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:17:32.726 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:32.726 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:17:32.726 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:17:32.726 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:17:32.726 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:32.726 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:17:32.726 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:32.726 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:17:32.726 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:17:32.732 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:17:32.732 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:17:32.732 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:17:32.915 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:17:32.915 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:17:32.915 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:17:32.916 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:17:32.916 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 58, 2024-08-24T21:17:32.916 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 171385, 2024-08-24T21:17:32.916 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:17:32.916 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:17:32.916 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:17:32.916 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:17:32.916 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:17:32.916 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 2, 2024-08-24T21:17:32.916 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:17:32.916 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:17:32.916 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:17:32.917 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:17:32.917 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:17:32.917 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:17:32.917 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:17:32.917 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:17:32.917 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:17:32.917 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:17:32.917 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:17:32.917 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:17:32.917 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:17:32.917 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:17:32.917 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:17:32.917 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:17:32.917 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:17:32.918 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:17:32.918 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:17:32.918 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:17:32.918 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:17:32.918 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:17:32.918 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:17:32.918 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:17:32.918 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:17:32.918 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:17:32.918 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:17:32.918 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:17:32.918 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:17:32.918 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:32.918 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:17:32.919 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:17:32.919 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:17:32.919 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:17:32.919 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:17:32.919 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:17:32.919 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:17:32.919 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:17:32.919 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:17:32.919 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:17:32.919 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:17:32.919 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:17:32.919 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:17:32.919 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:17:32.919 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:17:32.920 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:17:32.920 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:17:32.920 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:17:32.920 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:17:32.920 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:17:32.920 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:17:32.920 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:17:32.920 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:17:32.920 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:17:32.920 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:17:32.920 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:17:32.920 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:17:32.920 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:17:32.920 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:17:32.921 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:17:32.921 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:32.921 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:17:32.921 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:32.921 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:17:32.921 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:17:32.921 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:17:32.921 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:17:32.921 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:32.921 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:17:32.921 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:17:32.921 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:17:32.921 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:32.922 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:32.922 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:17:32.922 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:17:32.922 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:17:32.922 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:32.922 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:17:32.922 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:32.922 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:17:32.922 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:17:32.922 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:17:32.922 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:17:32.922 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:17:32.922 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:32.923 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:32.923 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:17:32.923 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:17:32.923 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:17:32.923 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:17:32.923 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:32.923 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:17:32.923 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:17:32.923 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:17:32.923 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:32.923 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:32.923 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:17:32.923 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:17:32.923 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:17:32.924 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:32.924 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:17:32.924 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:32.924 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:17:32.924 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:17:32.924 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:17:32.924 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:17:32.924 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:17:32.924 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:32.924 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:32.924 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:17:32.924 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:17:32.924 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:17:32.924 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:17:32.925 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:32.925 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:17:32.925 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:17:32.925 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:17:32.925 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:32.925 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:32.925 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:17:32.925 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:17:32.925 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:17:32.925 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:32.925 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:17:32.925 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:32.925 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:17:32.925 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:17:32.926 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:17:32.926 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:17:32.926 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:17:32.926 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:32.926 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:17:32.926 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:32.926 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:17:32.926 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:17:32.926 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:32.926 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:17:32.926 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:17:32.926 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:17:32.926 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:32.927 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:17:32.927 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:17:32.927 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:32.927 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:17:32.927 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:17:32.927 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 7 2024-08-24T21:17:32.927 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:32.927 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:17:32.927 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:17:32.927 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:32.927 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x2f018fb87aa4aafe", 2024-08-24T21:17:32.927 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "luminous", 2024-08-24T21:17:32.927 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:17:32.927 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:32.927 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:32.928 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:17:32.928 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:17:32.928 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 6 2024-08-24T21:17:32.928 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:32.928 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:17:32.928 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:17:32.928 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:32.928 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:17:32.928 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:17:32.928 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:17:32.928 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:32.928 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:17:32.928 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:32.928 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:17:32.929 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:17:32.930 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:17:32.930 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:17:32.930 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:17:33.107 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:17:33.107 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:17:33.107 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:17:33.107 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:17:33.107 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 58, 2024-08-24T21:17:33.107 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 8700, 2024-08-24T21:17:33.107 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:17:33.107 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:17:33.107 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:17:33.107 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:17:33.107 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:17:33.108 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 3, 2024-08-24T21:17:33.108 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:17:33.108 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:17:33.108 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:17:33.108 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:17:33.108 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:17:33.108 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:17:33.108 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:17:33.108 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:17:33.108 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:17:33.108 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:17:33.108 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:17:33.108 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:17:33.109 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:17:33.109 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:17:33.109 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:17:33.109 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:17:33.109 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:17:33.109 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:17:33.109 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:17:33.109 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:17:33.109 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:17:33.109 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:17:33.109 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:17:33.109 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:17:33.109 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:17:33.109 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:17:33.110 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:17:33.110 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:17:33.110 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:17:33.110 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:33.110 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:17:33.110 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:17:33.110 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:17:33.110 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:17:33.110 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:17:33.110 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:17:33.110 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:17:33.110 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:17:33.110 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:17:33.111 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:17:33.111 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:17:33.111 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:17:33.111 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:17:33.111 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:17:33.111 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:17:33.111 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:17:33.111 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:17:33.111 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:17:33.111 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:17:33.111 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:17:33.111 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:17:33.112 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:17:33.112 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:17:33.112 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:17:33.112 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:17:33.112 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:17:33.112 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:17:33.112 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:17:33.112 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:17:33.112 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:17:33.112 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:33.112 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:17:33.112 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:33.112 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:17:33.112 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:17:33.113 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:17:33.113 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:17:33.113 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:33.113 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:17:33.113 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:17:33.113 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:17:33.113 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:33.113 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:33.113 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:17:33.113 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:17:33.113 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:17:33.113 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:33.114 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:17:33.114 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:33.114 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:17:33.114 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:17:33.114 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:17:33.114 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:17:33.114 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:17:33.114 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:33.114 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:33.114 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:17:33.114 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:17:33.114 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:17:33.115 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:17:33.115 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:33.115 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:17:33.115 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:17:33.115 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:17:33.115 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:33.115 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:33.115 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:17:33.115 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:17:33.115 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:17:33.115 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:33.115 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:17:33.115 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:33.115 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:17:33.116 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:17:33.116 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:17:33.116 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:17:33.116 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:17:33.116 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:33.116 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:33.116 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:17:33.116 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:17:33.116 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:17:33.116 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:17:33.116 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:33.116 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:17:33.116 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:17:33.116 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:17:33.117 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:33.117 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:33.117 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:17:33.117 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:17:33.117 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:17:33.117 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:33.117 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:17:33.117 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:33.117 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:17:33.117 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:17:33.117 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:17:33.117 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:17:33.117 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:17:33.118 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:33.118 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:17:33.118 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:33.118 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:17:33.118 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:17:33.118 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:33.118 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:17:33.118 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:17:33.118 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:17:33.118 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:33.118 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:17:33.118 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:17:33.118 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:33.119 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:17:33.119 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:17:33.119 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:17:33.119 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:33.119 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:17:33.119 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:33.119 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:17:33.119 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:17:33.122 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:17:33.122 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-08-24T21:17:33.122 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-08-24T21:17:33.583 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-08-24T21:17:33.684 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:17:33.708 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 2 2024-08-24T21:17:34.004 INFO:tasks.workunit.client.0.smithi179.stderr:+ sync ac6341a6-6d9d-4017-bb38-7eb07f2860fe-mnt 2024-08-24T21:17:34.579 INFO:tasks.workunit.client.0.smithi179.stderr:+ rm -rf ac6341a6-6d9d-4017-bb38-7eb07f2860fe-mnt/linux-5.4 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-mnt/linux-5.4.tar.gz 2024-08-24T21:17:34.584 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:17:34.585 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:17:35.030 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":58,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:17:35.047 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:17:35.047 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-08-24T21:17:35.047 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:17:35.048 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:17:35.223 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:17:35.223 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:17:35.223 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:17:35.223 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:17:35.224 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 58, 2024-08-24T21:17:35.224 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 77207, 2024-08-24T21:17:35.224 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:17:35.224 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:17:35.224 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:17:35.224 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:17:35.224 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:17:35.224 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 5, 2024-08-24T21:17:35.224 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:17:35.224 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:17:35.224 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:17:35.224 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:17:35.224 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:17:35.225 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:17:35.225 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:17:35.225 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:17:35.225 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:17:35.225 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:17:35.225 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:17:35.225 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:17:35.225 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:17:35.225 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:17:35.225 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:17:35.225 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:17:35.225 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:17:35.225 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:17:35.226 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:17:35.226 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:17:35.226 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:17:35.226 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:17:35.226 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:17:35.226 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:17:35.226 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:17:35.226 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:17:35.226 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:17:35.226 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:17:35.226 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:17:35.226 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:35.227 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:17:35.227 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:17:35.227 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:17:35.227 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:17:35.227 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:17:35.227 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:17:35.227 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:17:35.227 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:17:35.227 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:17:35.227 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:17:35.227 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:17:35.227 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:17:35.227 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:17:35.228 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:17:35.228 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:17:35.228 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:17:35.228 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:17:35.228 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:17:35.228 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:17:35.228 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:17:35.228 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:17:35.228 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:17:35.228 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:17:35.228 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:17:35.228 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:17:35.228 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:17:35.229 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:17:35.229 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:17:35.229 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:17:35.229 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:17:35.229 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:35.229 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:17:35.229 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:35.229 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:17:35.229 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:17:35.229 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:17:35.229 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:17:35.229 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:35.229 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:17:35.230 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:17:35.230 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:17:35.230 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:35.230 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:35.230 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:17:35.230 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:17:35.230 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:17:35.230 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:35.230 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:17:35.230 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:35.230 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:17:35.230 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:17:35.230 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:17:35.231 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:17:35.231 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:17:35.231 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:35.231 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:35.231 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:17:35.231 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:17:35.231 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:17:35.231 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:17:35.231 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:35.231 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:17:35.231 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:17:35.231 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:17:35.231 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:35.232 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:35.232 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:17:35.232 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:17:35.232 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:17:35.232 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:35.232 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:17:35.232 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:35.232 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:17:35.232 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:17:35.232 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:17:35.232 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:17:35.232 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:17:35.232 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:35.233 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:35.233 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:17:35.233 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:17:35.233 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:17:35.233 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:17:35.233 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:35.233 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:17:35.233 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:17:35.233 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:17:35.233 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:35.233 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:35.233 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:17:35.233 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:17:35.233 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:17:35.234 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:35.234 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:17:35.234 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:35.234 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:17:35.234 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:17:35.234 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:17:35.234 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:17:35.234 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:17:35.234 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:35.234 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:17:35.234 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:35.234 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:17:35.234 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:17:35.235 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:35.235 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:17:35.235 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:17:35.235 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:17:35.235 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:35.235 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:17:35.235 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:17:35.235 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:35.235 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:17:35.235 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:17:35.235 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:17:35.235 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:35.235 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:17:35.236 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:17:35.236 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:35.236 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:17:35.236 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:17:35.236 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:17:35.236 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:35.236 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:17:35.236 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:35.236 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:17:35.236 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:17:35.238 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:17:35.238 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:17:35.239 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:17:35.414 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:17:35.414 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:17:35.414 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:17:35.414 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:17:35.414 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 58, 2024-08-24T21:17:35.414 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 173883, 2024-08-24T21:17:35.415 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:17:35.415 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:17:35.415 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:17:35.415 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:17:35.415 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:17:35.415 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 5, 2024-08-24T21:17:35.415 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:17:35.415 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:17:35.415 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:17:35.415 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:17:35.415 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:17:35.415 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:17:35.416 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:17:35.416 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:17:35.416 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:17:35.416 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:17:35.416 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:17:35.416 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:17:35.416 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:17:35.416 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:17:35.416 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:17:35.416 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:17:35.416 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:17:35.416 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:17:35.417 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:17:35.417 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:17:35.417 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:17:35.417 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:17:35.417 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:17:35.417 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:17:35.417 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:17:35.417 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:17:35.417 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:17:35.417 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:17:35.417 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:17:35.417 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:35.417 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:17:35.418 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:17:35.418 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:17:35.418 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:17:35.418 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:17:35.418 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:17:35.418 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:17:35.418 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:17:35.418 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:17:35.418 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:17:35.418 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:17:35.418 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:17:35.418 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:17:35.419 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:17:35.419 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:17:35.419 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:17:35.419 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:17:35.419 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:17:35.419 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:17:35.419 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:17:35.419 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:17:35.419 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:17:35.419 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:17:35.419 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:17:35.419 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:17:35.420 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:17:35.420 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:17:35.420 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:17:35.420 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:17:35.420 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:17:35.420 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:35.420 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:17:35.420 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:35.420 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:17:35.420 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:17:35.420 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:17:35.420 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:17:35.420 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:35.421 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:17:35.421 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:17:35.421 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:17:35.421 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:35.421 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:35.421 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:17:35.421 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:17:35.421 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:17:35.421 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:35.421 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:17:35.421 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:35.422 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:17:35.422 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:17:35.422 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:17:35.422 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:17:35.422 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:17:35.422 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:35.422 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:35.422 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:17:35.422 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:17:35.422 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:17:35.422 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:17:35.422 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:35.423 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:17:35.423 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:17:35.423 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:17:35.423 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:35.423 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:35.423 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:17:35.423 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:17:35.423 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:17:35.423 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:35.423 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:17:35.423 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:35.423 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:17:35.424 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:17:35.424 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:17:35.424 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:17:35.424 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:17:35.424 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:35.424 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:35.424 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:17:35.424 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:17:35.424 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:17:35.424 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:17:35.424 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:35.424 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:17:35.424 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:17:35.425 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:17:35.425 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:35.425 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:35.425 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:17:35.425 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:17:35.425 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:17:35.425 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:35.425 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:17:35.425 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:35.425 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:17:35.425 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:17:35.425 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:17:35.425 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:17:35.425 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:17:35.426 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:35.426 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:17:35.426 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:35.426 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:17:35.426 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:17:35.426 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:35.426 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:17:35.426 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:17:35.426 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:17:35.426 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:35.426 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:17:35.426 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:17:35.426 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:35.427 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:17:35.427 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:17:35.427 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 7 2024-08-24T21:17:35.427 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:35.427 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:17:35.427 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:17:35.427 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:35.427 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x2f018fb87aa4aafe", 2024-08-24T21:17:35.427 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "luminous", 2024-08-24T21:17:35.427 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:17:35.427 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:35.427 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:35.427 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:17:35.428 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:17:35.428 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-08-24T21:17:35.428 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:35.428 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:17:35.428 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:17:35.428 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:35.428 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:17:35.428 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:17:35.428 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:17:35.428 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:35.428 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:17:35.428 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:35.428 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:17:35.429 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:17:35.430 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:17:35.430 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:17:35.430 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:17:35.607 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:17:35.607 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:17:35.607 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:17:35.607 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:17:35.607 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 58, 2024-08-24T21:17:35.607 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 11200, 2024-08-24T21:17:35.608 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:17:35.608 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:17:35.608 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:17:35.608 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:17:35.608 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:17:35.608 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 5, 2024-08-24T21:17:35.608 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:17:35.608 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:17:35.608 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:17:35.608 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:17:35.608 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:17:35.608 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:17:35.609 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:17:35.609 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:17:35.609 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:17:35.609 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:17:35.609 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:17:35.609 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:17:35.609 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:17:35.609 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:17:35.609 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:17:35.609 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:17:35.609 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:17:35.609 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:17:35.609 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:17:35.610 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:17:35.610 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:17:35.610 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:17:35.610 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:17:35.610 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:17:35.610 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:17:35.610 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:17:35.610 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:17:35.610 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:17:35.610 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:17:35.610 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:35.611 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:17:35.611 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:17:35.611 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:17:35.611 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:17:35.611 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:17:35.611 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:17:35.611 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:17:35.611 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:17:35.611 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:17:35.611 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:17:35.611 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:17:35.612 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:17:35.612 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:17:35.612 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:17:35.612 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:17:35.612 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:17:35.612 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:17:35.612 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:17:35.612 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:17:35.612 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:17:35.612 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:17:35.612 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:17:35.612 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:17:35.612 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:17:35.613 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:17:35.613 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:17:35.613 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:17:35.613 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:17:35.613 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:17:35.613 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:17:35.613 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:35.613 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:17:35.613 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:35.613 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:17:35.613 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:17:35.613 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:17:35.613 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:17:35.614 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:35.614 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:17:35.614 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:17:35.614 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:17:35.614 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:35.614 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:35.614 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:17:35.614 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:17:35.614 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:17:35.614 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:35.614 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:17:35.614 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:35.615 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:17:35.615 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:17:35.615 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:17:35.615 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:17:35.615 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:17:35.615 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:35.615 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:35.615 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:17:35.615 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:17:35.615 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:17:35.615 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:17:35.615 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:35.615 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:17:35.616 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:17:35.616 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:17:35.616 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:35.616 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:35.616 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:17:35.616 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:17:35.616 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:17:35.616 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:35.616 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:17:35.616 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:35.616 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:17:35.616 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:17:35.617 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:17:35.617 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:17:35.617 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:17:35.617 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:35.617 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:35.617 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:17:35.617 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:17:35.617 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:17:35.617 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:17:35.617 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:35.617 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:17:35.617 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:17:35.617 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:17:35.618 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:35.618 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:35.618 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:17:35.618 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:17:35.618 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:17:35.618 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:35.618 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:17:35.618 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:35.618 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:17:35.618 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:17:35.618 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:17:35.618 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:17:35.618 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:17:35.619 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:35.619 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:17:35.619 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:35.619 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:17:35.619 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:17:35.619 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:35.619 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:17:35.619 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:17:35.619 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:17:35.619 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:35.619 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:17:35.619 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:17:35.620 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:35.620 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:17:35.620 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:17:35.620 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:17:35.620 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:35.620 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:17:35.620 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:35.620 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:17:35.620 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:17:35.621 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:17:35.622 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-08-24T21:17:35.622 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-08-24T21:17:35.622 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-08-24T21:17:35.622 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-08-24T21:17:35.622 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-08-24T21:17:35.622 INFO:teuthology.orchestra.run:waiting for 300 2024-08-24T21:17:35.639 INFO:tasks.ceph.mon.a:Stopped 2024-08-24T21:17:35.639 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-08-24T21:17:35.639 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:17:35.711 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap50 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap51 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap51.diff 2024-08-24T21:17:36.141 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":58,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":6,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:17:38.315 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete...+ (( i++ )) 2024-08-24T21:17:38.316 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i < 10 )) 2024-08-24T21:17:38.316 INFO:tasks.workunit.client.0.smithi179.stderr:+ pv -L 10M linux-5.4.tar.gz 2024-08-24T21:17:38.608 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 76% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 100% complete...done. 2024-08-24T21:17:38.674 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:17:38.674 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=52 2024-08-24T21:17:38.675 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap52 2024-08-24T21:17:39.160 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:17:39.607 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":58,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":9,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:17:42.627 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:17:43.075 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":58,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:17:46.095 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:17:49.768 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:17:49.798 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 4 2024-08-24T21:17:50.004 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":60,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:17:50.023 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-08-24T21:17:50.023 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-08-24T21:17:50.024 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:17:50.201 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:17:50.201 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:17:50.202 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:17:50.202 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:17:50.202 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 60, 2024-08-24T21:17:50.202 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 188671, 2024-08-24T21:17:50.202 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:17:50.202 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:17:50.202 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:17:50.202 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:17:50.202 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:17:50.202 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:17:50.202 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:17:50.203 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:17:50.203 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:17:50.203 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:17:50.203 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:17:50.203 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:17:50.203 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:17:50.203 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:17:50.203 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:17:50.203 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:17:50.203 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:17:50.203 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:17:50.204 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:17:50.204 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:17:50.204 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:17:50.204 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:17:50.204 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:17:50.204 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:17:50.204 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:17:50.204 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:17:50.204 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:17:50.204 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:17:50.204 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:17:50.204 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:17:50.205 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:17:50.205 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:17:50.205 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:17:50.205 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:17:50.205 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:50.205 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:17:50.205 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:17:50.205 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:17:50.205 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:17:50.205 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:17:50.205 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:17:50.205 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:17:50.205 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:17:50.206 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:17:50.206 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:17:50.206 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:17:50.206 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:17:50.206 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:17:50.206 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:17:50.206 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:17:50.206 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:17:50.206 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:17:50.206 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:17:50.206 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:17:50.206 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:17:50.207 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:17:50.207 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:17:50.207 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:17:50.207 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:17:50.207 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:17:50.207 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:17:50.207 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:17:50.207 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:17:50.207 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:17:50.207 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:17:50.207 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:50.208 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:17:50.208 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:50.208 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:17:50.208 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:17:50.208 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:17:50.208 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:17:50.208 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:50.208 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:17:50.208 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:17:50.208 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:17:50.208 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:50.208 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:50.208 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:17:50.209 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:17:50.209 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:17:50.209 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:50.209 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:17:50.209 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:50.209 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:17:50.209 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:17:50.209 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:17:50.209 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:17:50.209 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:17:50.209 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:50.209 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:50.210 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:17:50.210 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:17:50.210 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:17:50.210 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:17:50.210 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:50.210 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:17:50.210 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:17:50.210 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:17:50.210 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:50.210 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:50.210 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:17:50.210 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:17:50.211 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:17:50.211 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:50.211 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:17:50.211 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:50.211 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:17:50.211 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:17:50.211 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:17:50.211 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:17:50.211 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:17:50.211 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:50.212 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:50.212 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:17:50.212 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:17:50.212 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:17:50.212 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:17:50.212 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:50.214 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:17:50.214 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:17:50.214 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:17:50.214 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:50.214 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:50.214 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:17:50.214 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:17:50.214 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:17:50.214 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:50.214 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:17:50.214 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:50.215 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:17:50.215 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:17:50.215 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:17:50.215 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:17:50.215 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:17:50.215 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:50.215 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:17:50.215 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:50.215 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:17:50.215 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:17:50.215 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:50.216 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:17:50.216 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:17:50.216 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:17:50.216 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:50.216 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:17:50.216 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:17:50.216 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:50.216 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:17:50.216 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:17:50.216 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 7 2024-08-24T21:17:50.216 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:50.217 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:17:50.217 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:17:50.217 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:50.217 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x2f018fb87aa4aafe", 2024-08-24T21:17:50.217 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "luminous", 2024-08-24T21:17:50.217 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:17:50.217 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:50.217 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:50.217 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:17:50.217 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:17:50.217 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:17:50.218 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:50.218 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:17:50.218 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:17:50.218 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:50.218 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:17:50.218 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:17:50.218 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:17:50.218 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:50.218 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:17:50.218 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:50.218 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:17:50.219 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:17:50.220 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:17:50.220 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-08-24T21:17:50.220 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:17:50.397 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:17:50.397 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:17:50.397 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:17:50.397 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:17:50.397 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 60, 2024-08-24T21:17:50.397 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 25990, 2024-08-24T21:17:50.397 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:17:50.397 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:17:50.398 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:17:50.398 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:17:50.398 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:17:50.398 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:17:50.398 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:17:50.398 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:17:50.398 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:17:50.398 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:17:50.398 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:17:50.398 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:17:50.398 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:17:50.398 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:17:50.399 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:17:50.399 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:17:50.399 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:17:50.399 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:17:50.399 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:17:50.399 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:17:50.399 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:17:50.399 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:17:50.399 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:17:50.399 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:17:50.399 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:17:50.399 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:17:50.400 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:17:50.400 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:17:50.400 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:17:50.400 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:17:50.400 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:17:50.400 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:17:50.400 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:17:50.400 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:17:50.400 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:50.400 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:17:50.400 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:17:50.400 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:17:50.401 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:17:50.401 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:17:50.401 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:17:50.401 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:17:50.401 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:17:50.401 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:17:50.401 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:17:50.401 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:17:50.401 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:17:50.401 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:17:50.401 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:17:50.401 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:17:50.401 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:17:50.402 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:17:50.402 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:17:50.402 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:17:50.402 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:17:50.402 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:17:50.402 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:17:50.402 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:17:50.402 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:17:50.402 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:17:50.402 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:17:50.402 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:17:50.402 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:17:50.402 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:17:50.402 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:17:50.403 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:50.403 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:17:50.403 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:50.403 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:17:50.403 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:17:50.403 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:17:50.403 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:17:50.403 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:50.403 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:17:50.403 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:17:50.403 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:17:50.403 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:50.403 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:50.404 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:17:50.404 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:17:50.404 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:17:50.404 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:50.404 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:17:50.404 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:50.404 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:17:50.404 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:17:50.404 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:17:50.404 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:17:50.404 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:17:50.404 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:50.404 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:50.404 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:17:50.405 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:17:50.405 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:17:50.405 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:17:50.405 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:50.405 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:17:50.405 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:17:50.405 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:17:50.405 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:50.405 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:50.405 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:17:50.405 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:17:50.405 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:17:50.406 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:50.406 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:17:50.406 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:50.406 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:17:50.406 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:17:50.406 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:17:50.406 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:17:50.406 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:17:50.406 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:50.406 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:50.406 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:17:50.406 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:17:50.406 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:17:50.407 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:17:50.407 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:50.407 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:17:50.407 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:17:50.407 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:17:50.407 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:50.407 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:50.407 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:17:50.407 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:17:50.407 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:17:50.407 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:50.407 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:17:50.407 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:50.408 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:17:50.408 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:17:50.408 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:17:50.408 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:17:50.408 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:17:50.408 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:50.408 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:17:50.408 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:50.408 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:17:50.408 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:17:50.408 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:50.408 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:17:50.408 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:17:50.408 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:17:50.409 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:50.409 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:17:50.409 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:17:50.409 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:50.409 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:17:50.409 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:17:50.409 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:17:50.409 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:50.409 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:17:50.409 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:17:50.409 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:17:50.409 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:17:50.409 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:17:50.409 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:17:50.410 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:17:50.410 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:17:50.410 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:17:50.410 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:17:50.410 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:17:50.411 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:17:50.412 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-08-24T21:17:53.800 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap51 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap52 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap52.diff 2024-08-24T21:17:54.204 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 100% complete...done. 2024-08-24T21:17:54.216 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:17:54.216 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=53 2024-08-24T21:17:54.216 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap53 2024-08-24T21:17:54.783 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:17:54.804 INFO:tasks.workunit.client.0.smithi179.stderr:+ tar -C ac6341a6-6d9d-4017-bb38-7eb07f2860fe-mnt -xzf ac6341a6-6d9d-4017-bb38-7eb07f2860fe-mnt/linux-5.4.tar.gz 2024-08-24T21:17:54.806 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 2 2024-08-24T21:17:56.808 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap52 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap53 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap53.diff 2024-08-24T21:17:57.019 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 100% complete...done. 2024-08-24T21:17:57.028 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:17:57.029 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=54 2024-08-24T21:17:57.029 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap54 2024-08-24T21:17:57.796 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:17:57.818 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 2 2024-08-24T21:17:59.821 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap53 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap54 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap54.diff 2024-08-24T21:17:59.999 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 51% complete... Exporting image: 100% complete...done. 2024-08-24T21:18:00.008 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:18:00.008 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=55 2024-08-24T21:18:00.008 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap55 2024-08-24T21:18:00.815 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:18:00.842 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 4 2024-08-24T21:18:04.845 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap54 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap55 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap55.diff 2024-08-24T21:18:05.664 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 100% complete...done. 2024-08-24T21:18:05.678 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:18:05.678 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=56 2024-08-24T21:18:05.678 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap56 2024-08-24T21:18:10.413 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-08-24T21:18:10.413 INFO:tasks.ceph.mon.a:Restarting daemon 2024-08-24T21:18:10.413 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-08-24T21:18:10.419 INFO:tasks.ceph.mon.a:Started 2024-08-24T21:18:10.419 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:18:10.419 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:18:11.106 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":60,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":21,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:18:13.834 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:18:13.863 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 3 2024-08-24T21:18:14.146 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:18:14.814 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":60,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":25,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:18:16.866 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap55 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap56 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap56.diff 2024-08-24T21:18:17.839 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:18:18.753 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":60,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":29,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:18:20.893 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 14% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 100% complete...done. 2024-08-24T21:18:20.937 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:18:20.937 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=57 2024-08-24T21:18:20.937 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap57 2024-08-24T21:18:21.796 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:18:22.553 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":60,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":32,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:18:25.577 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:18:33.396 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:18:33.422 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 1 2024-08-24T21:18:33.634 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":66,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:18:34.425 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap56 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap57 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap57.diff 2024-08-24T21:18:34.806 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 18% complete...+ sync ac6341a6-6d9d-4017-bb38-7eb07f2860fe-mnt 2024-08-24T21:18:34.865 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 20% complete...+ rm -rf ac6341a6-6d9d-4017-bb38-7eb07f2860fe-mnt/linux-5.4 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-mnt/linux-5.4.tar.gz 2024-08-24T21:18:36.653 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:18:36.681 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 39% complete... Exporting image: 42% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 100% complete...done. 2024-08-24T21:18:36.745 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:18:36.745 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=58 2024-08-24T21:18:36.745 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap58 2024-08-24T21:18:37.104 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":68,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:18:37.122 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:18:37.122 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:18:37.122 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:18:37.184 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:18:37.206 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 2 2024-08-24T21:18:37.307 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:18:37.307 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:18:37.307 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:18:37.307 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:18:37.307 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 68, 2024-08-24T21:18:37.307 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 26658, 2024-08-24T21:18:37.307 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:18:37.307 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:18:37.308 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:18:37.308 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:18:37.308 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:18:37.308 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 1, 2024-08-24T21:18:37.308 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:18:37.308 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:18:37.308 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:18:37.308 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:18:37.308 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:18:37.308 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:18:37.308 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:18:37.308 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:18:37.308 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:18:37.309 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:18:37.309 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:18:37.309 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:18:37.309 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:18:37.309 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:18:37.309 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:18:37.309 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:18:37.309 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:18:37.309 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:18:37.309 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:18:37.309 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:18:37.309 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:18:37.310 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:18:37.310 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:18:37.310 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:18:37.310 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:18:37.310 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:18:37.310 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:18:37.310 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:18:37.310 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:18:37.310 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:37.310 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:18:37.310 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:18:37.310 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:18:37.311 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:18:37.311 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:18:37.311 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:18:37.311 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:18:37.311 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:18:37.311 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:18:37.311 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:18:37.311 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:18:37.311 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:18:37.311 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:18:37.311 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:18:37.312 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:18:37.312 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:18:37.312 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:18:37.312 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:18:37.312 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:18:37.312 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:18:37.312 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:18:37.312 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:18:37.312 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:18:37.312 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:18:37.312 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:18:37.312 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:18:37.313 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:18:37.313 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:18:37.313 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:18:37.313 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:18:37.313 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:37.313 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:18:37.313 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:37.313 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:18:37.313 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:18:37.313 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:18:37.313 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:18:37.313 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:37.314 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:18:37.314 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:18:37.314 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:18:37.314 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:37.314 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:37.314 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:18:37.314 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:18:37.314 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:18:37.314 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:18:37.314 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:18:37.314 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:37.314 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:18:37.314 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:18:37.315 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:18:37.315 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:18:37.315 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:18:37.315 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:37.315 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:37.315 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:18:37.315 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:18:37.315 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:18:37.315 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:18:37.315 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:37.315 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:18:37.315 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:18:37.315 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:18:37.315 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:37.316 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:37.316 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:18:37.316 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:18:37.316 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:18:37.316 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:18:37.316 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:18:37.316 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:37.316 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:18:37.316 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:18:37.316 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:18:37.316 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:18:37.316 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:18:37.316 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:37.317 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:37.317 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:18:37.317 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:18:37.317 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:18:37.317 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:18:37.317 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:37.317 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:18:37.317 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:18:37.317 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:18:37.317 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:37.317 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:37.317 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:18:37.317 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:18:37.317 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:18:37.318 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:18:37.318 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:18:37.318 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:37.318 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:18:37.318 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:18:37.318 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:18:37.318 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:18:37.318 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:18:37.318 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:18:37.318 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:18:37.318 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:37.318 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:18:37.319 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:18:37.319 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:37.319 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:18:37.319 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:18:37.319 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:18:37.319 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:18:37.319 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:18:37.319 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:18:37.319 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:37.319 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:18:37.319 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:18:37.319 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:18:37.319 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:18:37.320 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:18:37.320 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:37.320 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:18:37.320 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:18:37.321 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:18:37.321 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:18:37.322 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:18:37.497 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:18:37.497 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:18:37.497 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:18:37.498 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:18:37.498 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 68, 2024-08-24T21:18:37.498 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 235966, 2024-08-24T21:18:37.498 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:18:37.498 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:18:37.498 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:18:37.498 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:18:37.498 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:18:37.498 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 1, 2024-08-24T21:18:37.498 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:18:37.498 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:18:37.498 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:18:37.499 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:18:37.499 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:18:37.499 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:18:37.499 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:18:37.499 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:18:37.499 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:18:37.499 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:18:37.499 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:18:37.499 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:18:37.499 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:18:37.499 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:18:37.499 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:18:37.500 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:18:37.500 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:18:37.500 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:18:37.500 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:18:37.500 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:18:37.500 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:18:37.500 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:18:37.500 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:18:37.500 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:18:37.500 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:18:37.500 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:18:37.500 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:18:37.501 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:18:37.501 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:18:37.501 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:37.501 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:18:37.501 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:18:37.501 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:18:37.501 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:18:37.501 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:18:37.501 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:18:37.501 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:18:37.501 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:18:37.501 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:18:37.502 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:18:37.502 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:18:37.502 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:18:37.502 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:18:37.502 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:18:37.502 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:18:37.502 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:18:37.502 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:18:37.502 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:18:37.502 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:18:37.503 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:18:37.503 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:18:37.503 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:18:37.503 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:18:37.503 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:18:37.503 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:18:37.503 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:18:37.503 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:18:37.503 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:18:37.503 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:18:37.504 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:18:37.504 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:37.504 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:18:37.504 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:37.504 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:18:37.504 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:18:37.504 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:18:37.504 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:18:37.504 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:37.504 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:18:37.504 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:18:37.504 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:18:37.505 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:37.505 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:37.505 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:18:37.505 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:18:37.505 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:18:37.505 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:18:37.505 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:18:37.505 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:37.505 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:18:37.505 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:18:37.505 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:18:37.505 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:18:37.505 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:18:37.506 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:37.506 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:37.506 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:18:37.506 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:18:37.506 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:18:37.506 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:18:37.506 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:37.506 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:18:37.506 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:18:37.506 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:18:37.506 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:37.506 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:37.506 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:18:37.507 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:18:37.507 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:18:37.507 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:18:37.507 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:18:37.507 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:37.507 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:18:37.507 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:18:37.507 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:18:37.507 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:18:37.507 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:18:37.507 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:37.507 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:37.507 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:18:37.508 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:18:37.508 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:18:37.508 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:18:37.508 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:37.508 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:18:37.508 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:18:37.508 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:18:37.508 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:37.508 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:37.508 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:18:37.508 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:18:37.508 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:18:37.508 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:18:37.509 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:18:37.509 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:37.509 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:18:37.509 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:18:37.509 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:18:37.509 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:18:37.509 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:18:37.509 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:18:37.509 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:18:37.510 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:37.510 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:18:37.510 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:18:37.510 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:37.510 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:18:37.510 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:18:37.510 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:18:37.510 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:18:37.510 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:18:37.510 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:18:37.510 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:37.510 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:18:37.511 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:18:37.511 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 7 2024-08-24T21:18:37.511 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:18:37.511 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:18:37.511 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:18:37.511 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:37.511 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x2f018fb87aa4aafe", 2024-08-24T21:18:37.511 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "luminous", 2024-08-24T21:18:37.511 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:18:37.511 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:37.511 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:37.511 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:18:37.511 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:18:37.512 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-08-24T21:18:37.512 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:18:37.512 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:18:37.512 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:18:37.512 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:37.512 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:18:37.512 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:18:37.512 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:18:37.512 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:18:37.512 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:18:37.512 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:37.512 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:18:37.512 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:18:37.514 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:18:37.514 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:18:37.514 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:18:37.690 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:18:37.691 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:18:37.691 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:18:37.691 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:18:37.691 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 68, 2024-08-24T21:18:37.691 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 73284, 2024-08-24T21:18:37.691 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:18:37.691 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:18:37.691 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:18:37.691 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:18:37.691 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:18:37.692 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 1, 2024-08-24T21:18:37.692 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:18:37.692 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:18:37.692 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:18:37.692 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:18:37.692 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:18:37.692 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:18:37.692 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:18:37.692 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:18:37.692 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:18:37.692 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:18:37.692 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:18:37.693 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:18:37.693 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:18:37.693 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:18:37.693 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:18:37.693 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:18:37.693 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:18:37.693 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:18:37.693 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:18:37.693 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:18:37.693 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:18:37.693 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:18:37.693 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:18:37.693 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:18:37.693 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:18:37.694 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:18:37.694 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:18:37.694 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:18:37.694 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:18:37.694 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:37.694 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:18:37.694 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:18:37.694 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:18:37.694 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:18:37.694 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:18:37.694 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:18:37.694 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:18:37.694 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:18:37.695 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:18:37.695 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:18:37.695 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:18:37.695 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:18:37.695 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:18:37.695 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:18:37.695 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:18:37.695 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:18:37.695 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:18:37.695 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:18:37.695 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:18:37.695 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:18:37.695 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:18:37.696 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:18:37.696 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:18:37.696 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:18:37.696 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:18:37.696 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:18:37.697 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:18:37.697 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:18:37.697 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:18:37.697 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:18:37.697 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:37.697 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:18:37.697 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:37.697 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:18:37.697 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:18:37.697 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:18:37.697 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:18:37.697 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:37.697 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:18:37.698 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:18:37.698 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:18:37.698 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:37.698 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:37.698 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:18:37.698 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:18:37.698 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:18:37.698 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:18:37.698 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:18:37.698 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:37.698 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:18:37.698 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:18:37.698 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:18:37.699 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:18:37.699 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:18:37.699 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:37.699 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:37.699 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:18:37.699 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:18:37.699 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:18:37.699 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:18:37.699 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:37.699 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:18:37.699 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:18:37.699 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:18:37.699 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:37.700 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:37.700 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:18:37.700 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:18:37.700 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:18:37.700 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:18:37.700 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:18:37.700 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:37.700 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:18:37.700 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:18:37.700 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:18:37.700 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:18:37.700 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:18:37.700 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:37.701 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:37.701 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:18:37.701 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:18:37.701 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:18:37.701 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:18:37.701 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:37.701 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:18:37.701 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:18:37.701 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:18:37.701 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:37.701 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:37.701 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:18:37.701 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:18:37.701 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:18:37.702 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:18:37.702 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:18:37.702 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:37.702 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:18:37.702 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:18:37.702 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:18:37.702 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:18:37.702 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:18:37.702 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:18:37.702 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:18:37.702 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:37.702 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:18:37.702 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:18:37.703 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:37.703 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:18:37.703 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:18:37.703 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:18:37.703 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:18:37.703 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:18:37.703 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:18:37.703 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:37.703 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:18:37.703 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:18:37.703 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:18:37.703 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:18:37.703 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:18:37.703 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:18:37.704 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:37.704 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:18:37.704 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:18:37.704 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:18:37.704 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:18:37.704 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:18:37.704 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:37.704 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:18:37.704 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:18:37.705 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:18:37.705 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-08-24T21:18:37.706 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-08-24T21:18:38.165 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-08-24T21:18:38.443 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:18:38.444 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i < 10 )) 2024-08-24T21:18:38.444 INFO:tasks.workunit.client.0.smithi179.stderr:+ pv -L 10M linux-5.4.tar.gz 2024-08-24T21:18:39.166 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:18:39.166 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:18:39.209 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap57 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap58 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap58.diff 2024-08-24T21:18:39.460 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 100% complete...done. 2024-08-24T21:18:39.473 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:18:39.473 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=59 2024-08-24T21:18:39.473 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap59 2024-08-24T21:18:39.640 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":68,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:18:39.657 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:18:39.657 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-08-24T21:18:39.657 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:18:39.658 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:18:39.833 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:18:39.834 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:18:39.834 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:18:39.834 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:18:39.834 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 68, 2024-08-24T21:18:39.834 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 29185, 2024-08-24T21:18:39.834 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:18:39.834 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:18:39.834 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:18:39.834 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:18:39.834 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:18:39.834 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 3, 2024-08-24T21:18:39.834 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:18:39.835 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:18:39.835 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:18:39.835 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:18:39.835 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:18:39.835 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:18:39.835 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:18:39.835 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:18:39.835 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:18:39.835 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:18:39.835 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:18:39.835 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:18:39.835 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:18:39.836 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:18:39.836 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:18:39.836 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:18:39.836 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:18:39.836 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:18:39.836 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:18:39.836 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:18:39.836 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:18:39.836 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:18:39.836 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:18:39.836 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:18:39.836 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:18:39.836 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:18:39.837 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:18:39.837 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:18:39.837 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:18:39.837 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:39.837 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:18:39.837 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:18:39.837 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:18:39.837 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:18:39.837 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:18:39.837 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:18:39.837 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:18:39.837 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:18:39.837 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:18:39.837 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:18:39.838 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:18:39.838 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:18:39.838 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:18:39.838 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:18:39.838 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:18:39.838 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:18:39.838 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:18:39.838 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:18:39.838 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:18:39.838 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:18:39.838 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:18:39.838 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:18:39.839 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:18:39.839 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:18:39.839 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:18:39.839 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:18:39.839 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:18:39.839 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:18:39.839 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:18:39.839 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:18:39.839 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:39.839 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:18:39.839 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:39.839 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:18:39.839 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:18:39.840 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:18:39.840 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:18:39.840 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:39.840 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:18:39.840 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:18:39.840 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:18:39.840 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:39.840 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:39.840 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:18:39.840 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:18:39.840 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:18:39.840 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:18:39.840 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:18:39.840 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:39.841 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:18:39.841 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:18:39.841 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:18:39.841 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:18:39.841 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:18:39.841 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:39.841 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:39.841 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:18:39.841 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:18:39.841 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:18:39.841 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:18:39.841 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:39.841 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:18:39.842 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:18:39.842 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:18:39.842 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:39.842 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:39.842 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:18:39.842 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:18:39.842 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:18:39.842 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:18:39.842 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:18:39.842 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:39.842 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:18:39.842 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:18:39.842 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:18:39.843 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:18:39.843 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:18:39.843 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:39.843 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:39.843 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:18:39.843 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:18:39.843 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:18:39.843 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:18:39.843 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:39.843 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:18:39.843 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:18:39.843 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:18:39.843 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:39.844 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:39.844 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:18:39.844 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:18:39.844 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:18:39.844 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:18:39.844 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:18:39.844 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:39.844 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:18:39.844 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:18:39.844 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:18:39.844 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:18:39.844 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:18:39.844 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:18:39.844 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:18:39.845 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:39.845 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:18:39.845 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:18:39.845 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:39.845 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:18:39.845 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:18:39.845 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:18:39.845 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:18:39.845 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:18:39.845 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:18:39.845 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:39.845 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:18:39.845 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:18:39.845 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:18:39.846 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:18:39.846 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:18:39.846 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:39.846 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:18:39.846 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:18:39.848 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:18:39.848 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:18:39.848 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:18:40.024 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:18:40.024 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:18:40.024 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:18:40.024 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:18:40.025 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 68, 2024-08-24T21:18:40.025 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 238493, 2024-08-24T21:18:40.025 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:18:40.025 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:18:40.025 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:18:40.025 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:18:40.025 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:18:40.025 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 3, 2024-08-24T21:18:40.025 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:18:40.025 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:18:40.025 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:18:40.025 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:18:40.025 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:18:40.026 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:18:40.026 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:18:40.026 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:18:40.026 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:18:40.026 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:18:40.026 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:18:40.026 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:18:40.026 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:18:40.026 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:18:40.026 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:18:40.026 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:18:40.026 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:18:40.026 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:18:40.027 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:18:40.027 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:18:40.027 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:18:40.027 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:18:40.027 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:18:40.027 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:18:40.027 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:18:40.027 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:18:40.027 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:18:40.027 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:18:40.027 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:18:40.027 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:40.027 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:18:40.028 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:18:40.028 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:18:40.028 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:18:40.028 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:18:40.028 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:18:40.028 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:18:40.028 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:18:40.028 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:18:40.028 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:18:40.028 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:18:40.028 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:18:40.028 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:18:40.029 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:18:40.029 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:18:40.029 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:18:40.029 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:18:40.029 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:18:40.029 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:18:40.029 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:18:40.029 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:18:40.029 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:18:40.029 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:18:40.029 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:18:40.029 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:18:40.029 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:18:40.030 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:18:40.030 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:18:40.030 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:18:40.030 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:18:40.030 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:40.030 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:18:40.030 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:40.030 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:18:40.030 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:18:40.030 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:18:40.030 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:18:40.030 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:40.030 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:18:40.031 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:18:40.031 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:18:40.031 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:40.031 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:40.031 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:18:40.031 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:18:40.031 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:18:40.031 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:18:40.031 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:18:40.031 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:40.031 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:18:40.031 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:18:40.031 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:18:40.032 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:18:40.032 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:18:40.032 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:40.032 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:40.032 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:18:40.032 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:18:40.032 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:18:40.032 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:18:40.032 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:40.032 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:18:40.032 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:18:40.032 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:18:40.032 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:40.032 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:40.033 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:18:40.033 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:18:40.033 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:18:40.033 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:18:40.033 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:18:40.033 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:40.033 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:18:40.033 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:18:40.033 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:18:40.033 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:18:40.033 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:18:40.033 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:40.033 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:40.034 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:18:40.034 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:18:40.034 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:18:40.034 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:18:40.034 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:40.034 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:18:40.034 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:18:40.034 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:18:40.034 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:40.034 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:40.034 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:18:40.034 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:18:40.034 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:18:40.035 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:18:40.035 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:18:40.035 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:40.035 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:18:40.035 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:18:40.035 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:18:40.035 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:18:40.035 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:18:40.035 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:18:40.035 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:18:40.035 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:40.035 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:18:40.035 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:18:40.036 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:40.036 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:18:40.036 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:18:40.036 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:18:40.036 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:18:40.036 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:18:40.036 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:18:40.036 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:40.036 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:18:40.036 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:18:40.036 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 7 2024-08-24T21:18:40.036 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:18:40.036 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:18:40.036 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:18:40.037 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:40.037 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x2f018fb87aa4aafe", 2024-08-24T21:18:40.037 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "luminous", 2024-08-24T21:18:40.037 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:18:40.037 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:40.037 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:40.037 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:18:40.037 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:18:40.037 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:18:40.037 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:18:40.037 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:18:40.037 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:18:40.037 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:40.037 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:18:40.038 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:18:40.038 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:18:40.038 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:18:40.038 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:18:40.038 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:40.038 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:18:40.038 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:18:40.039 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:18:40.039 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:18:40.039 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:18:40.204 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:18:40.227 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:18:40.227 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:18:40.227 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:18:40.227 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:18:40.227 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 68, 2024-08-24T21:18:40.227 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 75820, 2024-08-24T21:18:40.227 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:18:40.227 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:18:40.227 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:18:40.227 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:18:40.227 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:18:40.228 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 4, 2024-08-24T21:18:40.228 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:18:40.228 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:18:40.228 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:18:40.228 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:18:40.228 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:18:40.228 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:18:40.228 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:18:40.228 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:18:40.228 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:18:40.228 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:18:40.228 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:18:40.228 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:18:40.228 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:18:40.229 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:18:40.229 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:18:40.229 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:18:40.229 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:18:40.229 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:18:40.229 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:18:40.229 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:18:40.229 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:18:40.229 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:18:40.229 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:18:40.229 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:18:40.229 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:18:40.229 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:18:40.229 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:18:40.230 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:18:40.230 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:18:40.230 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:40.230 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:18:40.230 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:18:40.230 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:18:40.230 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:18:40.230 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:18:40.230 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:18:40.230 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:18:40.230 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:18:40.230 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:18:40.231 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:18:40.231 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:18:40.231 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:18:40.231 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:18:40.231 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:18:40.231 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:18:40.231 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:18:40.231 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:18:40.231 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:18:40.231 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:18:40.231 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:18:40.231 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:18:40.232 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:18:40.232 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:18:40.232 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:18:40.232 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:18:40.232 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:18:40.232 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:18:40.232 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:18:40.232 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:18:40.232 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:18:40.232 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:40.232 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:18:40.232 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:40.232 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:18:40.233 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:18:40.233 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:18:40.233 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:18:40.233 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:40.233 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:18:40.233 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:18:40.233 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:18:40.233 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:40.233 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:40.233 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:18:40.233 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:18:40.233 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:18:40.233 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:18:40.233 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:18:40.234 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:40.234 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:18:40.234 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:18:40.234 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:18:40.234 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:18:40.234 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:18:40.234 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:40.234 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:40.234 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:18:40.234 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:18:40.234 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:18:40.234 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:18:40.234 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:40.235 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:18:40.235 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:18:40.235 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:18:40.235 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:40.235 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:40.235 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:18:40.235 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:18:40.235 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:18:40.235 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:18:40.235 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:18:40.235 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:40.235 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:18:40.235 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:18:40.236 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:18:40.236 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:18:40.236 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:18:40.236 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:40.236 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:40.236 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:18:40.236 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:18:40.236 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:18:40.236 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:18:40.236 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:40.236 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:18:40.236 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:18:40.236 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:18:40.236 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:40.237 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:40.237 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:18:40.237 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:18:40.237 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:18:40.237 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:18:40.237 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:18:40.237 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:40.237 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:18:40.237 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:18:40.237 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:18:40.237 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:18:40.237 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:18:40.237 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:18:40.238 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:18:40.238 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:40.238 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:18:40.238 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:18:40.238 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:40.238 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:18:40.238 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:18:40.238 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:18:40.238 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:18:40.238 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:18:40.238 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:18:40.238 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:40.238 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:18:40.239 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:18:40.239 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:18:40.239 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:18:40.239 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:18:40.239 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:18:40.239 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:40.239 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:18:40.239 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:18:40.239 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:18:40.239 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:18:40.239 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:18:40.239 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:40.239 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:18:40.240 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:18:40.240 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 4 2024-08-24T21:18:40.241 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:18:40.242 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-08-24T21:18:40.242 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-08-24T21:18:40.242 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-08-24T21:18:40.242 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-08-24T21:18:40.242 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-08-24T21:18:40.242 INFO:teuthology.orchestra.run:waiting for 300 2024-08-24T21:18:40.263 INFO:tasks.ceph.mon.a:Stopped 2024-08-24T21:18:40.263 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-08-24T21:18:40.263 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:18:40.741 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":68,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:18:43.761 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:18:44.210 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":68,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":8,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:18:44.236 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap58 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap59 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap59.diff 2024-08-24T21:18:44.319 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 100% complete...done. 2024-08-24T21:18:44.326 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:18:44.326 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=60 2024-08-24T21:18:44.326 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap60 2024-08-24T21:18:47.230 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:18:47.677 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":68,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:18:50.696 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:18:55.278 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:18:55.307 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 4 2024-08-24T21:18:55.554 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":72,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:18:55.573 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-08-24T21:18:55.573 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-08-24T21:18:55.573 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:18:55.625 INFO:tasks.workunit.client.0.smithi179.stderr:+ tar -C ac6341a6-6d9d-4017-bb38-7eb07f2860fe-mnt -xzf ac6341a6-6d9d-4017-bb38-7eb07f2860fe-mnt/linux-5.4.tar.gz 2024-08-24T21:18:55.747 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:18:55.747 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:18:55.748 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:18:55.748 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:18:55.748 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 72, 2024-08-24T21:18:55.748 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 254216, 2024-08-24T21:18:55.748 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:18:55.748 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:18:55.748 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:18:55.748 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:18:55.748 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:18:55.748 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:18:55.748 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:18:55.748 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:18:55.749 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:18:55.749 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:18:55.749 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:18:55.749 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:18:55.749 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:18:55.749 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:18:55.749 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:18:55.749 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:18:55.749 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:18:55.749 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:18:55.749 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:18:55.749 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:18:55.749 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:18:55.750 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:18:55.750 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:18:55.750 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:18:55.750 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:18:55.750 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:18:55.750 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:18:55.750 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:18:55.750 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:18:55.750 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:18:55.750 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:18:55.750 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:18:55.750 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:18:55.750 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:18:55.751 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:55.751 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:18:55.751 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:18:55.751 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:18:55.751 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:18:55.751 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:18:55.751 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:18:55.751 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:18:55.751 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:18:55.751 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:18:55.751 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:18:55.751 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:18:55.751 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:18:55.752 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:18:55.752 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:18:55.752 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:18:55.752 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:18:55.752 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:18:55.752 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:18:55.752 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:18:55.752 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:18:55.752 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:18:55.752 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:18:55.752 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:18:55.752 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:18:55.752 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:18:55.753 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:18:55.753 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:18:55.753 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:18:55.753 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:18:55.753 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:18:55.753 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:55.753 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:18:55.753 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:55.753 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:18:55.753 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:18:55.753 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:18:55.753 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:18:55.754 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:55.754 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:18:55.754 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:18:55.754 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:18:55.754 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:55.754 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:55.754 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:18:55.754 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:18:55.754 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:18:55.754 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:18:55.754 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:18:55.754 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:55.754 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:18:55.755 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:18:55.755 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:18:55.755 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:18:55.755 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:18:55.755 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:55.755 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:55.755 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:18:55.755 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:18:55.755 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:18:55.755 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:18:55.755 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:55.755 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:18:55.755 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:18:55.756 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:18:55.756 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:55.756 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:55.756 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:18:55.756 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:18:55.756 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:18:55.756 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:18:55.756 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:18:55.756 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:55.756 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:18:55.756 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:18:55.756 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:18:55.756 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:18:55.757 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:18:55.757 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:55.757 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:55.757 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:18:55.757 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:18:55.757 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:18:55.757 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:18:55.757 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:55.757 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:18:55.757 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:18:55.757 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:18:55.757 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:55.757 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:55.757 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:18:55.757 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:18:55.758 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:18:55.758 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:18:55.758 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:18:55.758 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:55.758 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:18:55.758 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:18:55.758 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:18:55.758 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:18:55.758 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:18:55.758 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:18:55.758 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:18:55.758 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:55.758 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:18:55.759 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:18:55.759 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:55.759 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:18:55.759 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:18:55.759 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:18:55.759 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:18:55.759 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:18:55.759 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:18:55.759 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:55.759 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:18:55.759 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:18:55.759 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 7 2024-08-24T21:18:55.759 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:18:55.759 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:18:55.760 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:18:55.760 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:55.760 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x2f018fb87aa4aafe", 2024-08-24T21:18:55.760 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "luminous", 2024-08-24T21:18:55.760 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:18:55.760 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:55.760 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:55.760 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:18:55.760 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:18:55.760 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:18:55.760 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:18:55.760 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:18:55.760 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:18:55.760 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:55.761 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:18:55.761 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:18:55.761 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:18:55.761 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:18:55.761 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:18:55.761 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:55.761 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:18:55.761 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:18:55.762 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:18:55.763 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-08-24T21:18:55.763 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:18:55.937 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:18:55.937 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:18:55.937 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:18:55.937 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:18:55.938 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 72, 2024-08-24T21:18:55.938 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 91531, 2024-08-24T21:18:55.938 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:18:55.938 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:18:55.938 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:18:55.938 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:18:55.938 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:18:55.938 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:18:55.938 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:18:55.938 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:18:55.938 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:18:55.938 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:18:55.938 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:18:55.939 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:18:55.939 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:18:55.939 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:18:55.939 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:18:55.939 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:18:55.939 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:18:55.939 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:18:55.939 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:18:55.939 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:18:55.939 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:18:55.939 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:18:55.939 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:18:55.940 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:18:55.940 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:18:55.940 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:18:55.940 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:18:55.940 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:18:55.940 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:18:55.940 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:18:55.940 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:18:55.940 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:18:55.940 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:18:55.940 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:18:55.940 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:55.940 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:18:55.941 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:18:55.941 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:18:55.941 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:18:55.941 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:18:55.941 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:18:55.941 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:18:55.941 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:18:55.941 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:18:55.941 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:18:55.941 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:18:55.941 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:18:55.941 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:18:55.941 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:18:55.941 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:18:55.942 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:18:55.942 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:18:55.942 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:18:55.942 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:18:55.942 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:18:55.942 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:18:55.942 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:18:55.942 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:18:55.942 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:18:55.942 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:18:55.942 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:18:55.942 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:18:55.942 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:18:55.943 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:18:55.943 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:18:55.943 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:55.943 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:18:55.943 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:55.943 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:18:55.943 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:18:55.943 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:18:55.943 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:18:55.943 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:55.943 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:18:55.943 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:18:55.943 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:18:55.944 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:55.944 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:55.944 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:18:55.944 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:18:55.944 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:18:55.944 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:18:55.944 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:18:55.944 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:55.944 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:18:55.944 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:18:55.944 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:18:55.944 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:18:55.944 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:18:55.945 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:55.945 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:55.945 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:18:55.945 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:18:55.945 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:18:55.945 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:18:55.945 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:55.945 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:18:55.945 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:18:55.945 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:18:55.945 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:55.945 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:55.945 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:18:55.946 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:18:55.946 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:18:55.946 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:18:55.946 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:18:55.946 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:55.946 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:18:55.946 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:18:55.946 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:18:55.946 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:18:55.946 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:18:55.946 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:55.946 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:55.946 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:18:55.947 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:18:55.947 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:18:55.947 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:18:55.947 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:55.947 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:18:55.947 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:18:55.947 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:18:55.947 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:55.947 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:55.947 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:18:55.947 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:18:55.947 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:18:55.947 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:18:55.948 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:18:55.948 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:55.948 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:18:55.948 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:18:55.948 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:18:55.948 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:18:55.948 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:18:55.948 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:18:55.948 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:18:55.948 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:55.948 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:18:55.948 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:18:55.948 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:55.948 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:18:55.949 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:18:55.949 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:18:55.949 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:18:55.949 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:18:55.949 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:18:55.949 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:55.949 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:18:55.949 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:18:55.949 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:18:55.949 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:18:55.949 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:18:55.949 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:18:55.949 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:18:55.949 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:18:55.949 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:18:55.950 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:18:55.950 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:18:55.950 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:18:55.950 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:18:55.950 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:18:55.950 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:18:55.952 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:18:55.952 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-08-24T21:18:59.310 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap59 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap60 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap60.diff 2024-08-24T21:18:59.490 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 51% complete... Exporting image: 100% complete...done. 2024-08-24T21:18:59.501 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:18:59.501 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=61 2024-08-24T21:18:59.501 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap61 2024-08-24T21:19:00.288 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:19:00.309 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 2 2024-08-24T21:19:02.194 INFO:tasks.workunit.client.0.smithi179.stderr:+ sync ac6341a6-6d9d-4017-bb38-7eb07f2860fe-mnt 2024-08-24T21:19:02.287 INFO:tasks.workunit.client.0.smithi179.stderr:+ rm -rf ac6341a6-6d9d-4017-bb38-7eb07f2860fe-mnt/linux-5.4 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-mnt/linux-5.4.tar.gz 2024-08-24T21:19:02.311 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap60 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap61 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap61.diff 2024-08-24T21:19:02.758 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 87% complete... Exporting image: 100% complete...done. 2024-08-24T21:19:02.774 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:19:02.774 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=62 2024-08-24T21:19:02.774 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap62 2024-08-24T21:19:03.305 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:19:03.325 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 1 2024-08-24T21:19:04.328 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap61 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap62 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap62.diff 2024-08-24T21:19:05.160 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 50% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 100% complete...done. 2024-08-24T21:19:05.197 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:19:05.197 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=63 2024-08-24T21:19:05.197 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap63 2024-08-24T21:19:05.294 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete...+ (( i++ )) 2024-08-24T21:19:05.294 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i < 10 )) 2024-08-24T21:19:05.294 INFO:tasks.workunit.client.0.smithi179.stderr:+ pv -L 10M linux-5.4.tar.gz 2024-08-24T21:19:06.322 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 100% complete...done. 2024-08-24T21:19:06.345 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 2 2024-08-24T21:19:08.348 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap62 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap63 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap63.diff 2024-08-24T21:19:08.438 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 100% complete...done. 2024-08-24T21:19:08.444 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:19:08.444 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=64 2024-08-24T21:19:08.444 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap64 2024-08-24T21:19:09.333 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:19:09.358 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 1 2024-08-24T21:19:10.360 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap63 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap64 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap64.diff 2024-08-24T21:19:10.681 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 100% complete...done. 2024-08-24T21:19:10.693 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:19:10.693 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=65 2024-08-24T21:19:10.693 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap65 2024-08-24T21:19:11.348 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:19:11.370 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 1 2024-08-24T21:19:12.373 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap64 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap65 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap65.diff 2024-08-24T21:19:12.460 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 100% complete...done. 2024-08-24T21:19:12.467 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:19:12.467 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=66 2024-08-24T21:19:12.467 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap66 2024-08-24T21:19:13.350 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:19:13.374 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 3 2024-08-24T21:19:15.953 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-08-24T21:19:15.953 INFO:tasks.ceph.mon.a:Restarting daemon 2024-08-24T21:19:15.953 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-08-24T21:19:15.958 INFO:tasks.ceph.mon.a:Started 2024-08-24T21:19:15.958 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:19:15.958 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:19:16.377 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap65 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap66 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap66.diff 2024-08-24T21:19:16.406 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":72,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":21,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:19:16.471 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 100% complete...done. 2024-08-24T21:19:16.478 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:19:16.478 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=67 2024-08-24T21:19:16.478 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap67 2024-08-24T21:19:17.372 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:19:17.401 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 3 2024-08-24T21:19:19.425 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:19:19.872 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":72,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":24,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:19:20.403 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap66 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap67 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap67.diff 2024-08-24T21:19:20.488 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 100% complete...done. 2024-08-24T21:19:20.495 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:19:20.495 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=68 2024-08-24T21:19:20.495 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap68 2024-08-24T21:19:21.374 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:19:21.395 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 4 2024-08-24T21:19:21.741 INFO:tasks.workunit.client.0.smithi179.stderr:+ tar -C ac6341a6-6d9d-4017-bb38-7eb07f2860fe-mnt -xzf ac6341a6-6d9d-4017-bb38-7eb07f2860fe-mnt/linux-5.4.tar.gz 2024-08-24T21:19:22.891 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:19:23.425 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":72,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":28,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:19:25.398 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap67 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap68 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap68.diff 2024-08-24T21:19:25.507 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 100% complete...done. 2024-08-24T21:19:25.517 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:19:25.517 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=69 2024-08-24T21:19:25.517 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap69 2024-08-24T21:19:26.386 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:19:26.410 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 2 2024-08-24T21:19:26.449 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:19:26.942 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":72,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":31,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:19:28.411 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap68 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap69 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap69.diff 2024-08-24T21:19:29.775 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 35% complete... Exporting image: 51% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 100% complete...done. 2024-08-24T21:19:29.789 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:19:29.789 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=70 2024-08-24T21:19:29.789 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap70 2024-08-24T21:19:29.972 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:19:30.623 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":76,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:19:30.654 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:19:30.654 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:19:30.654 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:19:30.879 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:19:30.879 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:19:30.879 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:19:30.879 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:19:30.879 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 76, 2024-08-24T21:19:30.879 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 14772, 2024-08-24T21:19:30.879 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:19:30.880 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:19:30.880 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:19:30.880 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:19:30.880 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:19:30.880 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 2, 2024-08-24T21:19:30.880 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:19:30.880 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:19:30.880 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:19:30.880 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:19:30.880 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:19:30.880 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:19:30.880 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:19:30.880 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:19:30.881 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:19:30.881 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:19:30.881 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:19:30.881 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:19:30.881 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:19:30.881 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:19:30.881 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:19:30.881 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:19:30.881 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:19:30.881 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:19:30.881 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:19:30.882 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:19:30.882 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:19:30.882 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:19:30.882 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:19:30.882 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:19:30.882 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:19:30.882 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:19:30.882 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:19:30.882 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:19:30.882 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:19:30.882 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:30.882 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:19:30.883 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:19:30.883 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:19:30.883 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:19:30.883 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:19:30.883 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:19:30.883 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:19:30.883 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:19:30.883 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:19:30.883 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:19:30.883 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:19:30.883 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:19:30.884 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:19:30.884 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:19:30.884 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:19:30.884 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:19:30.884 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:19:30.884 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:19:30.884 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:19:30.884 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:19:30.884 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:19:30.884 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:19:30.884 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:19:30.884 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:19:30.884 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:19:30.884 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:19:30.885 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:19:30.885 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:19:30.885 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:19:30.885 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:19:30.885 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:30.885 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:19:30.885 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:30.885 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:19:30.885 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:19:30.885 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:19:30.885 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:19:30.886 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:30.886 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:19:30.886 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:19:30.886 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:19:30.886 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:30.886 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:30.886 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:19:30.886 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:19:30.886 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:19:30.886 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:19:30.886 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:19:30.887 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:30.887 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:19:30.887 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:19:30.887 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:19:30.887 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:19:30.887 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:19:30.887 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:30.887 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:30.887 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:19:30.887 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:19:30.887 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:19:30.887 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:19:30.887 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:30.888 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:19:30.888 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:19:30.888 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:19:30.888 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:30.888 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:30.888 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:19:30.888 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:19:30.888 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:19:30.888 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:19:30.888 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:19:30.888 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:30.888 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:19:30.889 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:19:30.889 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:19:30.889 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:19:30.889 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:19:30.889 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:30.889 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:30.889 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:19:30.889 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:19:30.889 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:19:30.889 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:19:30.889 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:30.889 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:19:30.889 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:19:30.890 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:19:30.890 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:30.890 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:30.890 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:19:30.890 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:19:30.890 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:19:30.890 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:19:30.890 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:19:30.890 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:30.890 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:19:30.890 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:19:30.890 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:19:30.890 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:19:30.891 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:19:30.891 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:19:30.891 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:19:30.891 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:30.891 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:19:30.891 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:19:30.891 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:30.891 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:19:30.891 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:19:30.891 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:19:30.891 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:19:30.891 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:19:30.891 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:19:30.892 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:30.892 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:19:30.892 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:19:30.892 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:19:30.892 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:19:30.892 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:19:30.892 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:30.892 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:19:30.892 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:19:30.894 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:19:30.894 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:19:30.895 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:19:31.125 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:19:31.125 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:19:31.125 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:19:31.125 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:19:31.125 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 76, 2024-08-24T21:19:31.126 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 289594, 2024-08-24T21:19:31.126 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:19:31.126 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:19:31.126 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:19:31.126 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:19:31.126 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:19:31.126 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 2, 2024-08-24T21:19:31.126 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:19:31.126 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:19:31.126 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:19:31.126 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:19:31.126 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:19:31.126 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:19:31.126 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:19:31.127 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:19:31.127 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:19:31.127 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:19:31.127 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:19:31.127 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:19:31.127 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:19:31.127 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:19:31.127 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:19:31.127 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:19:31.127 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:19:31.127 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:19:31.127 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:19:31.127 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:19:31.128 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:19:31.128 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:19:31.128 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:19:31.128 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:19:31.128 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:19:31.128 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:19:31.128 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:19:31.128 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:19:31.128 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:19:31.128 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:31.128 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:19:31.129 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:19:31.129 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:19:31.129 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:19:31.129 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:19:31.129 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:19:31.129 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:19:31.129 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:19:31.129 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:19:31.129 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:19:31.129 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:19:31.129 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:19:31.130 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:19:31.130 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:19:31.130 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:19:31.130 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:19:31.130 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:19:31.130 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:19:31.130 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:19:31.130 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:19:31.130 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:19:31.130 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:19:31.130 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:19:31.131 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:19:31.131 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:19:31.131 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:19:31.131 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:19:31.131 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:19:31.131 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:19:31.131 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:19:31.131 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:31.131 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:19:31.131 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:31.131 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:19:31.132 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:19:31.132 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:19:31.132 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:19:31.132 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:31.132 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:19:31.132 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:19:31.132 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:19:31.132 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:31.132 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:31.132 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:19:31.132 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:19:31.132 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:19:31.133 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:19:31.133 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:19:31.133 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:31.133 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:19:31.133 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:19:31.133 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:19:31.133 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:19:31.133 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:19:31.133 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:31.133 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:31.133 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:19:31.133 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:19:31.134 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:19:31.134 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:19:31.134 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:31.134 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:19:31.134 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:19:31.134 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:19:31.134 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:31.134 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:31.134 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:19:31.134 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:19:31.134 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:19:31.134 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:19:31.135 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:19:31.135 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:31.135 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:19:31.135 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:19:31.135 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:19:31.135 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:19:31.135 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:19:31.135 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:31.135 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:31.135 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:19:31.135 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:19:31.135 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:19:31.136 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:19:31.136 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:31.136 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:19:31.136 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:19:31.136 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:19:31.136 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:31.136 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:31.136 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:19:31.136 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:19:31.136 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:19:31.136 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:19:31.137 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:19:31.137 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:31.137 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:19:31.137 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:19:31.137 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:19:31.137 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:19:31.137 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:19:31.137 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:19:31.137 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:19:31.137 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:31.137 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:19:31.137 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:19:31.138 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:31.138 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:19:31.138 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:19:31.138 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:19:31.138 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:19:31.138 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:19:31.138 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:19:31.138 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:31.138 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:19:31.138 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:19:31.138 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 7 2024-08-24T21:19:31.138 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:19:31.138 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:19:31.139 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:19:31.139 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:31.139 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x2f018fb87aa4aafe", 2024-08-24T21:19:31.139 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "luminous", 2024-08-24T21:19:31.139 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:19:31.139 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:31.139 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:31.139 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:19:31.139 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:19:31.139 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:19:31.139 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:19:31.139 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:19:31.139 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:19:31.140 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:31.140 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:19:31.140 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:19:31.140 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:19:31.140 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:19:31.140 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:19:31.140 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:31.140 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:19:31.140 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:19:31.142 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:19:31.142 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:19:31.143 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:19:31.398 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:19:31.399 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:19:31.399 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:19:31.399 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:19:31.399 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 76, 2024-08-24T21:19:31.399 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 126992, 2024-08-24T21:19:31.399 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:19:31.399 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:19:31.399 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:19:31.399 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:19:31.399 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:19:31.400 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 2, 2024-08-24T21:19:31.400 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:19:31.400 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:19:31.400 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:19:31.400 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:19:31.400 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:19:31.400 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:19:31.400 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:19:31.400 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:19:31.400 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:19:31.400 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:19:31.400 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:19:31.401 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:19:31.401 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:19:31.401 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:19:31.401 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:19:31.401 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:19:31.401 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:19:31.401 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:19:31.401 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:19:31.401 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:19:31.401 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:19:31.401 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:19:31.401 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:19:31.401 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:19:31.402 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:19:31.402 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:19:31.402 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:19:31.402 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:19:31.402 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:19:31.402 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:31.402 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:19:31.402 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:19:31.402 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:19:31.402 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:19:31.402 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:19:31.402 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:19:31.403 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:19:31.403 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:19:31.403 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:19:31.403 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:19:31.403 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:19:31.403 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:19:31.403 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:19:31.403 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:19:31.403 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:19:31.404 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:19:31.404 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:19:31.404 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:19:31.404 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:19:31.404 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:19:31.404 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:19:31.404 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:19:31.404 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:19:31.404 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:19:31.404 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:19:31.404 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:19:31.404 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:19:31.405 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:19:31.405 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:19:31.405 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:19:31.405 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:31.405 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:19:31.405 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:31.405 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:19:31.405 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:19:31.405 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:19:31.405 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:19:31.406 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:31.406 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:19:31.406 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:19:31.406 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:19:31.406 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:31.406 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:31.406 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:19:31.406 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:19:31.406 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:19:31.406 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:19:31.406 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:19:31.407 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:31.407 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:19:31.407 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:19:31.407 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:19:31.407 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:19:31.407 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:19:31.407 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:31.407 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:31.407 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:19:31.407 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:19:31.407 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:19:31.407 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:19:31.408 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:31.408 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:19:31.408 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:19:31.408 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:19:31.408 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:31.408 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:31.408 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:19:31.408 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:19:31.408 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:19:31.408 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:19:31.408 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:19:31.408 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:31.408 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:19:31.409 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:19:31.409 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:19:31.409 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:19:31.409 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:19:31.409 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:31.409 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:31.409 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:19:31.409 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:19:31.409 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:19:31.409 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:19:31.409 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:31.409 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:19:31.410 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:19:31.410 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:19:31.410 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:31.410 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:31.410 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:19:31.410 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:19:31.410 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:19:31.410 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:19:31.410 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:19:31.410 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:31.410 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:19:31.410 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:19:31.410 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:19:31.411 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:19:31.411 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:19:31.411 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:19:31.411 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:19:31.411 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:31.411 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:19:31.411 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:19:31.411 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:31.411 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:19:31.411 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:19:31.411 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:19:31.411 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:19:31.411 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:19:31.412 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:19:31.412 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:31.412 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:19:31.412 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:19:31.412 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:19:31.412 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:19:31.412 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:19:31.412 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:19:31.412 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:31.412 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:19:31.412 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:19:31.412 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:19:31.412 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:19:31.413 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:19:31.413 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:31.413 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:19:31.413 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:19:31.414 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:19:31.414 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-08-24T21:19:31.415 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-08-24T21:19:31.792 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:19:31.817 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 4 2024-08-24T21:19:31.956 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-08-24T21:19:32.956 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:19:32.957 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:19:33.775 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":76,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:19:33.806 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:19:33.806 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-08-24T21:19:33.806 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:19:33.806 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:19:34.110 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:19:34.110 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:19:34.110 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:19:34.110 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:19:34.110 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 76, 2024-08-24T21:19:34.110 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 18002, 2024-08-24T21:19:34.110 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:19:34.110 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:19:34.110 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:19:34.111 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:19:34.111 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:19:34.111 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 5, 2024-08-24T21:19:34.111 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:19:34.111 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:19:34.111 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:19:34.111 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:19:34.111 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:19:34.111 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:19:34.111 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:19:34.111 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:19:34.111 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:19:34.112 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:19:34.112 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:19:34.112 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:19:34.112 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:19:34.112 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:19:34.112 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:19:34.112 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:19:34.112 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:19:34.112 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:19:34.112 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:19:34.112 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:19:34.112 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:19:34.113 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:19:34.113 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:19:34.113 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:19:34.113 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:19:34.113 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:19:34.113 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:19:34.113 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:19:34.113 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:19:34.113 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:34.114 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:19:34.114 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:19:34.114 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:19:34.114 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:19:34.114 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:19:34.114 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:19:34.114 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:19:34.114 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:19:34.114 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:19:34.114 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:19:34.114 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:19:34.114 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:19:34.115 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:19:34.115 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:19:34.115 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:19:34.115 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:19:34.115 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:19:34.115 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:19:34.115 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:19:34.115 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:19:34.115 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:19:34.115 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:19:34.116 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:19:34.116 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:19:34.116 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:19:34.116 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:19:34.116 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:19:34.116 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:19:34.116 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:19:34.116 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:19:34.116 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:34.116 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:19:34.117 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:34.117 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:19:34.117 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:19:34.117 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:19:34.117 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:19:34.117 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:34.117 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:19:34.117 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:19:34.118 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:19:34.118 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:34.118 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:34.118 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:19:34.118 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:19:34.118 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:19:34.118 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:19:34.118 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:19:34.118 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:34.118 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:19:34.119 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:19:34.119 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:19:34.119 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:19:34.119 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:19:34.119 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:34.119 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:34.119 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:19:34.119 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:19:34.119 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:19:34.119 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:19:34.119 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:34.119 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:19:34.120 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:19:34.120 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:19:34.120 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:34.120 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:34.120 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:19:34.120 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:19:34.120 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:19:34.120 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:19:34.120 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:19:34.120 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:34.120 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:19:34.120 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:19:34.120 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:19:34.120 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:19:34.121 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:19:34.121 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:34.121 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:34.121 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:19:34.121 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:19:34.121 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:19:34.121 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:19:34.121 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:34.121 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:19:34.121 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:19:34.121 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:19:34.121 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:34.122 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:34.122 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:19:34.122 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:19:34.122 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:19:34.122 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:19:34.122 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:19:34.122 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:34.122 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:19:34.122 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:19:34.123 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:19:34.123 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:19:34.123 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:19:34.123 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:19:34.123 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:19:34.123 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:34.124 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:19:34.124 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:19:34.124 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:34.124 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:19:34.124 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:19:34.124 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:19:34.124 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:19:34.124 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:19:34.124 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:19:34.124 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:34.125 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:19:34.125 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:19:34.125 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:19:34.125 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:19:34.125 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:19:34.125 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:34.125 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:19:34.125 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:19:34.135 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:19:34.135 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:19:34.135 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:19:34.396 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:19:34.397 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:19:34.397 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:19:34.397 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:19:34.397 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 76, 2024-08-24T21:19:34.397 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 292866, 2024-08-24T21:19:34.397 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:19:34.397 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:19:34.397 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:19:34.397 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:19:34.397 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:19:34.398 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 5, 2024-08-24T21:19:34.398 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:19:34.398 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:19:34.398 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:19:34.398 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:19:34.398 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:19:34.398 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:19:34.398 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:19:34.398 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:19:34.398 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:19:34.398 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:19:34.399 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:19:34.399 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:19:34.399 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:19:34.399 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:19:34.399 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:19:34.399 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:19:34.399 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:19:34.399 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:19:34.399 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:19:34.399 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:19:34.399 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:19:34.399 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:19:34.399 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:19:34.400 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:19:34.400 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:19:34.400 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:19:34.400 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:19:34.400 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:19:34.400 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:19:34.400 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:34.400 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:19:34.400 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:19:34.400 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:19:34.400 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:19:34.400 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:19:34.400 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:19:34.401 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:19:34.401 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:19:34.401 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:19:34.401 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:19:34.401 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:19:34.401 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:19:34.401 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:19:34.401 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:19:34.401 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:19:34.401 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:19:34.401 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:19:34.401 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:19:34.401 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:19:34.402 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:19:34.402 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:19:34.402 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:19:34.402 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:19:34.402 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:19:34.402 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:19:34.402 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:19:34.402 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:19:34.402 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:19:34.402 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:19:34.402 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:19:34.402 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:34.403 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:19:34.403 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:34.403 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:19:34.403 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:19:34.403 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:19:34.403 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:19:34.403 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:34.403 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:19:34.403 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:19:34.403 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:19:34.403 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:34.403 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:34.403 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:19:34.404 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:19:34.404 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:19:34.404 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:19:34.404 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:19:34.404 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:34.404 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:19:34.404 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:19:34.404 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:19:34.404 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:19:34.404 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:19:34.404 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:34.404 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:34.404 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:19:34.405 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:19:34.405 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:19:34.405 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:19:34.405 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:34.405 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:19:34.405 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:19:34.405 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:19:34.405 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:34.405 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:34.405 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:19:34.405 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:19:34.405 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:19:34.405 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:19:34.406 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:19:34.406 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:34.406 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:19:34.406 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:19:34.406 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:19:34.406 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:19:34.406 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:19:34.406 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:34.406 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:34.406 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:19:34.406 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:19:34.406 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:19:34.406 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:19:34.407 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:34.407 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:19:34.407 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:19:34.407 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:19:34.407 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:34.407 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:34.407 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:19:34.407 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:19:34.407 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:19:34.407 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:19:34.407 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:19:34.407 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:34.407 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:19:34.407 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:19:34.408 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:19:34.408 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:19:34.408 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:19:34.408 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:19:34.408 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:19:34.408 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:34.408 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:19:34.408 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:19:34.408 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:34.408 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:19:34.408 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:19:34.408 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:19:34.409 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:19:34.409 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:19:34.409 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:19:34.409 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:34.409 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:19:34.409 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:19:34.409 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 7 2024-08-24T21:19:34.409 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:19:34.409 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:19:34.409 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:19:34.409 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:34.409 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x2f018fb87aa4aafe", 2024-08-24T21:19:34.409 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "luminous", 2024-08-24T21:19:34.410 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:19:34.410 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:34.410 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:34.410 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:19:34.410 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:19:34.410 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:19:34.410 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:19:34.410 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:19:34.410 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:19:34.410 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:34.410 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:19:34.410 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:19:34.410 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:19:34.411 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:19:34.411 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:19:34.411 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:34.411 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:19:34.411 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:19:34.420 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:19:34.420 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:19:34.420 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:19:34.693 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:19:34.693 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:19:34.693 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:19:34.693 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:19:34.693 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 76, 2024-08-24T21:19:34.693 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 130286, 2024-08-24T21:19:34.693 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:19:34.693 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:19:34.694 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:19:34.694 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:19:34.694 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:19:34.694 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 5, 2024-08-24T21:19:34.694 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:19:34.694 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:19:34.694 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:19:34.694 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:19:34.694 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:19:34.694 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:19:34.694 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:19:34.694 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:19:34.695 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:19:34.695 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:19:34.695 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:19:34.695 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:19:34.695 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:19:34.695 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:19:34.695 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:19:34.695 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:19:34.695 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:19:34.695 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:19:34.695 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:19:34.695 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:19:34.695 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:19:34.696 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:19:34.696 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:19:34.696 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:19:34.696 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:19:34.696 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:19:34.696 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:19:34.696 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:19:34.696 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:19:34.696 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:34.696 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:19:34.696 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:19:34.696 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:19:34.696 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:19:34.696 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:19:34.697 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:19:34.697 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:19:34.697 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:19:34.697 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:19:34.697 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:19:34.697 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:19:34.697 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:19:34.697 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:19:34.697 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:19:34.697 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:19:34.697 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:19:34.697 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:19:34.698 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:19:34.698 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:19:34.698 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:19:34.698 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:19:34.698 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:19:34.698 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:19:34.698 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:19:34.698 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:19:34.698 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:19:34.698 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:19:34.698 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:19:34.698 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:19:34.699 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:19:34.699 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:34.699 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:19:34.699 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:34.699 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:19:34.699 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:19:34.699 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:19:34.699 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:19:34.699 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:34.699 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:19:34.699 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:19:34.699 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:19:34.699 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:34.700 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:34.700 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:19:34.700 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:19:34.700 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:19:34.700 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:19:34.700 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:19:34.700 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:34.700 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:19:34.700 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:19:34.700 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:19:34.700 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:19:34.700 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:19:34.700 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:34.701 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:34.701 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:19:34.701 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:19:34.701 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:19:34.701 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:19:34.701 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:34.701 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:19:34.701 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:19:34.701 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:19:34.701 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:34.701 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:34.701 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:19:34.701 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:19:34.702 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:19:34.702 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:19:34.702 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:19:34.702 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:34.702 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:19:34.702 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:19:34.702 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:19:34.702 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:19:34.702 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:19:34.702 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:34.702 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:34.702 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:19:34.702 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:19:34.703 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:19:34.703 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:19:34.703 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:34.703 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:19:34.703 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:19:34.703 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:19:34.703 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:34.703 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:34.703 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:19:34.703 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:19:34.703 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:19:34.703 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:19:34.704 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:19:34.704 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:34.704 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:19:34.704 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:19:34.704 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:19:34.704 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:19:34.704 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:19:34.704 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:19:34.704 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:19:34.704 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:34.704 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:19:34.704 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:19:34.704 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:34.704 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:19:34.705 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:19:34.705 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:19:34.705 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:19:34.705 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:19:34.705 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:19:34.705 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:34.705 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:19:34.705 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:19:34.705 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:19:34.705 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:19:34.705 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:19:34.705 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:19:34.705 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:34.705 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:19:34.706 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:19:34.706 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:19:34.706 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:19:34.706 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:19:34.706 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:34.706 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:19:34.706 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:19:34.714 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:19:34.715 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2024-08-24T21:19:34.715 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-08-24T21:19:34.715 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-08-24T21:19:34.715 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-08-24T21:19:34.715 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-08-24T21:19:34.716 INFO:teuthology.orchestra.run:waiting for 300 2024-08-24T21:19:34.740 INFO:tasks.ceph.mon.b:Stopped 2024-08-24T21:19:34.740 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-08-24T21:19:34.740 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:19:35.484 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":76,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":6,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:19:35.819 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap69 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap70 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap70.diff 2024-08-24T21:19:38.529 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:19:39.037 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 42% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 84% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 100% complete...done. 2024-08-24T21:19:39.084 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:19:39.084 INFO:tasks.workunit.client.0.smithi179.stderr:+ snap_num=71 2024-08-24T21:19:39.084 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd snap create ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap71 2024-08-24T21:19:39.304 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":76,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":10,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:19:42.336 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:19:43.013 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":76,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:19:46.062 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:19:49.214 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":80,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:19:49.232 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-08-24T21:19:49.233 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-08-24T21:19:49.233 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:19:49.463 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:19:49.464 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:19:49.464 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:19:49.464 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:19:49.464 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 80, 2024-08-24T21:19:49.464 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 33357, 2024-08-24T21:19:49.464 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:19:49.464 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:19:49.464 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:19:49.464 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:19:49.464 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:19:49.464 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:19:49.464 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:19:49.464 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:19:49.465 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:19:49.465 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:19:49.465 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:19:49.465 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:19:49.465 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:19:49.465 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:19:49.465 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:19:49.465 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:19:49.465 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:19:49.465 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:19:49.465 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:19:49.465 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:19:49.465 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:19:49.466 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:19:49.466 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:19:49.466 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:19:49.466 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:19:49.466 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:19:49.466 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:19:49.466 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:19:49.466 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:19:49.466 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:19:49.466 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:19:49.466 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:19:49.466 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:19:49.466 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:19:49.467 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:49.467 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:19:49.467 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:19:49.467 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:19:49.467 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:19:49.467 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:19:49.467 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:19:49.467 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:19:49.467 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:19:49.467 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:19:49.467 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:19:49.467 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:19:49.467 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:19:49.468 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:19:49.468 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:19:49.468 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:19:49.468 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:19:49.468 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:19:49.468 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:19:49.468 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:19:49.468 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:19:49.468 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:19:49.468 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:19:49.468 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:19:49.468 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:19:49.469 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:19:49.469 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:19:49.469 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:19:49.469 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:19:49.469 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:19:49.469 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:19:49.469 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:49.469 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:19:49.469 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:49.469 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:19:49.469 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:19:49.469 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:19:49.469 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:19:49.469 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:49.469 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:19:49.470 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:19:49.470 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:19:49.470 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:49.470 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:49.470 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:19:49.470 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:19:49.470 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:19:49.470 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:19:49.470 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:19:49.470 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:49.470 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:19:49.470 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:19:49.471 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:19:49.471 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:19:49.471 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:19:49.471 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:49.471 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:49.471 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:19:49.471 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:19:49.471 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:19:49.471 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:19:49.471 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:49.471 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:19:49.471 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:19:49.471 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:19:49.471 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:49.472 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:49.472 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:19:49.472 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:19:49.472 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:19:49.472 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:19:49.472 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:19:49.472 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:49.472 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:19:49.472 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:19:49.472 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:19:49.472 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:19:49.472 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:19:49.472 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:49.472 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:49.472 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:19:49.473 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:19:49.473 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:19:49.473 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:19:49.473 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:49.473 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:19:49.473 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:19:49.473 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:19:49.473 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:49.473 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:49.473 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:19:49.473 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:19:49.473 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:19:49.473 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:19:49.474 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:19:49.474 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:49.474 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:19:49.474 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:19:49.474 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:19:49.474 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:19:49.474 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:19:49.474 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:19:49.474 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:19:49.474 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:49.474 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:19:49.474 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:19:49.474 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:49.474 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:19:49.475 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:19:49.475 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:19:49.475 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:19:49.475 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:19:49.475 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:19:49.475 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:49.475 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:19:49.475 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:19:49.475 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-08-24T21:19:49.475 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:19:49.475 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:19:49.475 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:49.475 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:19:49.475 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:19:49.480 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:19:49.480 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-08-24T21:19:49.480 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:19:49.713 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:19:49.713 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:19:49.713 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:19:49.713 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:19:49.713 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 80, 2024-08-24T21:19:49.713 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 308182, 2024-08-24T21:19:49.713 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:19:49.713 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:19:49.713 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:19:49.714 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:19:49.714 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:19:49.714 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:19:49.714 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:19:49.714 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:19:49.714 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:19:49.714 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:19:49.714 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:19:49.714 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:19:49.715 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:19:49.715 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:19:49.715 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:19:49.715 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:19:49.715 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:19:49.715 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:19:49.715 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:19:49.715 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:19:49.715 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:19:49.715 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:19:49.715 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:19:49.715 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:19:49.716 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:19:49.716 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:19:49.716 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:19:49.716 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:19:49.716 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:19:49.716 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:19:49.716 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:19:49.716 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:19:49.716 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:19:49.716 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:19:49.716 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:49.716 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:19:49.716 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:19:49.717 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:19:49.717 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:19:49.717 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:19:49.717 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:19:49.717 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:19:49.717 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:19:49.717 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:19:49.717 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:19:49.717 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:19:49.717 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:19:49.717 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:19:49.717 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:19:49.717 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:19:49.718 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:19:49.718 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:19:49.718 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:19:49.718 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:19:49.718 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:19:49.718 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:19:49.718 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:19:49.718 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:19:49.718 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:19:49.718 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:19:49.718 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:19:49.718 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:19:49.719 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:19:49.719 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:19:49.719 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:19:49.719 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:49.719 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:19:49.719 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:49.719 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:19:49.719 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:19:49.719 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:19:49.719 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:19:49.719 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:49.719 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:19:49.720 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:19:49.720 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:19:49.720 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:49.720 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:49.720 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:19:49.720 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:19:49.720 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:19:49.720 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:19:49.720 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:19:49.720 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:49.720 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:19:49.720 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:19:49.720 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:19:49.721 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:19:49.721 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:19:49.721 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:49.721 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:49.721 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:19:49.721 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:19:49.721 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:19:49.721 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:19:49.721 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:49.721 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:19:49.721 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:19:49.721 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:19:49.721 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:49.722 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:49.722 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:19:49.722 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:19:49.722 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:19:49.722 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:19:49.722 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:19:49.722 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:49.722 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:19:49.722 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:19:49.722 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:19:49.722 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:19:49.722 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:19:49.722 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:49.723 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:49.723 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:19:49.723 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:19:49.723 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:19:49.723 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:19:49.723 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:49.723 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:19:49.723 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:19:49.723 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:19:49.723 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:49.723 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:49.723 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:19:49.723 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:19:49.723 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:19:49.724 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:19:49.724 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:19:49.724 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:49.724 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:19:49.724 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:19:49.724 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:19:49.724 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:19:49.724 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:19:49.724 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:19:49.724 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:19:49.724 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:49.724 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:19:49.724 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:19:49.725 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:49.725 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:19:49.725 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:19:49.725 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:19:49.725 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:19:49.725 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:19:49.725 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:19:49.725 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:49.725 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:19:49.725 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:19:49.725 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 8 2024-08-24T21:19:49.725 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:19:49.725 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:19:49.725 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:19:49.726 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:49.726 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x2f018fb87aa4aafe", 2024-08-24T21:19:49.726 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "luminous", 2024-08-24T21:19:49.726 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:19:49.726 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:49.726 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:49.726 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:19:49.726 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:19:49.726 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:19:49.726 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:19:49.726 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:19:49.726 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:19:49.726 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:19:49.726 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:19:49.727 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:19:49.727 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:19:49.727 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:19:49.727 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:19:49.727 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:19:49.727 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:19:49.727 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:19:49.731 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:19:49.732 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-08-24T21:19:52.825 INFO:tasks.workunit.client.0.smithi179.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-08-24T21:19:52.849 INFO:tasks.workunit.client.0.smithi179.stderr:+ sleep 3 2024-08-24T21:19:53.707 INFO:tasks.workunit.client.0.smithi179.stderr:+ sync ac6341a6-6d9d-4017-bb38-7eb07f2860fe-mnt 2024-08-24T21:19:54.327 INFO:tasks.workunit.client.0.smithi179.stderr:+ rm -rf ac6341a6-6d9d-4017-bb38-7eb07f2860fe-mnt/linux-5.4 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-mnt/linux-5.4.tar.gz 2024-08-24T21:19:55.851 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd export-diff --whole-object --from-snap snap70 ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap71 ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap71.diff 2024-08-24T21:19:57.929 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 50% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete...+ (( i++ )) 2024-08-24T21:19:57.929 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i < 10 )) 2024-08-24T21:19:58.476 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 79% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:19:58.543 INFO:tasks.workunit.client.0.smithi179.stderr:+ kill -0 12669 2024-08-24T21:19:58.543 INFO:tasks.workunit.client.0.smithi179.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/diff_continuous.sh: line 65: kill: (12669) - No such process 2024-08-24T21:19:58.543 INFO:tasks.workunit.client.0.smithi179.stderr:+ sudo umount ac6341a6-6d9d-4017-bb38-7eb07f2860fe-mnt 2024-08-24T21:19:58.783 INFO:tasks.workunit.client.0.smithi179.stderr:+ sudo rbd device unmap -t krbd /dev/rbd0 2024-08-24T21:19:58.903 INFO:tasks.workunit.client.0.smithi179.stderr:+ wait 12669 2024-08-24T21:19:58.903 INFO:tasks.workunit.client.0.smithi179.stderr:+ echo 'Exported 71 incrementals' 2024-08-24T21:19:58.904 INFO:tasks.workunit.client.0.smithi179.stdout:Exported 71 incrementals 2024-08-24T21:19:58.904 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( snap_num < 30 )) 2024-08-24T21:19:58.904 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i = 1 )) 2024-08-24T21:19:58.904 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:19:58.904 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap1.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:19:59.824 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2024-08-24T21:19:59.844 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap1 - 2024-08-24T21:19:59.845 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:19:59.845 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:20:04.380 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:20:04.389 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=3f7401a622c2c60fd00b628d47413b15 2024-08-24T21:20:04.390 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap1 - 2024-08-24T21:20:04.390 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:20:04.390 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:20:08.541 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:20:08.549 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=3f7401a622c2c60fd00b628d47413b15 2024-08-24T21:20:08.549 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ 3f7401a622c2c60fd00b628d47413b15 != \3\f\7\4\0\1\a\6\2\2\c\2\c\6\0\f\d\0\0\b\6\2\8\d\4\7\4\1\3\b\1\5 ]] 2024-08-24T21:20:08.549 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap1 2024-08-24T21:20:08.549 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap1 2024-08-24T21:20:08.550 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap1 2024-08-24T21:20:08.665 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:20:08.681 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:20:08.681 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap1 2024-08-24T21:20:08.681 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:20:08.760 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:20:08.760 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:20:08.761 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:20:08.761 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:20:08.761 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:20:08.761 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap2.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:20:09.733 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-08-24T21:20:09.733 INFO:tasks.ceph.mon.b:Restarting daemon 2024-08-24T21:20:09.733 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-08-24T21:20:09.738 INFO:tasks.ceph.mon.b:Started 2024-08-24T21:20:09.738 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:20:09.738 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:20:09.846 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 52% complete... Importing image diff: 76% complete... Importing image diff: 97% complete... Importing image diff: 100% complete...done. 2024-08-24T21:20:09.865 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap2 - 2024-08-24T21:20:09.866 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:20:09.867 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:20:10.202 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":80,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:20:13.221 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:20:13.669 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":80,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":24,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:20:14.448 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:20:14.456 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=3f7401a622c2c60fd00b628d47413b15 2024-08-24T21:20:14.457 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap2 - 2024-08-24T21:20:14.457 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:20:14.458 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:20:16.689 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:20:17.142 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":82,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:20:17.161 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:20:17.161 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:20:17.161 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:20:17.340 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:20:17.340 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:20:17.340 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:20:17.340 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:20:17.340 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 82, 2024-08-24T21:20:17.341 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 61234, 2024-08-24T21:20:17.341 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:20:17.341 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:20:17.341 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:20:17.341 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:20:17.341 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:20:17.341 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 2, 2024-08-24T21:20:17.341 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:20:17.341 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:20:17.341 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:20:17.341 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:20:17.341 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:20:17.341 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:20:17.342 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:20:17.342 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:20:17.342 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:20:17.342 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:20:17.342 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:20:17.342 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:20:17.342 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:20:17.342 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:20:17.342 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:20:17.342 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:20:17.342 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:20:17.342 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:20:17.343 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:20:17.343 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:20:17.343 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:20:17.343 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:20:17.343 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:20:17.343 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:20:17.343 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:20:17.343 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:20:17.343 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:20:17.343 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:20:17.343 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:20:17.343 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:17.343 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:20:17.344 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:20:17.344 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:20:17.344 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:20:17.344 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:20:17.344 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:20:17.344 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:20:17.344 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:20:17.344 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:20:17.344 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:20:17.344 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:20:17.344 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:20:17.344 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:20:17.345 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:20:17.345 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:20:17.345 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:20:17.345 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:20:17.345 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:20:17.345 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:20:17.345 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:20:17.345 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:20:17.345 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:20:17.345 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:20:17.345 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:20:17.345 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:20:17.345 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:20:17.345 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:20:17.346 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:20:17.346 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:20:17.346 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:20:17.346 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:17.346 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:20:17.346 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:17.346 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:20:17.346 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:20:17.346 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:20:17.346 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:20:17.346 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:17.346 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:20:17.346 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:20:17.347 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:20:17.347 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:17.347 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:17.347 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:20:17.347 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:20:17.347 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:20:17.347 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:20:17.347 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:20:17.347 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:17.347 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:20:17.347 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:20:17.347 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:20:17.347 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:20:17.348 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:20:17.348 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:17.348 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:17.348 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:20:17.348 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:20:17.348 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:20:17.348 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:20:17.348 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:17.348 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:20:17.348 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:20:17.348 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:20:17.348 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:17.348 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:17.348 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:20:17.349 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:20:17.349 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:20:17.349 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:20:17.349 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:20:17.349 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:17.349 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:20:17.349 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:20:17.349 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:20:17.349 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:20:17.349 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:20:17.349 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:17.349 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:17.349 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:20:17.350 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:20:17.350 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:20:17.350 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:20:17.350 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:17.350 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:20:17.350 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:20:17.350 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:20:17.350 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:17.350 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:17.350 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:20:17.350 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:20:17.350 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:20:17.350 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:20:17.351 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:20:17.351 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:17.351 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:20:17.351 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:20:17.351 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:20:17.351 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:20:17.351 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:20:17.351 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:20:17.351 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:20:17.351 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:17.351 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:20:17.351 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:20:17.352 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:17.352 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:20:17.352 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:20:17.352 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:20:17.352 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:20:17.352 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:20:17.352 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:20:17.352 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:17.352 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:20:17.352 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:20:17.352 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:20:17.352 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:20:17.352 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:20:17.352 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:17.352 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:20:17.353 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:20:17.355 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:20:17.355 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:20:17.356 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:20:17.534 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:20:17.534 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:20:17.534 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:20:17.534 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:20:17.534 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 82, 2024-08-24T21:20:17.535 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 336003, 2024-08-24T21:20:17.535 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:20:17.535 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:20:17.535 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:20:17.535 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:20:17.535 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:20:17.535 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 2, 2024-08-24T21:20:17.535 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:20:17.535 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:20:17.536 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:20:17.536 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:20:17.536 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:20:17.536 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:20:17.536 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:20:17.536 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:20:17.536 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:20:17.536 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:20:17.536 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:20:17.536 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:20:17.536 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:20:17.537 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:20:17.537 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:20:17.537 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:20:17.537 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:20:17.537 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:20:17.537 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:20:17.537 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:20:17.537 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:20:17.537 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:20:17.537 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:20:17.537 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:20:17.537 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:20:17.537 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:20:17.537 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:20:17.538 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:20:17.538 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:20:17.538 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:17.538 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:20:17.538 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:20:17.538 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:20:17.538 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:20:17.538 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:20:17.538 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:20:17.538 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:20:17.538 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:20:17.538 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:20:17.538 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:20:17.539 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:20:17.539 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:20:17.539 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:20:17.539 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:20:17.539 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:20:17.539 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:20:17.539 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:20:17.539 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:20:17.539 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:20:17.539 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:20:17.539 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:20:17.539 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:20:17.540 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:20:17.540 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:20:17.540 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:20:17.540 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:20:17.540 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:20:17.540 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:20:17.540 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:20:17.540 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:20:17.540 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:17.540 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:20:17.540 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:17.540 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:20:17.540 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:20:17.541 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:20:17.541 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:20:17.541 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:17.541 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:20:17.541 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:20:17.541 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:20:17.541 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:17.541 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:17.541 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:20:17.541 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:20:17.541 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:20:17.541 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:20:17.541 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:20:17.541 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:17.542 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:20:17.542 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:20:17.542 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:20:17.542 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:20:17.542 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:20:17.542 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:17.542 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:17.542 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:20:17.542 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:20:17.542 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:20:17.542 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:20:17.542 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:17.542 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:20:17.542 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:20:17.543 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:20:17.543 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:17.543 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:17.543 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:20:17.543 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:20:17.543 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:20:17.543 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:20:17.543 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:20:17.543 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:17.543 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:20:17.543 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:20:17.543 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:20:17.543 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:20:17.543 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:20:17.544 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:17.544 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:17.544 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:20:17.544 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:20:17.544 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:20:17.544 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:20:17.544 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:17.544 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:20:17.544 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:20:17.544 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:20:17.544 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:17.544 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:17.544 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:20:17.544 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:20:17.545 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:20:17.545 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:20:17.545 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:20:17.545 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:17.545 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:20:17.545 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:20:17.545 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:20:17.545 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:20:17.545 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:20:17.545 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:20:17.545 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:20:17.545 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:17.545 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:20:17.545 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:20:17.546 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:17.546 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:20:17.546 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:20:17.546 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:20:17.546 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:20:17.546 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:20:17.546 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:20:17.546 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:17.546 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:20:17.546 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:20:17.546 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 8 2024-08-24T21:20:17.546 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:20:17.546 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:20:17.546 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:20:17.547 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:17.547 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:20:17.547 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:20:17.547 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 6 2024-08-24T21:20:17.547 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:20:17.547 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:20:17.547 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:20:17.547 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:17.547 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:20:17.547 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:20:17.547 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:20:17.547 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:20:17.547 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:20:17.547 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:17.547 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:20:17.548 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:20:17.550 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:20:17.550 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:20:17.550 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:20:17.729 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:20:17.729 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:20:17.729 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:20:17.730 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:20:17.730 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 82, 2024-08-24T21:20:17.730 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 7837, 2024-08-24T21:20:17.730 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:20:17.730 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:20:17.730 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:20:17.730 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:20:17.730 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:20:17.730 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 2, 2024-08-24T21:20:17.730 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:20:17.730 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:20:17.730 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:20:17.731 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:20:17.731 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:20:17.731 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:20:17.731 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:20:17.731 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:20:17.731 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:20:17.731 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:20:17.731 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:20:17.731 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:20:17.731 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:20:17.731 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:20:17.731 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:20:17.732 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:20:17.732 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:20:17.732 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:20:17.732 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:20:17.732 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:20:17.732 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:20:17.732 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:20:17.732 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:20:17.732 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:20:17.732 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:20:17.732 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:20:17.732 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:20:17.732 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:20:17.733 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:20:17.733 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:17.733 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:20:17.733 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:20:17.733 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:20:17.733 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:20:17.733 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:20:17.733 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:20:17.733 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:20:17.733 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:20:17.733 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:20:17.733 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:20:17.733 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:20:17.733 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:20:17.734 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:20:17.734 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:20:17.734 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:20:17.734 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:20:17.734 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:20:17.734 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:20:17.734 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:20:17.734 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:20:17.734 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:20:17.734 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:20:17.734 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:20:17.734 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:20:17.734 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:20:17.735 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:20:17.735 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:20:17.735 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:20:17.735 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:20:17.735 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:20:17.735 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:17.735 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:20:17.735 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:17.735 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:20:17.735 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:20:17.735 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:20:17.735 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:20:17.735 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:17.735 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:20:17.736 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:20:17.736 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:20:17.736 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:17.736 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:17.736 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:20:17.736 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:20:17.736 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:20:17.736 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:20:17.736 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:20:17.736 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:17.736 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:20:17.736 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:20:17.736 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:20:17.736 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:20:17.737 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:20:17.737 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:17.737 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:17.737 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:20:17.737 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:20:17.737 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:20:17.737 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:20:17.737 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:17.737 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:20:17.737 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:20:17.737 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:20:17.737 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:17.737 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:17.738 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:20:17.738 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:20:17.738 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:20:17.738 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:20:17.738 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:20:17.738 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:17.738 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:20:17.738 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:20:17.738 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:20:17.738 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:20:17.738 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:20:17.738 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:17.738 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:17.739 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:20:17.739 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:20:17.739 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:20:17.739 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:20:17.739 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:17.739 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:20:17.739 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:20:17.739 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:20:17.739 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:17.739 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:17.739 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:20:17.739 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:20:17.739 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:20:17.740 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:20:17.740 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:20:17.740 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:17.740 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:20:17.740 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:20:17.740 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:20:17.740 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:20:17.740 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:20:17.740 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:20:17.740 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:20:17.740 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:17.740 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:20:17.740 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:20:17.740 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:17.741 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:20:17.741 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:20:17.741 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:20:17.741 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:20:17.741 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:20:17.741 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:20:17.741 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:17.741 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:20:17.741 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:20:17.741 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:20:17.741 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:20:17.741 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:20:17.741 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:17.741 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:20:17.742 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:20:17.744 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:20:17.744 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-08-24T21:20:17.745 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-08-24T21:20:18.213 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-08-24T21:20:18.650 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:20:18.658 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=3f7401a622c2c60fd00b628d47413b15 2024-08-24T21:20:18.658 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ 3f7401a622c2c60fd00b628d47413b15 != \3\f\7\4\0\1\a\6\2\2\c\2\c\6\0\f\d\0\0\b\6\2\8\d\4\7\4\1\3\b\1\5 ]] 2024-08-24T21:20:18.658 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap2 2024-08-24T21:20:18.658 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap2 2024-08-24T21:20:18.658 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap2 2024-08-24T21:20:18.770 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:20:18.782 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:20:18.784 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap2 2024-08-24T21:20:18.784 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:20:18.863 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:20:18.864 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:20:18.864 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:20:18.864 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:20:18.864 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:20:18.864 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap3.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:20:19.215 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:20:19.215 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:20:19.654 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":82,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:20:19.671 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:20:19.671 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-08-24T21:20:19.671 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:20:19.671 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:20:19.847 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:20:19.847 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:20:19.847 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:20:19.847 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:20:19.847 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 82, 2024-08-24T21:20:19.847 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 63740, 2024-08-24T21:20:19.847 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:20:19.847 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:20:19.848 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:20:19.848 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:20:19.848 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:20:19.848 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 4, 2024-08-24T21:20:19.848 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:20:19.848 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:20:19.848 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:20:19.848 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:20:19.848 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:20:19.848 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:20:19.848 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:20:19.848 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:20:19.848 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:20:19.849 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:20:19.849 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:20:19.849 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:20:19.849 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:20:19.849 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:20:19.849 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:20:19.849 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:20:19.849 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:20:19.849 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:20:19.849 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:20:19.849 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:20:19.849 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:20:19.850 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:20:19.850 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:20:19.850 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:20:19.850 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:20:19.850 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:20:19.850 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:20:19.850 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:20:19.850 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:20:19.850 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:19.850 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:20:19.850 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:20:19.850 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:20:19.851 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:20:19.851 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:20:19.851 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:20:19.851 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:20:19.851 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:20:19.851 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:20:19.851 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:20:19.851 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:20:19.851 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:20:19.851 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:20:19.852 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:20:19.852 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:20:19.852 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:20:19.852 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:20:19.852 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:20:19.852 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:20:19.852 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:20:19.852 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:20:19.852 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:20:19.852 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:20:19.852 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:20:19.852 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:20:19.852 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:20:19.853 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:20:19.853 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:20:19.853 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:20:19.853 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:20:19.853 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:19.853 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:20:19.853 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:19.853 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:20:19.853 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:20:19.853 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:20:19.853 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:20:19.853 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:19.853 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:20:19.854 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:20:19.854 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:20:19.854 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:19.854 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:19.854 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:20:19.854 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:20:19.854 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:20:19.854 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:20:19.854 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:20:19.854 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:19.854 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:20:19.854 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:20:19.855 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:20:19.855 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:20:19.855 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:20:19.855 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:19.855 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:19.855 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:20:19.855 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:20:19.855 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:20:19.855 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:20:19.855 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:19.855 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:20:19.855 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:20:19.856 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:20:19.856 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:19.856 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:19.856 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:20:19.856 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:20:19.856 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:20:19.856 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:20:19.856 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:20:19.856 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:19.856 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:20:19.856 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:20:19.856 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:20:19.856 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:20:19.857 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:20:19.857 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:19.857 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:19.857 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:20:19.857 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:20:19.857 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:20:19.857 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:20:19.857 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:19.857 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:20:19.857 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:20:19.857 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:20:19.857 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:19.857 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:19.857 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:20:19.858 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:20:19.858 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:20:19.858 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:20:19.858 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:20:19.858 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:19.858 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:20:19.858 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:20:19.858 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:20:19.858 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:20:19.858 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:20:19.858 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:20:19.858 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:20:19.858 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:19.858 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:20:19.859 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:20:19.859 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:19.859 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:20:19.859 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:20:19.859 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:20:19.859 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:20:19.859 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:20:19.859 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:20:19.859 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:19.859 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:20:19.859 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:20:19.859 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:20:19.860 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:20:19.860 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:20:19.860 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:19.860 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:20:19.860 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:20:19.862 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:20:19.862 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:20:19.863 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:20:19.874 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 52% complete... Importing image diff: 76% complete... Importing image diff: 97% complete... Importing image diff: 100% complete...done. 2024-08-24T21:20:19.897 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap3 - 2024-08-24T21:20:19.897 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:20:19.897 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:20:20.038 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:20:20.039 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:20:20.039 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:20:20.039 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:20:20.039 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 82, 2024-08-24T21:20:20.039 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 338507, 2024-08-24T21:20:20.039 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:20:20.039 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:20:20.039 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:20:20.039 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:20:20.039 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:20:20.039 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 4, 2024-08-24T21:20:20.039 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:20:20.040 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:20:20.040 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:20:20.040 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:20:20.040 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:20:20.040 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:20:20.040 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:20:20.040 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:20:20.040 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:20:20.040 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:20:20.040 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:20:20.040 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:20:20.040 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:20:20.040 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:20:20.041 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:20:20.041 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:20:20.041 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:20:20.041 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:20:20.041 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:20:20.041 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:20:20.041 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:20:20.041 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:20:20.041 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:20:20.041 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:20:20.041 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:20:20.041 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:20:20.041 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:20:20.041 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:20:20.042 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:20:20.042 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:20.042 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:20:20.042 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:20:20.042 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:20:20.042 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:20:20.042 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:20:20.042 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:20:20.042 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:20:20.042 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:20:20.042 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:20:20.042 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:20:20.042 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:20:20.043 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:20:20.043 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:20:20.043 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:20:20.043 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:20:20.043 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:20:20.043 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:20:20.043 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:20:20.043 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:20:20.043 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:20:20.043 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:20:20.043 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:20:20.043 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:20:20.044 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:20:20.044 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:20:20.044 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:20:20.044 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:20:20.044 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:20:20.044 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:20:20.044 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:20:20.044 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:20.044 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:20:20.044 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:20.044 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:20:20.044 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:20:20.044 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:20:20.044 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:20:20.044 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:20.045 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:20:20.045 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:20:20.045 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:20:20.045 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:20.045 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:20.045 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:20:20.045 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:20:20.045 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:20:20.045 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:20:20.045 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:20:20.045 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:20.045 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:20:20.046 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:20:20.046 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:20:20.046 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:20:20.046 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:20:20.046 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:20.046 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:20.046 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:20:20.046 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:20:20.046 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:20:20.046 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:20:20.046 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:20.046 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:20:20.047 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:20:20.047 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:20:20.047 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:20.047 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:20.047 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:20:20.047 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:20:20.047 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:20:20.047 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:20:20.047 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:20:20.047 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:20.047 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:20:20.047 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:20:20.047 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:20:20.047 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:20:20.048 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:20:20.048 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:20.048 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:20.048 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:20:20.048 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:20:20.048 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:20:20.048 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:20:20.048 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:20.048 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:20:20.048 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:20:20.048 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:20:20.048 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:20.048 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:20.048 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:20:20.049 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:20:20.049 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:20:20.049 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:20:20.049 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:20:20.049 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:20.049 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:20:20.049 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:20:20.049 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:20:20.049 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:20:20.049 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:20:20.049 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:20:20.049 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:20:20.049 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:20.049 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:20:20.049 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:20:20.050 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:20.050 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:20:20.050 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:20:20.050 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:20:20.050 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:20:20.050 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:20:20.050 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:20:20.050 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:20.050 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:20:20.050 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:20:20.050 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 8 2024-08-24T21:20:20.050 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:20:20.050 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:20:20.051 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:20:20.051 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:20.051 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:20:20.051 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:20:20.051 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-08-24T21:20:20.051 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:20:20.051 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:20:20.051 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:20:20.051 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:20.051 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:20:20.051 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:20:20.051 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:20:20.052 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:20:20.052 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:20:20.052 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:20.052 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:20:20.052 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:20:20.053 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:20:20.053 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:20:20.054 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:20:20.230 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:20:20.230 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:20:20.230 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:20:20.230 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:20:20.230 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 82, 2024-08-24T21:20:20.230 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 10337, 2024-08-24T21:20:20.230 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:20:20.231 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:20:20.231 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:20:20.231 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:20:20.231 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:20:20.231 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 5, 2024-08-24T21:20:20.231 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:20:20.231 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:20:20.231 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:20:20.231 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:20:20.231 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:20:20.231 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:20:20.231 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:20:20.231 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:20:20.232 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:20:20.232 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:20:20.232 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:20:20.232 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:20:20.232 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:20:20.232 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:20:20.232 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:20:20.232 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:20:20.232 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:20:20.232 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:20:20.232 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:20:20.232 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:20:20.232 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:20:20.234 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:20:20.234 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:20:20.234 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:20:20.234 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:20:20.234 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:20:20.234 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:20:20.234 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:20:20.235 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:20:20.235 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:20.235 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:20:20.235 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:20:20.235 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:20:20.235 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:20:20.235 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:20:20.235 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:20:20.235 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:20:20.235 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:20:20.235 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:20:20.235 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:20:20.235 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:20:20.236 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:20:20.236 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:20:20.236 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:20:20.236 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:20:20.236 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:20:20.236 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:20:20.236 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:20:20.236 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:20:20.236 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:20:20.236 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:20:20.236 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:20:20.236 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:20:20.236 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:20:20.236 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:20:20.237 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:20:20.237 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:20:20.237 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:20:20.237 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:20:20.237 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:20:20.237 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:20.237 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:20:20.237 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:20.237 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:20:20.237 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:20:20.237 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:20:20.237 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:20:20.237 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:20.237 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:20:20.238 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:20:20.238 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:20:20.238 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:20.238 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:20.238 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:20:20.238 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:20:20.238 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:20:20.238 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:20:20.238 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:20:20.238 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:20.238 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:20:20.238 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:20:20.238 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:20:20.239 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:20:20.239 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:20:20.239 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:20.239 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:20.239 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:20:20.239 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:20:20.239 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:20:20.239 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:20:20.239 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:20.239 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:20:20.239 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:20:20.239 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:20:20.239 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:20.240 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:20.240 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:20:20.240 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:20:20.240 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:20:20.240 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:20:20.240 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:20:20.240 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:20.240 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:20:20.240 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:20:20.240 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:20:20.240 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:20:20.240 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:20:20.240 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:20.240 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:20.241 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:20:20.241 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:20:20.241 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:20:20.241 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:20:20.241 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:20.241 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:20:20.241 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:20:20.241 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:20:20.241 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:20.241 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:20.241 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:20:20.241 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:20:20.241 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:20:20.242 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:20:20.242 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:20:20.242 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:20.242 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:20:20.242 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:20:20.242 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:20:20.242 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:20:20.242 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:20:20.242 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:20:20.242 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:20:20.242 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:20.242 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:20:20.242 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:20:20.243 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:20.243 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:20:20.243 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:20:20.243 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:20:20.243 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:20:20.243 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:20:20.243 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:20:20.243 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:20.243 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:20:20.243 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:20:20.243 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:20:20.243 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:20:20.244 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:20:20.244 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:20.244 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:20:20.244 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:20:20.245 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:20:20.245 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2024-08-24T21:20:20.245 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-08-24T21:20:20.245 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-08-24T21:20:20.245 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-08-24T21:20:20.246 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-08-24T21:20:20.246 INFO:teuthology.orchestra.run:waiting for 300 2024-08-24T21:20:20.269 INFO:tasks.ceph.mon.c:Stopped 2024-08-24T21:20:20.269 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-08-24T21:20:20.269 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:20:20.754 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":82,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:20:23.773 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:20:24.219 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":82,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":9,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:20:24.442 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:20:24.450 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=3f7401a622c2c60fd00b628d47413b15 2024-08-24T21:20:24.451 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap3 - 2024-08-24T21:20:24.451 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:20:24.452 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:20:27.238 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:20:27.696 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":82,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:20:28.614 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:20:28.623 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=3f7401a622c2c60fd00b628d47413b15 2024-08-24T21:20:28.623 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ 3f7401a622c2c60fd00b628d47413b15 != \3\f\7\4\0\1\a\6\2\2\c\2\c\6\0\f\d\0\0\b\6\2\8\d\4\7\4\1\3\b\1\5 ]] 2024-08-24T21:20:28.623 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap3 2024-08-24T21:20:28.623 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap3 2024-08-24T21:20:28.623 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap3 2024-08-24T21:20:28.735 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:20:28.748 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:20:28.749 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap3 2024-08-24T21:20:28.749 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:20:28.828 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:20:28.829 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:20:28.829 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:20:28.829 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:20:28.829 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:20:28.829 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap4.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:20:30.715 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:20:35.297 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":86,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:20:35.315 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-08-24T21:20:35.315 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-08-24T21:20:35.315 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:20:35.490 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:20:35.491 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:20:35.491 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:20:35.491 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:20:35.491 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 86, 2024-08-24T21:20:35.491 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 79384, 2024-08-24T21:20:35.491 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:20:35.491 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:20:35.491 INFO:teuthology.orchestra.run.smithi060.stdout: 1 2024-08-24T21:20:35.491 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:20:35.491 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:20:35.491 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:20:35.491 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:20:35.492 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:20:35.492 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:20:35.492 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:20:35.492 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:20:35.492 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:20:35.492 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:20:35.492 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:20:35.492 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:20:35.492 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:20:35.492 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:20:35.492 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:20:35.492 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:20:35.493 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:20:35.493 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:20:35.493 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:20:35.493 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:20:35.493 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:20:35.493 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:20:35.493 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:20:35.493 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:20:35.493 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:20:35.493 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:20:35.493 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:20:35.493 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:20:35.493 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:20:35.494 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:20:35.494 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:20:35.494 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:35.494 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:20:35.494 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:20:35.494 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:20:35.494 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:20:35.494 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:20:35.494 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:20:35.494 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:20:35.494 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:20:35.494 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:20:35.495 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:20:35.495 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:20:35.495 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:20:35.495 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:20:35.495 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:20:35.495 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:20:35.495 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:20:35.495 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:20:35.495 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:20:35.495 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:20:35.495 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:20:35.495 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:20:35.496 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:20:35.496 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:20:35.496 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:20:35.496 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:20:35.496 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:20:35.496 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:20:35.496 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:20:35.496 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:20:35.496 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:20:35.496 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:35.496 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:20:35.496 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:35.496 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:20:35.497 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:20:35.497 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:20:35.497 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:20:35.497 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:35.497 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:20:35.497 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:20:35.497 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:20:35.497 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:35.497 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:35.497 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:20:35.497 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:20:35.497 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:20:35.497 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:20:35.498 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:20:35.498 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:35.498 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:20:35.498 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:20:35.498 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:20:35.498 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:20:35.498 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:20:35.498 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:35.498 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:35.498 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:20:35.498 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:20:35.498 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:20:35.498 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:20:35.499 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:35.499 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:20:35.499 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:20:35.499 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:20:35.499 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:35.499 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:35.499 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:20:35.499 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:20:35.499 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:20:35.499 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:20:35.499 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:20:35.500 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:35.500 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:20:35.500 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:20:35.500 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:20:35.500 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:20:35.500 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:20:35.500 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:35.500 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:35.500 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:20:35.501 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:20:35.501 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:20:35.501 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:20:35.501 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:35.501 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:20:35.501 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:20:35.501 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:20:35.501 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:35.501 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:35.501 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:20:35.501 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:20:35.501 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:20:35.501 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:20:35.502 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:20:35.502 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:35.502 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:20:35.502 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:20:35.502 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:20:35.502 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:20:35.502 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:20:35.502 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:20:35.502 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:20:35.502 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:35.502 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:20:35.502 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:20:35.502 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:35.503 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:20:35.503 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:20:35.503 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:20:35.503 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:20:35.503 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:20:35.503 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:20:35.503 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:35.503 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:20:35.503 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:20:35.503 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:20:35.503 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:20:35.503 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:20:35.504 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:20:35.504 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:35.504 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:20:35.504 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:20:35.504 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 6 2024-08-24T21:20:35.504 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:20:35.504 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:20:35.504 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:20:35.504 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:35.504 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:20:35.504 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:20:35.504 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:20:35.504 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:20:35.504 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:20:35.505 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:35.505 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:20:35.505 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:20:35.506 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:20:35.506 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-08-24T21:20:35.506 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:20:35.682 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:20:35.683 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:20:35.683 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:20:35.683 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:20:35.683 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 86, 2024-08-24T21:20:35.683 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 25790, 2024-08-24T21:20:35.683 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:20:35.683 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:20:35.683 INFO:teuthology.orchestra.run.smithi060.stdout: 1 2024-08-24T21:20:35.683 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:20:35.683 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:20:35.683 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:20:35.684 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:20:35.684 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:20:35.684 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:20:35.684 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:20:35.684 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:20:35.684 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:20:35.684 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:20:35.684 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:20:35.684 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:20:35.684 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:20:35.684 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:20:35.684 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:20:35.684 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:20:35.684 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:20:35.685 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:20:35.685 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:20:35.685 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:20:35.685 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:20:35.685 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:20:35.685 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:20:35.685 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:20:35.685 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:20:35.685 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:20:35.685 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:20:35.685 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:20:35.685 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:20:35.685 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:20:35.686 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:20:35.686 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:35.686 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:20:35.686 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:20:35.686 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:20:35.686 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:20:35.686 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:20:35.686 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:20:35.686 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:20:35.686 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:20:35.686 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:20:35.686 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:20:35.686 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:20:35.687 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:20:35.687 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:20:35.687 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:20:35.687 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:20:35.687 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:20:35.687 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:20:35.687 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:20:35.687 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:20:35.687 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:20:35.687 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:20:35.687 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:20:35.687 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:20:35.687 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:20:35.688 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:20:35.688 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:20:35.688 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:20:35.688 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:20:35.688 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:20:35.688 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:20:35.688 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:35.688 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:20:35.688 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:35.688 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:20:35.688 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:20:35.688 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:20:35.688 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:20:35.689 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:35.689 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:20:35.689 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:20:35.689 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:20:35.689 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:35.689 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:35.689 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:20:35.689 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:20:35.689 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:20:35.689 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:20:35.689 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:20:35.689 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:35.689 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:20:35.690 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:20:35.690 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:20:35.690 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:20:35.690 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:20:35.690 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:35.690 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:35.690 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:20:35.690 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:20:35.690 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:20:35.690 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:20:35.690 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:35.690 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:20:35.690 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:20:35.691 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:20:35.691 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:35.691 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:35.691 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:20:35.691 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:20:35.691 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:20:35.691 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:20:35.691 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:20:35.691 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:35.691 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:20:35.691 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:20:35.691 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:20:35.691 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:20:35.691 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:20:35.692 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:35.692 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:35.692 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:20:35.692 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:20:35.692 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:20:35.692 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:20:35.692 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:35.692 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:20:35.692 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:20:35.692 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:20:35.692 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:35.692 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:35.692 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:20:35.693 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:20:35.693 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:20:35.693 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:20:35.693 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:20:35.693 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:35.693 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:20:35.693 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:20:35.693 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:20:35.693 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:20:35.693 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:20:35.693 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:20:35.693 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:20:35.693 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:35.693 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:20:35.694 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:20:35.694 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:35.694 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:20:35.694 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:20:35.694 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:20:35.694 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:20:35.694 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:20:35.694 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:20:35.694 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:35.694 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:20:35.694 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:20:35.694 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:20:35.694 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:20:35.695 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:20:35.695 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:20:35.695 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:20:35.695 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:20:35.695 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:20:35.695 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:20:35.695 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:20:35.695 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:20:35.695 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:20:35.695 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:20:35.695 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:20:35.698 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:20:35.698 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-08-24T21:20:35.892 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 50% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2024-08-24T21:20:35.912 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap4 - 2024-08-24T21:20:35.912 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:20:35.913 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:20:40.516 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:20:40.531 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=e0563d85caecbb92b679a7d638dc94d1 2024-08-24T21:20:40.532 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap4 - 2024-08-24T21:20:40.532 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:20:40.533 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:20:44.741 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:20:44.749 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=e0563d85caecbb92b679a7d638dc94d1 2024-08-24T21:20:44.750 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ e0563d85caecbb92b679a7d638dc94d1 != \e\0\5\6\3\d\8\5\c\a\e\c\b\b\9\2\b\6\7\9\a\7\d\6\3\8\d\c\9\4\d\1 ]] 2024-08-24T21:20:44.750 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap4 2024-08-24T21:20:44.750 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap4 2024-08-24T21:20:44.750 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap4 2024-08-24T21:20:44.866 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:20:44.878 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:20:44.879 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap4 2024-08-24T21:20:44.879 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:20:44.958 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:20:44.958 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:20:44.958 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:20:44.958 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:20:44.958 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:20:44.958 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap5.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:20:45.917 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 52% complete... Importing image diff: 76% complete... Importing image diff: 97% complete... Importing image diff: 100% complete...done. 2024-08-24T21:20:45.939 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap5 - 2024-08-24T21:20:45.939 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:20:45.939 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:20:50.615 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:20:50.631 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=e0563d85caecbb92b679a7d638dc94d1 2024-08-24T21:20:50.632 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap5 - 2024-08-24T21:20:50.632 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:20:50.632 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:20:54.821 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:20:54.830 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=e0563d85caecbb92b679a7d638dc94d1 2024-08-24T21:20:54.830 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ e0563d85caecbb92b679a7d638dc94d1 != \e\0\5\6\3\d\8\5\c\a\e\c\b\b\9\2\b\6\7\9\a\7\d\6\3\8\d\c\9\4\d\1 ]] 2024-08-24T21:20:54.830 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap5 2024-08-24T21:20:54.831 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap5 2024-08-24T21:20:54.831 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap5 2024-08-24T21:20:54.945 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:20:54.957 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:20:54.958 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap5 2024-08-24T21:20:54.959 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:20:55.038 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:20:55.038 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:20:55.038 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:20:55.038 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:20:55.038 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:20:55.039 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap6.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:20:55.698 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-08-24T21:20:55.698 INFO:tasks.ceph.mon.c:Restarting daemon 2024-08-24T21:20:55.699 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-08-24T21:20:55.704 INFO:tasks.ceph.mon.c:Started 2024-08-24T21:20:55.704 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:20:55.704 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:20:55.947 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2024-08-24T21:20:55.967 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap6 - 2024-08-24T21:20:55.967 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:20:55.968 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:20:56.162 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":86,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:20:59.181 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:20:59.635 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":86,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":24,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:21:00.483 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:21:00.498 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=9c879d62e5b122265071f6cf78e3e494 2024-08-24T21:21:00.499 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap6 - 2024-08-24T21:21:00.500 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:21:00.500 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:21:02.654 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:21:03.112 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":88,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:21:03.131 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:21:03.131 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:21:03.131 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:21:03.307 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:21:03.308 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:21:03.308 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:21:03.308 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:21:03.308 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 88, 2024-08-24T21:21:03.308 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 107201, 2024-08-24T21:21:03.308 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:21:03.308 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:21:03.308 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:21:03.308 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:21:03.308 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:21:03.308 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 2, 2024-08-24T21:21:03.309 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:21:03.309 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:21:03.309 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:21:03.309 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:21:03.309 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:21:03.309 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:21:03.309 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:21:03.309 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:21:03.309 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:21:03.309 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:21:03.309 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:21:03.309 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:21:03.310 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:21:03.310 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:21:03.310 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:21:03.310 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:21:03.310 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:21:03.310 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:21:03.310 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:21:03.310 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:21:03.310 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:21:03.310 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:21:03.310 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:21:03.310 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:21:03.311 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:21:03.311 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:21:03.311 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:21:03.311 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:21:03.311 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:21:03.311 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:03.311 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:21:03.311 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:21:03.311 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:21:03.311 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:21:03.311 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:21:03.311 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:21:03.312 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:21:03.312 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:21:03.312 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:21:03.312 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:21:03.312 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:21:03.312 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:21:03.312 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:21:03.312 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:21:03.312 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:21:03.312 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:21:03.312 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:21:03.312 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:21:03.313 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:21:03.313 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:21:03.313 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:21:03.313 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:21:03.313 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:21:03.313 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:21:03.313 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:21:03.313 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:21:03.313 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:21:03.313 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:21:03.313 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:21:03.313 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:21:03.314 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:03.314 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:21:03.314 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:03.314 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:21:03.314 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:21:03.314 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:21:03.314 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:21:03.314 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:03.314 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:21:03.314 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:21:03.314 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:21:03.314 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:03.314 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:03.315 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:21:03.315 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:21:03.315 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:21:03.315 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:21:03.315 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:21:03.315 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:03.315 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:21:03.315 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:21:03.315 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:21:03.315 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:21:03.315 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:21:03.315 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:03.315 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:03.316 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:21:03.316 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:21:03.316 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:21:03.316 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:21:03.316 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:03.316 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:21:03.316 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:21:03.316 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:21:03.316 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:03.316 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:03.316 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:21:03.316 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:21:03.316 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:21:03.317 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:21:03.317 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:21:03.317 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:03.317 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:21:03.317 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:21:03.317 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:21:03.317 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:21:03.317 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:21:03.317 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:03.317 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:03.317 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:21:03.317 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:21:03.317 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:21:03.318 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:21:03.318 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:03.318 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:21:03.318 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:21:03.318 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:21:03.318 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:03.318 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:03.318 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:21:03.318 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:21:03.318 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:21:03.318 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:21:03.318 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:21:03.319 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:03.319 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:21:03.319 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:21:03.319 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:21:03.319 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:21:03.319 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:21:03.319 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:21:03.319 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:21:03.319 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:03.319 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:21:03.319 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:21:03.319 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:03.319 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:21:03.320 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:21:03.320 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:21:03.320 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:21:03.320 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:21:03.320 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:21:03.320 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:03.320 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:21:03.320 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:21:03.320 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:21:03.320 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:21:03.320 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:21:03.320 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:21:03.320 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:03.321 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:21:03.321 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:21:03.321 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 6 2024-08-24T21:21:03.321 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:21:03.321 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:21:03.321 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:21:03.321 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:03.321 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:21:03.321 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:21:03.321 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:21:03.321 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:21:03.321 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:21:03.321 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:03.322 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:21:03.322 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:21:03.323 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:21:03.323 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:21:03.323 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:21:04.633 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:21:04.642 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=9c879d62e5b122265071f6cf78e3e494 2024-08-24T21:21:04.643 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ 9c879d62e5b122265071f6cf78e3e494 != \9\c\8\7\9\d\6\2\e\5\b\1\2\2\2\6\5\0\7\1\f\6\c\f\7\8\e\3\e\4\9\4 ]] 2024-08-24T21:21:04.643 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap6 2024-08-24T21:21:04.643 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap6 2024-08-24T21:21:04.643 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap6 2024-08-24T21:21:04.761 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:21:04.773 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:21:04.774 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap6 2024-08-24T21:21:04.775 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:21:04.859 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:21:04.859 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:21:04.859 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:21:04.859 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:21:04.859 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:21:04.859 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap7.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:21:05.969 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 11% complete... Importing image diff: 22% complete... Importing image diff: 33% complete... Importing image diff: 44% complete... Importing image diff: 55% complete... Importing image diff: 66% complete... Importing image diff: 77% complete... Importing image diff: 88% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2024-08-24T21:21:05.987 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap7 - 2024-08-24T21:21:05.987 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:21:05.987 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:21:06.508 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:21:06.508 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:21:06.508 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:21:06.508 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:21:06.508 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 88, 2024-08-24T21:21:06.508 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 10640, 2024-08-24T21:21:06.508 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:21:06.508 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:21:06.509 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:21:06.509 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:21:06.509 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:21:06.509 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 5, 2024-08-24T21:21:06.509 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:21:06.509 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:21:06.509 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:21:06.509 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:21:06.509 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:21:06.509 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:21:06.509 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:21:06.509 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:21:06.509 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:21:06.509 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:21:06.510 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:21:06.510 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:21:06.510 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:21:06.510 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:21:06.510 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:21:06.510 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:21:06.510 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:21:06.510 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:21:06.510 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:21:06.510 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:21:06.510 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:21:06.510 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:21:06.511 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:21:06.511 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:21:06.511 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:21:06.511 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:21:06.511 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:21:06.511 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:21:06.511 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:21:06.511 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:06.511 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:21:06.511 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:21:06.511 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:21:06.511 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:21:06.512 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:21:06.512 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:21:06.512 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:21:06.512 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:21:06.512 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:21:06.512 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:21:06.512 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:21:06.512 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:21:06.512 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:21:06.512 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:21:06.512 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:21:06.512 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:21:06.512 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:21:06.513 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:21:06.513 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:21:06.513 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:21:06.513 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:21:06.513 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:21:06.513 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:21:06.513 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:21:06.513 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:21:06.513 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:21:06.513 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:21:06.513 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:21:06.513 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:21:06.513 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:21:06.514 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:06.514 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:21:06.514 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:06.514 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:21:06.514 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:21:06.514 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:21:06.514 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:21:06.514 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:06.514 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:21:06.514 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:21:06.514 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:21:06.514 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:06.514 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:06.515 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:21:06.515 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:21:06.515 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:21:06.515 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:21:06.515 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:21:06.515 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:06.515 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:21:06.515 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:21:06.515 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:21:06.515 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:21:06.515 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:21:06.515 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:06.515 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:06.516 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:21:06.516 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:21:06.516 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:21:06.516 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:21:06.516 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:06.516 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:21:06.516 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:21:06.516 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:21:06.516 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:06.516 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:06.516 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:21:06.516 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:21:06.516 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:21:06.517 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:21:06.517 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:21:06.517 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:06.517 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:21:06.517 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:21:06.517 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:21:06.517 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:21:06.517 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:21:06.517 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:06.517 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:06.517 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:21:06.517 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:21:06.517 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:21:06.518 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:21:06.518 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:06.518 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:21:06.518 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:21:06.518 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:21:06.518 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:06.518 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:06.518 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:21:06.518 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:21:06.518 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:21:06.518 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:21:06.518 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:21:06.518 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:06.519 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:21:06.519 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:21:06.519 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:21:06.519 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:21:06.519 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:21:06.519 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:21:06.519 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:21:06.519 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:06.519 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:21:06.519 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:21:06.519 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:06.519 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:21:06.519 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:21:06.519 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:21:06.520 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:21:06.520 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:21:06.520 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:21:06.520 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:06.520 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:21:06.520 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:21:06.520 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:21:06.520 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:21:06.520 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:21:06.520 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:06.520 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:21:06.520 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:21:06.524 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:21:06.524 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:21:06.524 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:21:06.703 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:21:06.703 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:21:06.703 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:21:06.703 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:21:06.703 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 88, 2024-08-24T21:21:06.703 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 56810, 2024-08-24T21:21:06.703 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:21:06.703 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:21:06.703 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:21:06.703 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:21:06.704 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:21:06.704 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 5, 2024-08-24T21:21:06.704 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:21:06.704 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:21:06.704 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:21:06.704 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:21:06.704 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:21:06.704 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:21:06.704 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:21:06.704 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:21:06.704 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:21:06.705 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:21:06.705 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:21:06.705 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:21:06.705 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:21:06.705 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:21:06.705 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:21:06.705 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:21:06.705 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:21:06.705 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:21:06.705 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:21:06.705 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:21:06.706 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:21:06.706 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:21:06.706 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:21:06.706 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:21:06.706 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:21:06.706 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:21:06.706 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:21:06.706 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:21:06.706 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:21:06.706 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:06.707 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:21:06.707 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:21:06.708 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:21:06.708 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:21:06.708 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:21:06.708 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:21:06.708 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:21:06.708 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:21:06.708 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:21:06.708 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:21:06.708 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:21:06.708 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:21:06.708 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:21:06.708 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:21:06.709 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:21:06.709 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:21:06.709 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:21:06.709 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:21:06.709 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:21:06.709 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:21:06.709 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:21:06.709 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:21:06.709 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:21:06.709 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:21:06.709 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:21:06.709 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:21:06.709 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:21:06.710 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:21:06.710 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:21:06.710 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:21:06.710 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:06.710 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:21:06.710 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:06.710 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:21:06.710 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:21:06.710 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:21:06.710 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:21:06.710 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:06.710 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:21:06.711 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:21:06.711 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:21:06.711 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:06.711 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:06.711 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:21:06.712 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:21:06.712 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:21:06.712 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:21:06.712 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:21:06.712 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:06.712 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:21:06.712 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:21:06.712 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:21:06.712 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:21:06.712 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:21:06.712 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:06.712 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:06.712 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:21:06.712 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:21:06.713 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:21:06.713 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:21:06.713 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:06.713 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:21:06.713 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:21:06.713 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:21:06.713 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:06.713 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:06.713 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:21:06.713 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:21:06.713 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:21:06.713 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:21:06.713 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:21:06.713 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:06.714 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:21:06.714 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:21:06.714 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:21:06.714 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:21:06.714 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:21:06.714 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:06.714 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:06.714 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:21:06.714 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:21:06.714 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:21:06.714 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:21:06.714 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:06.714 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:21:06.715 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:21:06.715 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:21:06.715 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:06.715 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:06.715 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:21:06.715 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:21:06.715 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:21:06.715 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:21:06.715 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:21:06.715 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:06.715 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:21:06.715 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:21:06.715 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:21:06.716 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:21:06.716 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:21:06.716 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:21:06.716 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:21:06.716 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:06.716 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:21:06.716 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:21:06.716 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:06.716 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:21:06.716 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:21:06.716 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:21:06.716 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:21:06.716 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:21:06.716 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:21:06.717 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:06.717 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:21:06.717 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:21:06.717 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:21:06.717 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:21:06.717 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:21:06.717 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:21:06.717 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:06.717 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:21:06.717 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:21:06.717 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:21:06.717 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:21:06.717 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:21:06.718 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:06.718 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:21:06.718 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:21:06.719 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:21:06.719 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-08-24T21:21:06.719 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-08-24T21:21:07.186 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-08-24T21:21:08.188 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:21:08.188 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:21:08.641 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":88,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:21:08.658 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:21:08.659 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-08-24T21:21:08.659 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:21:08.659 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:21:08.834 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:21:08.834 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:21:08.834 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:21:08.834 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:21:08.834 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 88, 2024-08-24T21:21:08.834 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 112728, 2024-08-24T21:21:08.834 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:21:08.835 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:21:08.835 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:21:08.835 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:21:08.835 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:21:08.835 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 7, 2024-08-24T21:21:08.835 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:21:08.835 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:21:08.835 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:21:08.835 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:21:08.835 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:21:08.835 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:21:08.835 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:21:08.836 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:21:08.836 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:21:08.836 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:21:08.836 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:21:08.836 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:21:08.836 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:21:08.836 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:21:08.836 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:21:08.836 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:21:08.836 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:21:08.836 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:21:08.836 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:21:08.836 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:21:08.837 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:21:08.837 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:21:08.837 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:21:08.837 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:21:08.837 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:21:08.837 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:21:08.837 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:21:08.837 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:21:08.837 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:21:08.837 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:08.837 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:21:08.837 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:21:08.837 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:21:08.838 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:21:08.838 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:21:08.838 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:21:08.838 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:21:08.838 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:21:08.838 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:21:08.838 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:21:08.838 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:21:08.838 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:21:08.838 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:21:08.838 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:21:08.838 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:21:08.838 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:21:08.839 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:21:08.839 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:21:08.839 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:21:08.839 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:21:08.839 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:21:08.839 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:21:08.839 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:21:08.839 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:21:08.839 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:21:08.840 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:21:08.840 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:21:08.840 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:21:08.840 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:21:08.840 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:21:08.840 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:08.840 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:21:08.840 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:08.840 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:21:08.840 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:21:08.840 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:21:08.840 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:21:08.840 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:08.841 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:21:08.841 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:21:08.841 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:21:08.841 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:08.841 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:08.841 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:21:08.841 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:21:08.841 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:21:08.841 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:21:08.841 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:21:08.841 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:08.841 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:21:08.841 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:21:08.841 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:21:08.842 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:21:08.842 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:21:08.842 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:08.842 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:08.842 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:21:08.842 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:21:08.842 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:21:08.842 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:21:08.842 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:08.842 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:21:08.842 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:21:08.842 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:21:08.842 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:08.843 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:08.843 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:21:08.843 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:21:08.843 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:21:08.843 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:21:08.843 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:21:08.843 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:08.843 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:21:08.843 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:21:08.843 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:21:08.843 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:21:08.843 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:21:08.844 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:08.844 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:08.844 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:21:08.844 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:21:08.844 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:21:08.844 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:21:08.844 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:08.844 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:21:08.844 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:21:08.844 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:21:08.844 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:08.844 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:08.844 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:21:08.845 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:21:08.845 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:21:08.845 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:21:08.845 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:21:08.845 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:08.845 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:21:08.845 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:21:08.845 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:21:08.845 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:21:08.845 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:21:08.845 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:21:08.845 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:21:08.845 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:08.846 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:21:08.846 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:21:08.846 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:08.846 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:21:08.846 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:21:08.846 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:21:08.846 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:21:08.846 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:21:08.846 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:21:08.846 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:08.846 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:21:08.846 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:21:08.846 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:21:08.847 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:21:08.847 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:21:08.847 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:21:08.847 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:08.847 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:21:08.847 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:21:08.847 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-08-24T21:21:08.847 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:21:08.847 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:21:08.847 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:21:08.847 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:08.847 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:21:08.847 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:21:08.848 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:21:08.848 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:21:08.848 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:21:08.848 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:08.848 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:21:08.848 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:21:08.849 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:21:08.849 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:21:08.849 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:21:09.026 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:21:09.027 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:21:09.027 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:21:09.027 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:21:09.027 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 88, 2024-08-24T21:21:09.027 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 13159, 2024-08-24T21:21:09.027 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:21:09.027 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:21:09.027 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:21:09.027 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:21:09.027 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:21:09.027 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 7, 2024-08-24T21:21:09.028 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:21:09.028 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:21:09.028 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:21:09.028 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:21:09.028 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:21:09.028 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:21:09.028 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:21:09.028 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:21:09.028 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:21:09.028 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:21:09.028 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:21:09.028 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:21:09.028 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:21:09.029 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:21:09.029 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:21:09.029 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:21:09.029 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:21:09.029 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:21:09.029 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:21:09.029 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:21:09.029 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:21:09.029 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:21:09.029 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:21:09.029 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:21:09.029 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:21:09.029 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:21:09.030 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:21:09.030 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:21:09.030 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:21:09.030 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:09.030 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:21:09.030 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:21:09.030 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:21:09.030 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:21:09.030 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:21:09.031 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:21:09.031 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:21:09.031 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:21:09.031 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:21:09.031 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:21:09.031 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:21:09.031 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:21:09.031 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:21:09.031 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:21:09.031 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:21:09.031 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:21:09.031 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:21:09.032 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:21:09.032 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:21:09.032 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:21:09.032 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:21:09.032 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:21:09.032 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:21:09.032 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:21:09.032 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:21:09.032 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:21:09.032 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:21:09.032 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:21:09.032 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:21:09.032 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:21:09.033 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:09.033 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:21:09.033 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:09.033 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:21:09.033 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:21:09.033 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:21:09.033 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:21:09.033 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:09.033 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:21:09.033 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:21:09.033 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:21:09.033 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:09.033 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:09.034 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:21:09.034 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:21:09.034 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:21:09.034 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:21:09.034 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:21:09.034 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:09.034 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:21:09.034 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:21:09.034 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:21:09.034 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:21:09.034 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:21:09.034 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:09.035 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:09.035 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:21:09.035 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:21:09.035 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:21:09.035 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:21:09.035 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:09.035 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:21:09.035 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:21:09.035 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:21:09.035 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:09.035 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:09.035 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:21:09.035 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:21:09.036 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:21:09.036 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:21:09.036 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:21:09.036 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:09.036 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:21:09.036 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:21:09.036 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:21:09.036 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:21:09.036 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:21:09.036 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:09.036 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:09.036 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:21:09.036 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:21:09.037 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:21:09.037 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:21:09.037 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:09.037 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:21:09.037 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:21:09.037 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:21:09.037 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:09.037 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:09.037 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:21:09.037 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:21:09.037 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:21:09.037 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:21:09.037 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:21:09.037 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:09.038 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:21:09.038 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:21:09.038 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:21:09.038 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:21:09.038 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:21:09.038 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:21:09.038 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:21:09.038 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:09.038 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:21:09.038 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:21:09.038 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:09.038 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:21:09.038 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:21:09.039 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:21:09.039 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:21:09.039 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:21:09.039 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:21:09.039 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:09.039 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:21:09.039 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:21:09.039 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:21:09.039 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:21:09.039 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:21:09.039 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:09.039 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:21:09.039 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:21:09.041 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:21:09.042 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:21:09.042 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:21:09.220 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:21:09.220 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:21:09.220 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:21:09.220 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:21:09.220 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 88, 2024-08-24T21:21:09.220 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 59327, 2024-08-24T21:21:09.220 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:21:09.220 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:21:09.221 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:21:09.221 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:21:09.221 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:21:09.221 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 8, 2024-08-24T21:21:09.221 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:21:09.221 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:21:09.221 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:21:09.221 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:21:09.221 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:21:09.221 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:21:09.221 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:21:09.221 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:21:09.221 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:21:09.222 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:21:09.222 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:21:09.222 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:21:09.222 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:21:09.222 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:21:09.222 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:21:09.222 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:21:09.222 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:21:09.222 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:21:09.222 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:21:09.222 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:21:09.222 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:21:09.223 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:21:09.223 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:21:09.223 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:21:09.223 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:21:09.223 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:21:09.223 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:21:09.223 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:21:09.223 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:21:09.223 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:09.223 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:21:09.223 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:21:09.223 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:21:09.224 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:21:09.224 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:21:09.224 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:21:09.224 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:21:09.224 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:21:09.224 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:21:09.224 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:21:09.224 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:21:09.224 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:21:09.224 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:21:09.224 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:21:09.224 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:21:09.225 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:21:09.225 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:21:09.225 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:21:09.225 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:21:09.225 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:21:09.225 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:21:09.225 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:21:09.225 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:21:09.225 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:21:09.225 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:21:09.225 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:21:09.225 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:21:09.225 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:21:09.226 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:21:09.226 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:21:09.226 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:09.226 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:21:09.226 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:09.226 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:21:09.226 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:21:09.226 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:21:09.226 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:21:09.226 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:09.226 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:21:09.226 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:21:09.227 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:21:09.227 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:09.227 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:09.227 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:21:09.227 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:21:09.227 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:21:09.227 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:21:09.227 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:21:09.227 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:09.227 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:21:09.227 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:21:09.227 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:21:09.227 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:21:09.228 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:21:09.228 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:09.228 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:09.228 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:21:09.228 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:21:09.228 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:21:09.228 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:21:09.228 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:09.228 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:21:09.229 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:21:09.229 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:21:09.229 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:09.229 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:09.229 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:21:09.229 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:21:09.229 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:21:09.229 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:21:09.229 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:21:09.229 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:09.229 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:21:09.229 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:21:09.229 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:21:09.230 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:21:09.230 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:21:09.230 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:09.230 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:09.230 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:21:09.230 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:21:09.230 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:21:09.230 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:21:09.230 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:09.230 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:21:09.230 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:21:09.230 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:21:09.231 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:09.231 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:09.231 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:21:09.231 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:21:09.231 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:21:09.231 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:21:09.231 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:21:09.231 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:09.231 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:21:09.231 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:21:09.232 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:21:09.232 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:21:09.232 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:21:09.232 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:21:09.232 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:21:09.232 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:09.232 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:21:09.232 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:21:09.232 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:09.232 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:21:09.232 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:21:09.232 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:21:09.232 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:21:09.233 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:21:09.233 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:21:09.233 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:09.233 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:21:09.233 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:21:09.233 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:21:09.233 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:21:09.233 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:21:09.233 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:21:09.233 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:09.233 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:21:09.233 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:21:09.233 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:21:09.234 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:21:09.234 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:21:09.234 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:09.234 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:21:09.234 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:21:09.235 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:21:09.235 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-08-24T21:21:09.235 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-08-24T21:21:09.235 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-08-24T21:21:09.235 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-08-24T21:21:09.236 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-08-24T21:21:09.236 INFO:teuthology.orchestra.run:waiting for 300 2024-08-24T21:21:09.258 INFO:tasks.ceph.mon.a:Stopped 2024-08-24T21:21:09.258 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-08-24T21:21:09.258 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:21:09.734 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":88,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":8,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:21:10.540 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:21:10.565 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=3527177533762880cf6e66aa22e90a5b 2024-08-24T21:21:10.566 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap7 - 2024-08-24T21:21:10.567 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:21:10.567 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:21:12.753 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:21:13.208 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":88,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:21:14.838 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:21:14.848 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=3527177533762880cf6e66aa22e90a5b 2024-08-24T21:21:14.849 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ 3527177533762880cf6e66aa22e90a5b != \3\5\2\7\1\7\7\5\3\3\7\6\2\8\8\0\c\f\6\e\6\6\a\a\2\2\e\9\0\a\5\b ]] 2024-08-24T21:21:14.849 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap7 2024-08-24T21:21:14.849 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap7 2024-08-24T21:21:14.849 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap7 2024-08-24T21:21:14.955 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:21:14.967 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:21:14.968 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap7 2024-08-24T21:21:14.968 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:21:15.045 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:21:15.046 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:21:15.046 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:21:15.046 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:21:15.046 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:21:15.046 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap8.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:21:16.226 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:21:16.841 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":88,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:21:19.860 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:21:24.066 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 5% complete... Importing image diff: 11% complete... Importing image diff: 16% complete... Importing image diff: 22% complete... Importing image diff: 27% complete... Importing image diff: 33% complete... Importing image diff: 38% complete... Importing image diff: 44% complete... Importing image diff: 50% complete... Importing image diff: 55% complete... Importing image diff: 61% complete... Importing image diff: 66% complete... Importing image diff: 72% complete... Importing image diff: 77% complete... Importing image diff: 83% complete... Importing image diff: 88% complete... Importing image diff: 94% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2024-08-24T21:21:24.087 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap8 - 2024-08-24T21:21:24.087 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:21:24.088 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:21:24.300 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":90,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:21:24.318 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-08-24T21:21:24.319 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-08-24T21:21:24.319 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:21:24.494 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:21:24.494 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:21:24.494 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:21:24.494 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:21:24.494 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 90, 2024-08-24T21:21:24.494 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 28626, 2024-08-24T21:21:24.495 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:21:24.495 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:21:24.495 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:21:24.495 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:21:24.495 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:21:24.495 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:21:24.495 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:21:24.495 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:21:24.495 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:21:24.495 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:21:24.495 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:21:24.495 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:21:24.495 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:21:24.496 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:21:24.496 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:21:24.496 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:21:24.496 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:21:24.496 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:21:24.496 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:21:24.496 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:21:24.496 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:21:24.496 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:21:24.496 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:21:24.496 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:21:24.496 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:21:24.496 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:21:24.497 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:21:24.497 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:21:24.497 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:21:24.497 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:21:24.497 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:21:24.497 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:21:24.497 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:21:24.497 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:21:24.497 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:24.497 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:21:24.497 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:21:24.498 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:21:24.498 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:21:24.498 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:21:24.498 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:21:24.498 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:21:24.498 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:21:24.498 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:21:24.498 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:21:24.498 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:21:24.498 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:21:24.498 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:21:24.498 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:21:24.499 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:21:24.499 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:21:24.499 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:21:24.499 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:21:24.499 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:21:24.499 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:21:24.499 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:21:24.499 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:21:24.499 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:21:24.499 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:21:24.499 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:21:24.499 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:21:24.500 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:21:24.500 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:21:24.500 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:21:24.500 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:21:24.500 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:24.500 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:21:24.500 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:24.500 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:21:24.500 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:21:24.500 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:21:24.500 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:21:24.500 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:24.501 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:21:24.501 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:21:24.501 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:21:24.501 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:24.501 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:24.501 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:21:24.501 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:21:24.501 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:21:24.501 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:21:24.501 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:21:24.501 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:24.501 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:21:24.501 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:21:24.502 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:21:24.502 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:21:24.502 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:21:24.502 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:24.502 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:24.502 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:21:24.502 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:21:24.502 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:21:24.502 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:21:24.502 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:24.502 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:21:24.502 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:21:24.503 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:21:24.503 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:24.503 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:24.503 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:21:24.503 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:21:24.503 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:21:24.503 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:21:24.503 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:21:24.503 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:24.503 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:21:24.503 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:21:24.503 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:21:24.504 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:21:24.504 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:21:24.504 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:24.504 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:24.504 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:21:24.504 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:21:24.504 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:21:24.504 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:21:24.504 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:24.504 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:21:24.504 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:21:24.504 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:21:24.504 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:24.505 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:24.505 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:21:24.505 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:21:24.505 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:21:24.505 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:21:24.505 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:21:24.505 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:24.505 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:21:24.505 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:21:24.505 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:21:24.505 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:21:24.505 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:21:24.506 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:21:24.506 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:21:24.506 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:24.506 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:21:24.506 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:21:24.506 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:24.506 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:21:24.506 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:21:24.506 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:21:24.506 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:21:24.506 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:21:24.506 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:21:24.507 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:24.507 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:21:24.507 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:21:24.507 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:21:24.507 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:21:24.507 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:21:24.507 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:21:24.507 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:24.507 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:21:24.507 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:21:24.507 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-08-24T21:21:24.507 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:21:24.508 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:21:24.508 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:21:24.508 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:24.508 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:21:24.508 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:21:24.508 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:21:24.508 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:21:24.508 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:21:24.508 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:24.508 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:21:24.508 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:21:24.509 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:21:24.509 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-08-24T21:21:24.510 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:21:24.684 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:21:24.685 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:21:24.685 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:21:24.685 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:21:24.685 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 90, 2024-08-24T21:21:24.685 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 74793, 2024-08-24T21:21:24.685 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:21:24.685 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:21:24.685 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:21:24.685 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:21:24.685 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:21:24.686 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:21:24.686 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:21:24.686 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:21:24.686 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:21:24.686 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:21:24.686 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:21:24.686 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:21:24.686 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:21:24.686 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:21:24.686 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:21:24.687 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:21:24.687 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:21:24.687 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:21:24.687 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:21:24.687 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:21:24.687 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:21:24.687 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:21:24.687 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:21:24.687 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:21:24.687 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:21:24.687 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:21:24.687 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:21:24.688 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:21:24.688 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:21:24.688 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:21:24.688 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:21:24.688 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:21:24.688 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:21:24.688 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:21:24.688 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:24.688 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:21:24.688 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:21:24.688 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:21:24.689 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:21:24.689 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:21:24.689 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:21:24.689 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:21:24.689 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:21:24.689 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:21:24.689 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:21:24.689 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:21:24.689 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:21:24.689 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:21:24.689 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:21:24.690 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:21:24.690 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:21:24.690 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:21:24.690 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:21:24.690 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:21:24.690 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:21:24.690 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:21:24.690 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:21:24.690 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:21:24.690 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:21:24.690 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:21:24.691 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:21:24.691 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:21:24.691 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:21:24.691 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:21:24.691 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:21:24.691 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:24.691 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:21:24.691 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:24.691 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:21:24.691 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:21:24.692 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:21:24.692 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:21:24.692 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:24.692 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:21:24.692 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:21:24.692 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:21:24.692 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:24.692 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:24.692 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:21:24.692 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:21:24.692 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:21:24.693 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:21:24.693 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:21:24.693 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:24.693 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:21:24.693 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:21:24.693 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:21:24.693 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:21:24.693 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:21:24.694 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:24.694 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:24.694 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:21:24.694 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:21:24.694 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:21:24.694 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:21:24.694 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:24.694 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:21:24.694 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:21:24.694 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:21:24.694 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:24.695 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:24.695 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:21:24.695 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:21:24.695 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:21:24.695 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:21:24.695 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:21:24.695 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:24.695 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:21:24.695 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:21:24.695 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:21:24.695 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:21:24.696 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:21:24.696 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:24.696 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:24.696 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:21:24.696 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:21:24.696 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:21:24.696 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:21:24.696 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:24.696 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:21:24.696 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:21:24.696 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:21:24.697 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:24.697 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:24.697 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:21:24.697 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:21:24.697 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:21:24.697 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:21:24.697 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:21:24.697 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:24.697 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:21:24.697 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:21:24.697 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:21:24.697 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:21:24.698 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:21:24.698 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:21:24.698 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:21:24.698 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:24.698 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:21:24.698 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:21:24.698 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:24.698 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:21:24.698 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:21:24.698 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:21:24.698 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:21:24.699 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:21:24.699 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:21:24.699 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:24.699 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:21:24.699 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:21:24.699 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 6 2024-08-24T21:21:24.699 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:21:24.699 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:21:24.699 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:21:24.699 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:21:24.699 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:21:24.700 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:21:24.700 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-08-24T21:21:24.700 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:21:24.700 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:21:24.700 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:21:24.700 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:21:24.700 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:21:24.701 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:21:24.701 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-08-24T21:21:28.628 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:21:28.672 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=227bd12f6ff675a7b2679ec3163812e7 2024-08-24T21:21:28.673 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap8 - 2024-08-24T21:21:28.674 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:21:28.674 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:21:33.211 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:21:33.221 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=227bd12f6ff675a7b2679ec3163812e7 2024-08-24T21:21:33.221 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ 227bd12f6ff675a7b2679ec3163812e7 != \2\2\7\b\d\1\2\f\6\f\f\6\7\5\a\7\b\2\6\7\9\e\c\3\1\6\3\8\1\2\e\7 ]] 2024-08-24T21:21:33.221 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap8 2024-08-24T21:21:33.221 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap8 2024-08-24T21:21:33.221 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap8 2024-08-24T21:21:33.329 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:21:33.341 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:21:33.341 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap8 2024-08-24T21:21:33.342 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:21:33.430 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:21:33.430 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:21:33.430 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:21:33.430 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:21:33.430 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:21:33.430 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap9.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:21:36.096 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 4% complete... Importing image diff: 9% complete... Importing image diff: 13% complete... Importing image diff: 18% complete... Importing image diff: 22% complete... Importing image diff: 27% complete... Importing image diff: 31% complete... Importing image diff: 36% complete... Importing image diff: 40% complete... Importing image diff: 45% complete... Importing image diff: 49% complete... Importing image diff: 54% complete... Importing image diff: 58% complete... Importing image diff: 63% complete... Importing image diff: 67% complete... Importing image diff: 72% complete... Importing image diff: 76% complete... Importing image diff: 81% complete... Importing image diff: 86% complete... Importing image diff: 90% complete... Importing image diff: 95% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2024-08-24T21:21:36.114 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap9 - 2024-08-24T21:21:36.114 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:21:36.115 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:21:41.016 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:21:41.087 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=ad3df6422d40a3e59ad6c49ca3d9a15d 2024-08-24T21:21:41.089 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap9 - 2024-08-24T21:21:41.090 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:21:41.090 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:21:44.703 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-08-24T21:21:44.703 INFO:tasks.ceph.mon.a:Restarting daemon 2024-08-24T21:21:44.703 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-08-24T21:21:44.708 INFO:tasks.ceph.mon.a:Started 2024-08-24T21:21:44.708 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:21:44.708 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:21:45.167 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":90,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":21,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:21:45.843 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:21:45.854 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=ad3df6422d40a3e59ad6c49ca3d9a15d 2024-08-24T21:21:45.854 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ ad3df6422d40a3e59ad6c49ca3d9a15d != \a\d\3\d\f\6\4\2\2\d\4\0\a\3\e\5\9\a\d\6\c\4\9\c\a\3\d\9\a\1\5\d ]] 2024-08-24T21:21:45.854 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap9 2024-08-24T21:21:45.855 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap9 2024-08-24T21:21:45.855 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap9 2024-08-24T21:21:45.969 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:21:45.981 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:21:45.982 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap9 2024-08-24T21:21:45.982 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:21:46.061 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:21:46.061 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:21:46.061 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:21:46.061 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:21:46.061 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:21:46.061 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap10.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:21:47.121 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 47% complete... Importing image diff: 48% complete... Importing image diff: 49% complete... Importing image diff: 50% complete... Importing image diff: 51% complete... Importing image diff: 52% complete... Importing image diff: 53% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2024-08-24T21:21:47.140 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap10 - 2024-08-24T21:21:47.140 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:21:47.141 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:21:48.186 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:21:48.639 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":90,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":24,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:21:51.657 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:21:51.921 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:21:51.976 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=3c33bc9d586a9e62a2c6b8ab3767786c 2024-08-24T21:21:51.978 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap10 - 2024-08-24T21:21:51.978 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:21:51.978 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:21:52.111 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":90,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":28,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:21:55.130 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:21:55.592 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":90,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":31,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:21:56.767 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:21:56.776 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=3c33bc9d586a9e62a2c6b8ab3767786c 2024-08-24T21:21:56.776 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ 3c33bc9d586a9e62a2c6b8ab3767786c != \3\c\3\3\b\c\9\d\5\8\6\a\9\e\6\2\a\2\c\6\b\8\a\b\3\7\6\7\7\8\6\c ]] 2024-08-24T21:21:56.776 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap10 2024-08-24T21:21:56.776 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap10 2024-08-24T21:21:56.776 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap10 2024-08-24T21:21:56.883 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:21:56.896 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:21:56.897 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap10 2024-08-24T21:21:56.897 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:21:56.983 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:21:56.983 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:21:56.983 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:21:56.983 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:21:56.983 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:21:56.983 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap11.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:21:58.154 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 50% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2024-08-24T21:21:58.174 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap11 - 2024-08-24T21:21:58.174 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:21:58.174 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:21:58.611 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:21:59.052 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":90,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":35,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:22:02.072 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:22:02.527 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":90,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":38,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:22:03.115 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:22:03.177 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=086d086d0a6d1fd2185ccb853d186268 2024-08-24T21:22:03.178 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap11 - 2024-08-24T21:22:03.178 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:22:03.179 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:22:05.545 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:22:06.010 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":90,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":42,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:22:07.958 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:22:07.968 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=086d086d0a6d1fd2185ccb853d186268 2024-08-24T21:22:07.968 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ 086d086d0a6d1fd2185ccb853d186268 != \0\8\6\d\0\8\6\d\0\a\6\d\1\f\d\2\1\8\5\c\c\b\8\5\3\d\1\8\6\2\6\8 ]] 2024-08-24T21:22:07.969 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap11 2024-08-24T21:22:07.969 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap11 2024-08-24T21:22:07.969 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap11 2024-08-24T21:22:08.087 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:22:08.098 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:22:08.099 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap11 2024-08-24T21:22:08.100 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:22:08.178 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:22:08.178 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:22:08.178 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:22:08.178 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:22:08.178 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:22:08.178 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap12.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:22:09.030 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:22:09.182 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 52% complete... Importing image diff: 77% complete... Importing image diff: 97% complete... Importing image diff: 100% complete...done. 2024-08-24T21:22:09.202 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap12 - 2024-08-24T21:22:09.202 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:22:09.203 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:22:09.501 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":90,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":45,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:22:12.519 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:22:12.956 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":94,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:22:12.979 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:22:12.979 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:22:12.979 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:22:13.181 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:22:13.181 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:22:13.181 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:22:13.181 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:22:13.182 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 94, 2024-08-24T21:22:13.182 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 28320, 2024-08-24T21:22:13.182 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:22:13.182 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:22:13.182 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:22:13.182 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:22:13.182 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:22:13.182 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 2, 2024-08-24T21:22:13.182 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:22:13.182 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:22:13.182 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:22:13.182 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:22:13.183 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:22:13.183 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:22:13.183 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:22:13.183 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:22:13.183 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:22:13.183 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:22:13.183 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:22:13.183 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:22:13.183 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:22:13.183 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:22:13.183 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:22:13.183 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:22:13.184 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:22:13.184 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:22:13.184 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:22:13.184 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:22:13.184 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:22:13.184 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:22:13.184 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:22:13.184 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:22:13.184 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:22:13.184 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:22:13.184 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:22:13.184 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:22:13.185 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:22:13.185 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:13.185 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:22:13.185 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:22:13.185 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:22:13.185 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:22:13.185 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:22:13.185 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:22:13.185 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:22:13.185 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:22:13.186 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:22:13.186 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:22:13.186 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:22:13.186 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:22:13.186 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:22:13.186 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:22:13.186 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:22:13.186 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:22:13.186 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:22:13.186 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:22:13.186 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:22:13.187 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:22:13.187 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:22:13.187 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:22:13.187 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:22:13.187 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:22:13.187 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:22:13.187 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:22:13.187 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:22:13.187 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:22:13.187 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:22:13.187 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:22:13.187 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:13.187 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:22:13.188 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:13.188 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:22:13.188 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:22:13.188 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:22:13.188 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:22:13.188 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:13.188 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:22:13.188 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:22:13.188 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:22:13.188 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:13.188 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:13.188 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:22:13.188 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:22:13.189 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:22:13.189 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:22:13.189 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:22:13.189 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:13.189 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:22:13.189 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:22:13.189 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:22:13.189 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:22:13.189 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:22:13.190 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:13.190 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:13.190 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:22:13.190 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:22:13.190 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:22:13.190 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:22:13.190 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:13.190 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:22:13.191 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:22:13.191 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:22:13.191 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:13.191 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:13.191 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:22:13.191 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:22:13.191 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:22:13.191 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:22:13.191 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:22:13.191 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:13.192 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:22:13.192 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:22:13.192 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:22:13.192 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:22:13.192 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:22:13.192 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:13.192 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:13.192 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:22:13.192 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:22:13.192 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:22:13.192 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:22:13.192 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:13.192 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:22:13.192 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:22:13.193 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:22:13.193 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:13.193 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:13.193 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:22:13.193 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:22:13.193 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:22:13.193 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:22:13.193 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:22:13.193 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:13.193 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:22:13.193 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:22:13.193 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:22:13.193 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:22:13.194 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:22:13.194 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:22:13.194 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:22:13.194 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:13.194 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:22:13.194 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:22:13.194 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:13.194 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:22:13.194 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:22:13.194 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:22:13.194 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:22:13.195 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:22:13.195 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:22:13.195 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:13.195 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:22:13.195 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:22:13.195 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:22:13.196 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:22:13.196 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:22:13.196 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:13.196 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:22:13.196 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:22:13.198 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:22:13.198 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:22:13.198 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:22:13.379 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:22:13.379 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:22:13.379 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:22:13.379 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:22:13.379 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 94, 2024-08-24T21:22:13.379 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 77511, 2024-08-24T21:22:13.379 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:22:13.379 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:22:13.379 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:22:13.380 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:22:13.380 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:22:13.380 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 3, 2024-08-24T21:22:13.380 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:22:13.380 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:22:13.380 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:22:13.380 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:22:13.380 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:22:13.380 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:22:13.380 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:22:13.380 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:22:13.381 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:22:13.381 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:22:13.381 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:22:13.381 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:22:13.381 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:22:13.381 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:22:13.381 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:22:13.381 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:22:13.381 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:22:13.381 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:22:13.381 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:22:13.381 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:22:13.381 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:22:13.382 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:22:13.382 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:22:13.382 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:22:13.382 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:22:13.382 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:22:13.382 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:22:13.382 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:22:13.382 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:22:13.382 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:13.382 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:22:13.382 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:22:13.382 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:22:13.383 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:22:13.383 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:22:13.383 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:22:13.383 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:22:13.383 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:22:13.383 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:22:13.383 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:22:13.383 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:22:13.383 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:22:13.384 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:22:13.384 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:22:13.384 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:22:13.384 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:22:13.384 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:22:13.384 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:22:13.384 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:22:13.384 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:22:13.384 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:22:13.384 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:22:13.384 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:22:13.385 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:22:13.385 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:22:13.385 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:22:13.385 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:22:13.385 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:22:13.385 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:22:13.385 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:22:13.385 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:13.385 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:22:13.385 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:13.385 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:22:13.385 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:22:13.386 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:22:13.386 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:22:13.386 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:13.386 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:22:13.386 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:22:13.386 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:22:13.386 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:13.386 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:13.386 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:22:13.387 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:22:13.387 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:22:13.387 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:22:13.387 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:22:13.387 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:13.387 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:22:13.387 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:22:13.387 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:22:13.387 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:22:13.387 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:22:13.387 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:13.387 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:13.387 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:22:13.388 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:22:13.388 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:22:13.388 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:22:13.388 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:13.388 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:22:13.388 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:22:13.388 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:22:13.388 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:13.388 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:13.388 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:22:13.388 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:22:13.388 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:22:13.388 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:22:13.389 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:22:13.389 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:13.389 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:22:13.389 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:22:13.389 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:22:13.389 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:22:13.389 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:22:13.389 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:13.389 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:13.389 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:22:13.389 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:22:13.389 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:22:13.389 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:22:13.390 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:13.390 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:22:13.390 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:22:13.390 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:22:13.390 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:13.390 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:13.390 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:22:13.390 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:22:13.390 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:22:13.391 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:22:13.391 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:22:13.391 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:13.391 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:22:13.391 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:22:13.391 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:22:13.391 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:22:13.391 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:22:13.391 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:22:13.391 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:22:13.391 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:13.391 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:22:13.391 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:22:13.391 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:13.392 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:22:13.392 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:22:13.392 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:22:13.392 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:22:13.392 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:22:13.392 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:22:13.392 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:13.392 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:22:13.392 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:22:13.392 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:22:13.392 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:22:13.392 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:22:13.392 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:22:13.393 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:13.393 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:22:13.393 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:22:13.393 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:22:13.393 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:22:13.393 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:22:13.393 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:22:13.393 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:13.393 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:22:13.393 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:22:13.393 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:22:13.394 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:22:13.394 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:22:13.394 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:13.394 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:22:13.394 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:22:13.395 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:22:13.395 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:22:13.396 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:22:13.571 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:22:13.571 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:22:13.571 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:22:13.572 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:22:13.572 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 94, 2024-08-24T21:22:13.572 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 123679, 2024-08-24T21:22:13.572 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:22:13.572 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:22:13.572 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:22:13.572 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:22:13.572 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:22:13.572 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 3, 2024-08-24T21:22:13.572 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:22:13.572 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:22:13.572 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:22:13.572 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:22:13.573 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:22:13.573 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:22:13.573 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:22:13.573 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:22:13.573 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:22:13.573 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:22:13.573 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:22:13.573 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:22:13.573 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:22:13.573 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:22:13.573 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:22:13.573 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:22:13.573 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:22:13.573 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:22:13.574 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:22:13.574 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:22:13.574 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:22:13.574 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:22:13.574 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:22:13.574 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:22:13.574 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:22:13.574 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:22:13.574 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:22:13.574 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:22:13.575 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:22:13.575 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:13.575 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:22:13.575 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:22:13.575 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:22:13.575 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:22:13.575 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:22:13.575 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:22:13.575 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:22:13.575 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:22:13.576 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:22:13.576 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:22:13.576 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:22:13.576 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:22:13.576 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:22:13.576 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:22:13.576 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:22:13.576 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:22:13.576 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:22:13.576 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:22:13.576 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:22:13.576 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:22:13.576 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:22:13.577 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:22:13.577 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:22:13.577 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:22:13.577 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:22:13.577 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:22:13.577 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:22:13.577 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:22:13.577 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:22:13.577 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:22:13.578 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:13.578 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:22:13.578 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:13.578 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:22:13.578 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:22:13.578 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:22:13.578 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:22:13.578 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:13.578 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:22:13.578 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:22:13.578 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:22:13.578 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:13.579 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:13.579 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:22:13.579 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:22:13.579 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:22:13.579 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:22:13.579 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:22:13.579 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:13.579 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:22:13.579 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:22:13.579 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:22:13.580 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:22:13.580 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:22:13.580 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:13.580 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:13.580 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:22:13.580 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:22:13.580 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:22:13.580 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:22:13.580 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:13.580 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:22:13.580 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:22:13.580 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:22:13.580 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:13.581 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:13.581 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:22:13.581 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:22:13.581 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:22:13.581 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:22:13.581 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:22:13.581 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:13.581 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:22:13.581 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:22:13.581 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:22:13.581 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:22:13.582 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:22:13.582 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:13.582 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:13.582 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:22:13.582 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:22:13.582 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:22:13.582 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:22:13.582 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:13.582 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:22:13.582 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:22:13.582 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:22:13.582 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:13.582 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:13.582 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:22:13.583 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:22:13.583 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:22:13.583 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:22:13.583 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:22:13.583 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:13.583 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:22:13.583 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:22:13.583 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:22:13.583 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:22:13.583 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:22:13.584 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:22:13.584 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:22:13.584 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:13.584 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:22:13.584 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:22:13.584 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:13.584 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:22:13.584 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:22:13.584 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:22:13.584 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:22:13.584 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:22:13.585 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:22:13.585 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:13.585 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:22:13.585 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:22:13.585 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 6 2024-08-24T21:22:13.585 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:22:13.585 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:22:13.585 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:22:13.585 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:13.585 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:22:13.585 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:22:13.585 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-08-24T21:22:13.586 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:22:13.586 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:22:13.586 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:13.586 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:22:13.586 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:22:13.587 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:22:13.587 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-08-24T21:22:13.587 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-08-24T21:22:13.974 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:22:14.032 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=086d086d0a6d1fd2185ccb853d186268 2024-08-24T21:22:14.033 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap12 - 2024-08-24T21:22:14.033 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:22:14.034 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:22:14.063 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-08-24T21:22:15.064 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:22:15.064 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:22:15.510 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":94,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:22:15.529 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:22:15.529 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-08-24T21:22:15.529 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:22:15.529 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:22:15.709 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:22:15.709 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:22:15.709 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:22:15.709 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:22:15.709 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 94, 2024-08-24T21:22:15.709 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 30847, 2024-08-24T21:22:15.709 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:22:15.709 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:22:15.709 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:22:15.709 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:22:15.710 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:22:15.710 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 5, 2024-08-24T21:22:15.710 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:22:15.710 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:22:15.710 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:22:15.710 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:22:15.710 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:22:15.710 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:22:15.710 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:22:15.710 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:22:15.710 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:22:15.711 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:22:15.711 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:22:15.711 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:22:15.711 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:22:15.711 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:22:15.711 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:22:15.711 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:22:15.711 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:22:15.711 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:22:15.711 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:22:15.711 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:22:15.711 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:22:15.712 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:22:15.712 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:22:15.712 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:22:15.712 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:22:15.712 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:22:15.712 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:22:15.712 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:22:15.712 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:22:15.712 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:15.712 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:22:15.712 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:22:15.712 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:22:15.712 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:22:15.713 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:22:15.713 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:22:15.713 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:22:15.713 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:22:15.713 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:22:15.713 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:22:15.713 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:22:15.713 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:22:15.713 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:22:15.713 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:22:15.713 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:22:15.713 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:22:15.714 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:22:15.714 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:22:15.714 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:22:15.714 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:22:15.714 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:22:15.714 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:22:15.714 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:22:15.714 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:22:15.714 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:22:15.714 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:22:15.714 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:22:15.714 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:22:15.715 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:22:15.715 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:22:15.715 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:15.715 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:22:15.715 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:15.715 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:22:15.715 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:22:15.715 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:22:15.715 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:22:15.715 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:15.716 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:22:15.716 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:22:15.716 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:22:15.716 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:15.716 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:15.716 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:22:15.716 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:22:15.716 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:22:15.716 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:22:15.716 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:22:15.716 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:15.716 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:22:15.716 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:22:15.717 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:22:15.717 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:22:15.717 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:22:15.717 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:15.717 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:15.717 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:22:15.717 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:22:15.717 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:22:15.717 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:22:15.717 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:15.717 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:22:15.717 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:22:15.717 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:22:15.718 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:15.718 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:15.718 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:22:15.718 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:22:15.718 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:22:15.718 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:22:15.718 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:22:15.718 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:15.718 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:22:15.718 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:22:15.718 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:22:15.718 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:22:15.719 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:22:15.719 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:15.719 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:15.719 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:22:15.719 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:22:15.719 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:22:15.719 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:22:15.719 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:15.719 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:22:15.719 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:22:15.719 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:22:15.719 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:15.719 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:15.720 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:22:15.720 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:22:15.720 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:22:15.720 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:22:15.720 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:22:15.720 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:15.720 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:22:15.721 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:22:15.721 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:22:15.721 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:22:15.721 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:22:15.721 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:22:15.721 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:22:15.722 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:15.722 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:22:15.722 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:22:15.722 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:15.722 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:22:15.723 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:22:15.723 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:22:15.723 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:22:15.723 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:22:15.723 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:22:15.723 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:15.724 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:22:15.724 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:22:15.724 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:22:15.724 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:22:15.724 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:22:15.724 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:15.724 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:22:15.724 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:22:15.725 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:22:15.725 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:22:15.726 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:22:15.906 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:22:15.907 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:22:15.907 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:22:15.907 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:22:15.907 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 94, 2024-08-24T21:22:15.907 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 80037, 2024-08-24T21:22:15.907 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:22:15.907 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:22:15.907 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:22:15.907 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:22:15.907 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:22:15.907 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 5, 2024-08-24T21:22:15.907 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:22:15.908 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:22:15.908 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:22:15.908 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:22:15.908 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:22:15.908 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:22:15.908 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:22:15.908 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:22:15.908 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:22:15.908 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:22:15.908 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:22:15.908 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:22:15.908 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:22:15.908 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:22:15.908 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:22:15.909 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:22:15.909 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:22:15.909 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:22:15.909 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:22:15.909 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:22:15.909 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:22:15.909 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:22:15.909 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:22:15.909 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:22:15.909 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:22:15.909 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:22:15.910 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:22:15.910 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:22:15.910 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:22:15.910 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:15.910 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:22:15.910 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:22:15.910 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:22:15.910 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:22:15.910 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:22:15.910 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:22:15.910 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:22:15.910 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:22:15.910 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:22:15.911 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:22:15.911 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:22:15.911 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:22:15.911 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:22:15.911 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:22:15.911 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:22:15.911 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:22:15.911 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:22:15.911 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:22:15.911 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:22:15.911 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:22:15.912 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:22:15.912 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:22:15.912 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:22:15.912 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:22:15.912 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:22:15.912 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:22:15.912 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:22:15.912 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:22:15.912 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:22:15.912 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:22:15.913 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:15.913 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:22:15.913 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:15.913 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:22:15.913 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:22:15.913 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:22:15.913 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:22:15.913 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:15.913 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:22:15.913 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:22:15.913 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:22:15.913 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:15.913 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:15.914 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:22:15.914 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:22:15.914 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:22:15.914 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:22:15.914 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:22:15.914 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:15.914 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:22:15.914 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:22:15.914 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:22:15.914 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:22:15.914 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:22:15.914 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:15.914 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:15.915 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:22:15.915 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:22:15.915 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:22:15.915 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:22:15.915 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:15.915 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:22:15.915 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:22:15.915 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:22:15.915 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:15.915 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:15.915 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:22:15.915 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:22:15.915 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:22:15.916 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:22:15.916 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:22:15.916 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:15.916 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:22:15.916 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:22:15.916 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:22:15.916 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:22:15.916 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:22:15.916 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:15.916 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:15.916 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:22:15.916 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:22:15.917 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:22:15.917 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:22:15.917 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:15.917 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:22:15.917 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:22:15.917 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:22:15.917 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:15.917 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:15.917 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:22:15.917 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:22:15.918 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:22:15.918 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:22:15.918 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:22:15.918 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:15.918 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:22:15.918 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:22:15.918 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:22:15.918 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:22:15.918 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:22:15.918 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:22:15.918 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:22:15.918 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:15.919 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:22:15.919 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:22:15.919 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:15.919 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:22:15.919 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:22:15.919 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:22:15.919 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:22:15.919 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:22:15.919 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:22:15.919 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:15.919 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:22:15.919 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:22:15.919 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:22:15.920 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:22:15.920 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:22:15.920 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:22:15.920 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:15.920 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:22:15.920 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:22:15.920 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:22:15.920 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:22:15.920 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:22:15.920 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:22:15.920 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:15.920 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:22:15.920 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:22:15.920 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:22:15.921 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:22:15.921 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:22:15.921 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:15.921 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:22:15.921 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:22:15.922 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:22:15.922 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:22:15.923 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:22:16.102 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:22:16.102 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:22:16.102 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:22:16.102 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:22:16.102 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 94, 2024-08-24T21:22:16.102 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 126209, 2024-08-24T21:22:16.103 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:22:16.103 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:22:16.103 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:22:16.103 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:22:16.103 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:22:16.103 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 5, 2024-08-24T21:22:16.103 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:22:16.103 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:22:16.103 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:22:16.103 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:22:16.103 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:22:16.103 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:22:16.104 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:22:16.104 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:22:16.104 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:22:16.104 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:22:16.104 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:22:16.104 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:22:16.104 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:22:16.104 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:22:16.104 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:22:16.104 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:22:16.104 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:22:16.104 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:22:16.104 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:22:16.105 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:22:16.105 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:22:16.105 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:22:16.105 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:22:16.105 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:22:16.105 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:22:16.105 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:22:16.105 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:22:16.105 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:22:16.105 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:22:16.105 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:16.105 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:22:16.105 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:22:16.106 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:22:16.106 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:22:16.106 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:22:16.106 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:22:16.106 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:22:16.106 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:22:16.106 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:22:16.106 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:22:16.106 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:22:16.106 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:22:16.106 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:22:16.106 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:22:16.107 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:22:16.107 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:22:16.107 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:22:16.107 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:22:16.107 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:22:16.107 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:22:16.107 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:22:16.107 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:22:16.107 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:22:16.108 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:22:16.108 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:22:16.108 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:22:16.108 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:22:16.108 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:22:16.108 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:22:16.108 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:22:16.108 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:16.108 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:22:16.108 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:16.108 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:22:16.108 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:22:16.109 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:22:16.109 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:22:16.109 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:16.109 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:22:16.109 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:22:16.109 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:22:16.109 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:16.109 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:16.109 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:22:16.109 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:22:16.109 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:22:16.109 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:22:16.110 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:22:16.110 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:16.110 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:22:16.110 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:22:16.110 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:22:16.110 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:22:16.110 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:22:16.110 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:16.110 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:16.110 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:22:16.110 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:22:16.110 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:22:16.110 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:22:16.111 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:16.111 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:22:16.111 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:22:16.111 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:22:16.111 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:16.111 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:16.111 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:22:16.111 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:22:16.111 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:22:16.111 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:22:16.111 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:22:16.112 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:16.112 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:22:16.112 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:22:16.112 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:22:16.112 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:22:16.112 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:22:16.112 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:16.112 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:16.112 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:22:16.112 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:22:16.112 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:22:16.112 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:22:16.113 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:16.113 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:22:16.113 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:22:16.113 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:22:16.113 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:16.113 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:16.113 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:22:16.113 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:22:16.113 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:22:16.113 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:22:16.114 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:22:16.114 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:16.114 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:22:16.114 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:22:16.114 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:22:16.114 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:22:16.114 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:22:16.114 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:22:16.114 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:22:16.114 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:16.114 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:22:16.114 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:22:16.114 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:16.115 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:22:16.115 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:22:16.115 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:22:16.115 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:22:16.115 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:22:16.115 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:22:16.115 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:16.115 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:22:16.115 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:22:16.115 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 6 2024-08-24T21:22:16.115 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:22:16.115 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:22:16.116 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:22:16.116 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:16.116 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:22:16.116 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:22:16.116 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:22:16.116 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:22:16.116 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:22:16.116 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:16.116 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:22:16.116 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:22:16.118 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:22:16.118 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2024-08-24T21:22:16.118 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-08-24T21:22:16.118 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-08-24T21:22:16.118 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-08-24T21:22:16.118 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-08-24T21:22:16.119 INFO:teuthology.orchestra.run:waiting for 300 2024-08-24T21:22:16.139 INFO:tasks.ceph.mon.c:Stopped 2024-08-24T21:22:16.139 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-08-24T21:22:16.139 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:22:16.641 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":94,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":6,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:22:18.866 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:22:18.877 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=086d086d0a6d1fd2185ccb853d186268 2024-08-24T21:22:18.877 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ 086d086d0a6d1fd2185ccb853d186268 != \0\8\6\d\0\8\6\d\0\a\6\d\1\f\d\2\1\8\5\c\c\b\8\5\3\d\1\8\6\2\6\8 ]] 2024-08-24T21:22:18.877 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap12 2024-08-24T21:22:18.877 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap12 2024-08-24T21:22:18.877 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap12 2024-08-24T21:22:18.985 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:22:18.996 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:22:18.997 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap12 2024-08-24T21:22:18.998 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:22:19.077 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:22:19.077 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:22:19.077 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:22:19.077 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:22:19.077 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:22:19.077 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap13.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:22:19.661 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:22:20.104 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":94,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":9,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:22:23.123 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:22:30.677 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":98,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:22:30.695 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-08-24T21:22:30.695 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-08-24T21:22:30.696 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:22:30.874 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:22:30.874 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:22:30.874 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:22:30.874 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:22:30.874 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 98, 2024-08-24T21:22:30.874 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 46012, 2024-08-24T21:22:30.874 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:22:30.874 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:22:30.874 INFO:teuthology.orchestra.run.smithi060.stdout: 1 2024-08-24T21:22:30.874 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:22:30.874 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:22:30.875 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:22:30.875 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:22:30.875 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:22:30.875 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:22:30.875 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:22:30.875 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:22:30.875 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:22:30.875 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:22:30.875 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:22:30.875 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:22:30.875 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:22:30.875 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:22:30.875 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:22:30.876 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:22:30.876 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:22:30.876 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:22:30.876 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:22:30.876 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:22:30.876 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:22:30.876 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:22:30.876 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:22:30.876 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:22:30.876 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:22:30.876 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:22:30.876 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:22:30.876 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:22:30.877 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:22:30.877 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:22:30.877 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:22:30.877 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:30.877 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:22:30.877 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:22:30.877 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:22:30.877 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:22:30.877 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:22:30.877 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:22:30.877 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:22:30.877 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:22:30.877 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:22:30.878 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:22:30.878 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:22:30.878 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:22:30.878 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:22:30.878 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:22:30.878 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:22:30.878 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:22:30.878 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:22:30.878 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:22:30.878 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:22:30.878 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:22:30.878 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:22:30.879 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:22:30.879 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:22:30.879 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:22:30.879 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:22:30.879 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:22:30.879 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:22:30.879 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:22:30.879 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:22:30.879 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:22:30.879 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:30.879 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:22:30.879 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:30.880 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:22:30.880 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:22:30.880 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:22:30.880 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:22:30.880 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:30.880 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:22:30.880 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:22:30.880 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:22:30.880 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:30.880 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:30.880 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:22:30.880 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:22:30.880 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:22:30.881 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:22:30.881 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:22:30.881 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:30.881 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:22:30.881 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:22:30.881 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:22:30.881 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:22:30.881 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:22:30.881 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:30.881 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:30.881 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:22:30.881 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:22:30.882 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:22:30.882 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:22:30.882 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:30.882 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:22:30.882 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:22:30.882 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:22:30.882 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:30.882 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:30.882 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:22:30.882 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:22:30.882 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:22:30.882 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:22:30.883 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:22:30.883 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:30.883 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:22:30.883 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:22:30.883 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:22:30.883 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:22:30.883 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:22:30.883 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:30.883 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:30.883 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:22:30.883 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:22:30.883 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:22:30.883 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:22:30.883 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:30.884 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:22:30.884 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:22:30.884 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:22:30.884 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:30.884 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:30.884 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:22:30.884 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:22:30.884 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:22:30.884 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:22:30.884 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:22:30.884 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:30.884 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:22:30.884 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:22:30.885 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:22:30.885 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:22:30.885 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:22:30.885 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:22:30.885 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:22:30.885 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:30.885 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:22:30.885 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:22:30.885 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:30.885 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:22:30.885 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:22:30.885 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:22:30.885 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:22:30.886 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:22:30.886 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:22:30.886 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:30.886 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:22:30.886 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:22:30.886 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:22:30.886 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:22:30.886 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:22:30.886 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:22:30.886 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:30.886 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:22:30.886 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:22:30.886 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:22:30.887 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:22:30.887 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:22:30.887 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:22:30.887 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:30.887 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:22:30.887 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:22:30.887 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:22:30.887 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:22:30.887 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:22:30.887 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:30.887 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:22:30.887 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:22:30.889 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:22:30.889 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-08-24T21:22:30.889 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:22:31.067 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:22:31.067 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:22:31.067 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:22:31.067 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:22:31.067 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 98, 2024-08-24T21:22:31.067 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 141174, 2024-08-24T21:22:31.068 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:22:31.068 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:22:31.068 INFO:teuthology.orchestra.run.smithi060.stdout: 1 2024-08-24T21:22:31.068 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:22:31.068 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:22:31.068 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:22:31.068 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:22:31.068 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:22:31.068 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:22:31.068 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:22:31.068 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:22:31.068 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:22:31.068 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:22:31.069 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:22:31.069 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:22:31.069 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:22:31.069 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:22:31.069 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:22:31.069 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:22:31.069 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:22:31.069 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:22:31.069 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:22:31.069 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:22:31.069 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:22:31.069 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:22:31.069 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:22:31.070 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:22:31.070 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:22:31.070 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:22:31.070 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:22:31.070 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:22:31.070 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:22:31.070 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:22:31.070 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:22:31.070 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:31.070 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:22:31.070 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:22:31.070 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:22:31.070 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:22:31.071 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:22:31.071 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:22:31.071 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:22:31.071 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:22:31.071 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:22:31.071 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:22:31.071 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:22:31.071 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:22:31.071 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:22:31.071 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:22:31.071 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:22:31.072 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:22:31.072 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:22:31.072 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:22:31.072 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:22:31.072 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:22:31.072 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:22:31.072 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:22:31.072 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:22:31.072 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:22:31.072 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:22:31.072 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:22:31.072 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:22:31.072 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:22:31.073 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:22:31.073 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:22:31.073 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:31.073 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:22:31.073 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:31.073 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:22:31.073 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:22:31.073 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:22:31.073 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:22:31.073 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:31.073 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:22:31.073 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:22:31.073 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:22:31.074 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:31.074 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:31.074 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:22:31.074 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:22:31.074 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:22:31.074 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:22:31.074 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:22:31.074 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:31.074 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:22:31.074 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:22:31.074 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:22:31.074 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:22:31.074 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:22:31.075 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:31.075 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:31.075 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:22:31.075 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:22:31.075 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:22:31.075 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:22:31.075 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:31.075 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:22:31.075 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:22:31.075 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:22:31.075 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:31.075 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:31.075 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:22:31.076 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:22:31.076 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:22:31.076 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:22:31.076 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:22:31.076 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:31.076 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:22:31.076 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:22:31.076 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:22:31.076 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:22:31.076 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:22:31.076 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:31.076 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:31.076 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:22:31.077 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:22:31.077 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:22:31.077 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:22:31.077 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:31.077 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:22:31.077 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:22:31.077 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:22:31.077 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:31.077 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:31.077 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:22:31.077 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:22:31.077 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:22:31.077 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:22:31.078 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:22:31.078 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:31.078 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:22:31.078 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:22:31.078 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:22:31.078 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:22:31.078 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:22:31.078 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:22:31.078 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:22:31.078 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:31.078 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:22:31.078 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:22:31.078 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:31.079 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:22:31.079 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:22:31.079 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:22:31.079 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:22:31.079 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:22:31.079 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:22:31.079 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:31.079 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:22:31.079 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:22:31.079 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 7 2024-08-24T21:22:31.079 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:22:31.079 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:22:31.079 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:22:31.080 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:22:31.080 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:22:31.080 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:22:31.080 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:22:31.080 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:22:31.080 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:22:31.080 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:22:31.080 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:22:31.080 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:22:31.081 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:22:31.081 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-08-24T21:22:31.407 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 52% complete... Importing image diff: 77% complete... Importing image diff: 97% complete... Importing image diff: 100% complete...done. 2024-08-24T21:22:31.433 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap13 - 2024-08-24T21:22:31.433 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:22:31.433 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:22:36.299 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:22:36.361 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=086d086d0a6d1fd2185ccb853d186268 2024-08-24T21:22:36.362 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap13 - 2024-08-24T21:22:36.362 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:22:36.362 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:22:41.187 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:22:41.197 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=086d086d0a6d1fd2185ccb853d186268 2024-08-24T21:22:41.198 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ 086d086d0a6d1fd2185ccb853d186268 != \0\8\6\d\0\8\6\d\0\a\6\d\1\f\d\2\1\8\5\c\c\b\8\5\3\d\1\8\6\2\6\8 ]] 2024-08-24T21:22:41.198 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap13 2024-08-24T21:22:41.198 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap13 2024-08-24T21:22:41.198 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap13 2024-08-24T21:22:41.306 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:22:41.317 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:22:41.318 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap13 2024-08-24T21:22:41.319 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:22:41.396 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:22:41.396 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:22:41.397 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:22:41.397 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:22:41.397 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:22:41.397 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap14.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:22:42.431 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 1% complete... Importing image diff: 3% complete... Importing image diff: 4% complete... Importing image diff: 6% complete... Importing image diff: 7% complete... Importing image diff: 9% complete... Importing image diff: 10% complete... Importing image diff: 12% complete... Importing image diff: 14% complete... Importing image diff: 15% complete... Importing image diff: 17% complete... Importing image diff: 18% complete... Importing image diff: 20% complete... Importing image diff: 21% complete... Importing image diff: 23% complete... Importing image diff: 25% complete... Importing image diff: 26% complete... Importing image diff: 28% complete... Importing image diff: 29% complete... Importing image diff: 31% complete... Importing image diff: 32% complete... Importing image diff: 34% complete... Importing image diff: 35% complete... Importing image diff: 37% complete... Importing image diff: 39% complete... Importing image diff: 40% complete... Importing image diff: 42% complete... Importing image diff: 43% complete... Importing image diff: 45% complete... Importing image diff: 46% complete... Importing image diff: 48% complete... Importing image diff: 50% complete... Importing image diff: 51% complete... Importing image diff: 53% complete... Importing image diff: 54% complete... Importing image diff: 56% complete... Importing image diff: 57% complete... Importing image diff: 59% complete... Importing image diff: 60% complete... Importing image diff: 62% complete... Importing image diff: 64% complete... Importing image diff: 65% complete... Importing image diff: 67% complete... Importing image diff: 68% complete... Importing image diff: 70% complete... Importing image diff: 71% complete... Importing image diff: 73% complete... Importing image diff: 75% complete... Importing image diff: 76% complete... Importing image diff: 78% complete... Importing image diff: 79% complete... Importing image diff: 81% complete... Importing image diff: 82% complete... Importing image diff: 84% complete... Importing image diff: 85% complete... Importing image diff: 87% complete... Importing image diff: 89% complete... Importing image diff: 90% complete... Importing image diff: 92% complete... Importing image diff: 93% complete... Importing image diff: 95% complete... Importing image diff: 96% complete... Importing image diff: 98% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2024-08-24T21:22:42.452 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap14 - 2024-08-24T21:22:42.453 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:22:42.453 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:22:47.289 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:22:47.360 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=3b39b69e6df1fe12261829ea8175ca3b 2024-08-24T21:22:47.361 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap14 - 2024-08-24T21:22:47.361 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:22:47.362 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:22:51.082 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-08-24T21:22:51.082 INFO:tasks.ceph.mon.c:Restarting daemon 2024-08-24T21:22:51.083 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-08-24T21:22:51.087 INFO:tasks.ceph.mon.c:Started 2024-08-24T21:22:51.087 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:22:51.087 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:22:51.555 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":98,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:22:52.128 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:22:52.139 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=3b39b69e6df1fe12261829ea8175ca3b 2024-08-24T21:22:52.139 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ 3b39b69e6df1fe12261829ea8175ca3b != \3\b\3\9\b\6\9\e\6\d\f\1\f\e\1\2\2\6\1\8\2\9\e\a\8\1\7\5\c\a\3\b ]] 2024-08-24T21:22:52.139 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap14 2024-08-24T21:22:52.140 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap14 2024-08-24T21:22:52.140 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap14 2024-08-24T21:22:52.247 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:22:52.259 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:22:52.260 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap14 2024-08-24T21:22:52.260 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:22:52.337 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:22:52.337 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:22:52.337 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:22:52.337 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:22:52.337 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:22:52.337 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap15.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:22:54.574 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:22:57.742 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 1% complete... Importing image diff: 3% complete... Importing image diff: 4% complete... Importing image diff: 6% complete... Importing image diff: 7% complete... Importing image diff: 9% complete... Importing image diff: 10% complete... Importing image diff: 12% complete... Importing image diff: 14% complete... Importing image diff: 15% complete... Importing image diff: 17% complete... Importing image diff: 18% complete... Importing image diff: 20% complete... Importing image diff: 21% complete... Importing image diff: 23% complete... Importing image diff: 25% complete... Importing image diff: 26% complete... Importing image diff: 28% complete... Importing image diff: 29% complete... Importing image diff: 31% complete... Importing image diff: 32% complete... Importing image diff: 34% complete... Importing image diff: 35% complete... Importing image diff: 37% complete... Importing image diff: 39% complete... Importing image diff: 40% complete... Importing image diff: 42% complete... Importing image diff: 43% complete... Importing image diff: 45% complete... Importing image diff: 46% complete... Importing image diff: 48% complete... Importing image diff: 50% complete... Importing image diff: 51% complete... Importing image diff: 53% complete... Importing image diff: 54% complete... Importing image diff: 56% complete... Importing image diff: 57% complete... Importing image diff: 59% complete... Importing image diff: 60% complete... Importing image diff: 62% complete... Importing image diff: 64% complete... Importing image diff: 65% complete... Importing image diff: 67% complete... Importing image diff: 68% complete... Importing image diff: 70% complete... Importing image diff: 71% complete... Importing image diff: 73% complete... Importing image diff: 75% complete... Importing image diff: 76% complete... Importing image diff: 78% complete... Importing image diff: 79% complete... Importing image diff: 81% complete... Importing image diff: 82% complete... Importing image diff: 84% complete... Importing image diff: 85% complete... Importing image diff: 87% complete... Importing image diff: 89% complete... Importing image diff: 90% complete... Importing image diff: 92% complete... Importing image diff: 93% complete... Importing image diff: 95% complete... Importing image diff: 96% complete... Importing image diff: 98% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2024-08-24T21:22:57.765 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap15 - 2024-08-24T21:22:57.765 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:22:57.766 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:22:57.982 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":102,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:23:01.001 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:23:01.450 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":104,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:23:01.468 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:23:01.468 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:23:01.468 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:23:01.659 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:23:01.659 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:23:01.659 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:23:01.659 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:23:01.659 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 104, 2024-08-24T21:23:01.659 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 76798, 2024-08-24T21:23:01.659 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:23:01.659 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:23:01.659 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:23:01.660 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:23:01.660 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:23:01.660 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 2, 2024-08-24T21:23:01.660 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:23:01.660 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:23:01.660 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:23:01.660 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:23:01.660 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:23:01.660 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:23:01.660 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:23:01.660 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:23:01.660 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:23:01.660 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:23:01.661 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:23:01.661 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:23:01.661 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:23:01.661 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:23:01.661 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:23:01.661 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:23:01.661 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:23:01.661 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:23:01.661 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:23:01.661 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:23:01.661 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:23:01.661 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:23:01.662 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:23:01.662 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:23:01.662 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:23:01.662 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:23:01.662 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:23:01.662 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:23:01.662 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:23:01.662 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:01.662 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:23:01.662 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:23:01.662 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:23:01.662 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:23:01.663 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:23:01.663 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:23:01.663 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:23:01.663 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:23:01.663 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:23:01.663 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:23:01.663 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:23:01.663 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:23:01.663 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:23:01.663 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:23:01.663 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:23:01.663 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:23:01.664 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:23:01.664 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:23:01.664 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:23:01.664 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:23:01.664 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:23:01.664 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:23:01.664 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:23:01.664 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:23:01.664 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:23:01.664 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:23:01.664 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:23:01.664 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:23:01.665 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:23:01.665 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:23:01.665 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:01.665 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:23:01.665 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:01.665 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:23:01.665 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:23:01.665 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:23:01.665 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:23:01.665 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:01.665 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:23:01.665 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:23:01.665 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:23:01.665 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:01.665 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:01.666 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:23:01.666 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:23:01.666 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:23:01.666 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:23:01.666 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:23:01.666 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:01.666 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:23:01.666 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:23:01.666 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:23:01.666 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:23:01.666 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:23:01.666 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:01.666 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:01.667 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:23:01.667 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:23:01.667 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:23:01.667 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:23:01.667 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:01.667 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:23:01.667 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:23:01.667 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:23:01.667 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:01.667 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:01.667 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:23:01.667 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:23:01.667 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:23:01.668 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:23:01.668 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:23:01.668 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:01.668 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:23:01.668 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:23:01.668 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:23:01.668 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:23:01.668 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:23:01.668 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:01.668 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:01.668 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:23:01.668 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:23:01.668 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:23:01.669 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:23:01.669 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:01.669 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:23:01.669 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:23:01.669 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:23:01.669 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:01.669 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:01.669 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:23:01.669 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:23:01.669 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:23:01.669 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:23:01.669 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:23:01.669 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:01.669 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:23:01.670 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:23:01.670 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:23:01.670 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:23:01.670 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:23:01.670 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:23:01.670 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:23:01.670 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:01.670 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:23:01.670 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:23:01.670 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:01.670 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:23:01.670 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:23:01.671 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:23:01.671 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:23:01.671 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:23:01.671 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:23:01.671 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:01.671 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:23:01.671 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:23:01.671 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:23:01.671 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:23:01.671 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:23:01.671 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:23:01.671 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:01.671 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:23:01.672 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:23:01.672 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-08-24T21:23:01.672 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:23:01.672 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:23:01.672 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:23:01.672 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:01.672 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:23:01.672 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:23:01.672 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:23:01.672 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:23:01.672 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:23:01.672 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:01.673 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:23:01.673 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:23:01.676 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:23:01.676 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:23:01.677 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:23:01.869 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:23:01.869 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:23:01.870 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:23:01.870 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:23:01.870 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 104, 2024-08-24T21:23:01.870 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 10634, 2024-08-24T21:23:01.870 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:23:01.870 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:23:01.870 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:23:01.870 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:23:01.870 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:23:01.870 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 3, 2024-08-24T21:23:01.870 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:23:01.871 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:23:01.871 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:23:01.871 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:23:01.871 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:23:01.871 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:23:01.871 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:23:01.871 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:23:01.871 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:23:01.871 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:23:01.871 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:23:01.871 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:23:01.871 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:23:01.871 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:23:01.872 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:23:01.872 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:23:01.872 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:23:01.872 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:23:01.872 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:23:01.872 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:23:01.872 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:23:01.872 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:23:01.872 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:23:01.872 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:23:01.872 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:23:01.872 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:23:01.872 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:23:01.873 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:23:01.873 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:23:01.873 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:01.873 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:23:01.873 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:23:01.873 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:23:01.873 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:23:01.873 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:23:01.873 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:23:01.873 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:23:01.873 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:23:01.873 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:23:01.873 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:23:01.874 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:23:01.874 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:23:01.874 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:23:01.874 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:23:01.874 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:23:01.874 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:23:01.874 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:23:01.874 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:23:01.874 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:23:01.874 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:23:01.874 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:23:01.874 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:23:01.875 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:23:01.875 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:23:01.875 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:23:01.875 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:23:01.875 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:23:01.875 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:23:01.875 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:23:01.875 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:23:01.875 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:01.875 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:23:01.875 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:01.875 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:23:01.875 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:23:01.876 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:23:01.876 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:23:01.876 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:01.876 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:23:01.876 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:23:01.876 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:23:01.876 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:01.876 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:01.876 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:23:01.876 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:23:01.876 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:23:01.876 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:23:01.876 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:23:01.876 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:01.877 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:23:01.877 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:23:01.877 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:23:01.877 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:23:01.877 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:23:01.877 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:01.877 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:01.877 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:23:01.877 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:23:01.877 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:23:01.877 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:23:01.877 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:01.877 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:23:01.878 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:23:01.878 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:23:01.878 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:01.878 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:01.878 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:23:01.878 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:23:01.878 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:23:01.878 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:23:01.878 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:23:01.878 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:01.878 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:23:01.878 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:23:01.879 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:23:01.879 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:23:01.879 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:23:01.879 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:01.879 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:01.879 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:23:01.879 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:23:01.879 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:23:01.879 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:23:01.879 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:01.879 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:23:01.879 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:23:01.879 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:23:01.880 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:01.880 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:01.880 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:23:01.880 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:23:01.880 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:23:01.880 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:23:01.880 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:23:01.880 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:01.880 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:23:01.880 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:23:01.880 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:23:01.880 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:23:01.880 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:23:01.881 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:23:01.881 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:23:01.881 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:01.881 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:23:01.881 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:23:01.881 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:01.881 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:23:01.881 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:23:01.881 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:23:01.881 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:23:01.881 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:23:01.881 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:23:01.881 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:01.882 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:23:01.882 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:23:01.882 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:23:01.882 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:23:01.882 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:23:01.882 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:01.882 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:23:01.882 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:23:01.884 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:23:01.884 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:23:01.884 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:23:02.061 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:23:02.062 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:23:02.062 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:23:02.062 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:23:02.062 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 104, 2024-08-24T21:23:02.062 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 172169, 2024-08-24T21:23:02.062 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:23:02.062 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:23:02.062 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:23:02.062 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:23:02.062 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:23:02.062 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 3, 2024-08-24T21:23:02.063 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:23:02.063 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:23:02.063 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:23:02.063 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:23:02.063 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:23:02.063 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:23:02.063 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:23:02.063 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:23:02.063 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:23:02.063 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:23:02.063 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:23:02.063 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:23:02.064 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:23:02.064 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:23:02.064 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:23:02.064 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:23:02.064 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:23:02.064 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:23:02.064 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:23:02.064 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:23:02.064 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:23:02.064 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:23:02.065 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:23:02.065 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:23:02.065 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:23:02.065 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:23:02.065 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:23:02.065 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:23:02.065 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:23:02.065 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:02.065 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:23:02.065 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:23:02.065 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:23:02.065 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:23:02.065 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:23:02.066 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:23:02.066 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:23:02.066 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:23:02.066 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:23:02.066 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:23:02.066 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:23:02.066 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:23:02.066 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:23:02.066 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:23:02.066 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:23:02.066 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:23:02.066 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:23:02.067 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:23:02.067 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:23:02.067 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:23:02.067 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:23:02.067 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:23:02.067 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:23:02.067 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:23:02.067 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:23:02.067 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:23:02.067 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:23:02.067 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:23:02.068 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:23:02.068 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:23:02.068 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:02.068 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:23:02.068 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:02.068 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:23:02.068 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:23:02.068 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:23:02.068 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:23:02.068 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:02.068 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:23:02.068 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:23:02.068 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:23:02.068 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:02.069 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:02.069 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:23:02.069 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:23:02.069 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:23:02.069 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:23:02.069 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:23:02.069 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:02.069 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:23:02.069 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:23:02.069 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:23:02.069 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:23:02.069 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:23:02.069 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:02.070 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:02.070 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:23:02.070 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:23:02.070 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:23:02.070 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:23:02.070 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:02.070 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:23:02.070 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:23:02.070 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:23:02.070 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:02.070 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:02.071 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:23:02.071 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:23:02.071 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:23:02.071 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:23:02.071 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:23:02.071 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:02.071 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:23:02.071 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:23:02.071 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:23:02.071 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:23:02.072 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:23:02.072 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:02.072 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:02.072 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:23:02.072 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:23:02.072 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:23:02.072 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:23:02.072 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:02.072 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:23:02.072 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:23:02.072 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:23:02.072 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:02.072 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:02.073 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:23:02.073 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:23:02.073 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:23:02.073 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:23:02.073 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:23:02.073 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:02.073 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:23:02.073 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:23:02.073 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:23:02.073 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:23:02.073 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:23:02.073 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:23:02.073 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:23:02.073 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:02.074 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:23:02.074 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:23:02.074 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:02.074 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:23:02.074 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:23:02.074 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:23:02.074 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:23:02.074 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:23:02.074 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:23:02.074 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:02.074 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:23:02.074 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:23:02.074 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 7 2024-08-24T21:23:02.075 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:23:02.075 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:23:02.075 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:23:02.075 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:02.075 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:23:02.075 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:23:02.075 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-08-24T21:23:02.075 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:23:02.075 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:23:02.075 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:02.075 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:23:02.075 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:23:02.076 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:23:02.077 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-08-24T21:23:02.077 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-08-24T21:23:02.547 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-08-24T21:23:02.622 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:23:02.678 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=a1e9f79793f57ba1d02744b8ab10d436 2024-08-24T21:23:02.679 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap15 - 2024-08-24T21:23:02.679 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:23:02.679 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:23:03.547 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:23:03.548 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:23:03.994 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":104,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:23:04.012 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:23:04.012 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-08-24T21:23:04.012 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:23:04.012 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:23:04.191 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:23:04.191 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:23:04.191 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:23:04.191 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:23:04.191 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 104, 2024-08-24T21:23:04.191 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 79330, 2024-08-24T21:23:04.191 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:23:04.192 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:23:04.192 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:23:04.192 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:23:04.192 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:23:04.192 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 5, 2024-08-24T21:23:04.192 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:23:04.192 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:23:04.192 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:23:04.192 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:23:04.192 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:23:04.192 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:23:04.192 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:23:04.192 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:23:04.193 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:23:04.193 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:23:04.193 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:23:04.193 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:23:04.193 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:23:04.193 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:23:04.193 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:23:04.193 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:23:04.193 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:23:04.193 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:23:04.193 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:23:04.194 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:23:04.194 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:23:04.194 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:23:04.194 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:23:04.194 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:23:04.194 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:23:04.194 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:23:04.194 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:23:04.194 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:23:04.194 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:23:04.194 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:04.194 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:23:04.195 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:23:04.195 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:23:04.195 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:23:04.195 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:23:04.195 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:23:04.195 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:23:04.195 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:23:04.195 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:23:04.195 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:23:04.196 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:23:04.196 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:23:04.196 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:23:04.196 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:23:04.196 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:23:04.196 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:23:04.196 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:23:04.196 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:23:04.196 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:23:04.196 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:23:04.196 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:23:04.196 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:23:04.197 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:23:04.197 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:23:04.197 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:23:04.197 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:23:04.197 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:23:04.197 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:23:04.197 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:23:04.197 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:23:04.197 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:04.197 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:23:04.197 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:04.197 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:23:04.197 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:23:04.198 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:23:04.198 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:23:04.198 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:04.198 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:23:04.198 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:23:04.198 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:23:04.198 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:04.198 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:04.198 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:23:04.198 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:23:04.198 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:23:04.198 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:23:04.198 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:23:04.198 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:04.199 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:23:04.199 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:23:04.199 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:23:04.199 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:23:04.199 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:23:04.199 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:04.199 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:04.199 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:23:04.199 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:23:04.199 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:23:04.199 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:23:04.199 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:04.199 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:23:04.200 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:23:04.200 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:23:04.200 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:04.200 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:04.200 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:23:04.200 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:23:04.200 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:23:04.200 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:23:04.200 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:23:04.200 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:04.200 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:23:04.200 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:23:04.200 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:23:04.200 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:23:04.201 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:23:04.201 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:04.201 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:04.201 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:23:04.201 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:23:04.201 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:23:04.201 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:23:04.201 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:04.201 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:23:04.201 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:23:04.201 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:23:04.201 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:04.202 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:04.202 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:23:04.202 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:23:04.202 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:23:04.202 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:23:04.202 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:23:04.202 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:04.202 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:23:04.202 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:23:04.202 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:23:04.202 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:23:04.202 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:23:04.202 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:23:04.202 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:23:04.203 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:04.203 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:23:04.203 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:23:04.203 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:04.203 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:23:04.203 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:23:04.203 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:23:04.203 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:23:04.203 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:23:04.204 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:23:04.204 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:04.204 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:23:04.204 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:23:04.204 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:23:04.204 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:23:04.204 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:23:04.204 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:23:04.204 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:04.204 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:23:04.204 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:23:04.204 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:23:04.204 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:23:04.205 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:23:04.205 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:23:04.205 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:04.205 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:23:04.205 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:23:04.205 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:23:04.205 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:23:04.205 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:23:04.205 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:04.205 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:23:04.205 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:23:04.207 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:23:04.207 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:23:04.207 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:23:04.387 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:23:04.387 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:23:04.387 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:23:04.387 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:23:04.387 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 104, 2024-08-24T21:23:04.387 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 13152, 2024-08-24T21:23:04.387 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:23:04.387 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:23:04.388 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:23:04.388 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:23:04.388 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:23:04.388 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 5, 2024-08-24T21:23:04.388 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:23:04.388 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:23:04.388 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:23:04.388 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:23:04.388 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:23:04.388 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:23:04.388 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:23:04.388 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:23:04.389 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:23:04.389 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:23:04.389 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:23:04.389 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:23:04.389 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:23:04.389 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:23:04.389 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:23:04.389 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:23:04.389 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:23:04.389 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:23:04.389 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:23:04.389 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:23:04.389 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:23:04.390 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:23:04.390 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:23:04.390 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:23:04.390 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:23:04.390 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:23:04.390 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:23:04.390 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:23:04.390 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:23:04.390 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:04.390 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:23:04.390 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:23:04.390 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:23:04.391 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:23:04.391 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:23:04.391 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:23:04.391 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:23:04.391 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:23:04.391 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:23:04.391 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:23:04.391 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:23:04.391 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:23:04.391 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:23:04.391 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:23:04.391 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:23:04.392 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:23:04.392 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:23:04.392 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:23:04.392 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:23:04.392 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:23:04.392 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:23:04.392 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:23:04.392 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:23:04.392 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:23:04.392 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:23:04.392 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:23:04.392 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:23:04.393 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:23:04.393 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:23:04.393 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:23:04.393 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:04.393 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:23:04.393 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:04.393 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:23:04.393 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:23:04.393 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:23:04.393 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:23:04.393 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:04.393 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:23:04.393 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:23:04.393 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:23:04.394 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:04.394 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:04.394 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:23:04.394 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:23:04.394 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:23:04.394 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:23:04.394 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:23:04.394 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:04.394 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:23:04.394 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:23:04.394 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:23:04.394 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:23:04.394 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:23:04.395 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:04.395 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:04.395 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:23:04.395 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:23:04.395 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:23:04.395 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:23:04.395 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:04.395 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:23:04.395 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:23:04.395 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:23:04.395 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:04.395 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:04.396 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:23:04.396 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:23:04.396 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:23:04.396 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:23:04.396 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:23:04.396 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:04.396 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:23:04.396 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:23:04.396 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:23:04.396 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:23:04.396 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:23:04.396 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:04.396 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:04.397 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:23:04.397 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:23:04.397 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:23:04.397 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:23:04.397 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:04.397 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:23:04.397 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:23:04.397 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:23:04.397 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:04.397 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:04.397 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:23:04.397 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:23:04.397 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:23:04.398 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:23:04.398 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:23:04.398 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:04.398 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:23:04.398 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:23:04.398 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:23:04.398 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:23:04.398 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:23:04.398 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:23:04.398 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:23:04.398 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:04.398 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:23:04.398 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:23:04.399 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:04.399 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:23:04.399 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:23:04.399 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:23:04.399 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:23:04.399 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:23:04.399 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:23:04.399 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:04.399 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:23:04.399 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:23:04.399 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:23:04.399 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:23:04.399 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:23:04.400 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:04.400 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:23:04.400 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:23:04.401 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:23:04.402 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:23:04.402 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:23:04.581 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:23:04.581 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:23:04.581 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:23:04.581 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:23:04.581 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 104, 2024-08-24T21:23:04.581 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 174688, 2024-08-24T21:23:04.581 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:23:04.581 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:23:04.582 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:23:04.582 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:23:04.582 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:23:04.582 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 5, 2024-08-24T21:23:04.582 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:23:04.582 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:23:04.582 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:23:04.582 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:23:04.582 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:23:04.582 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:23:04.582 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:23:04.582 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:23:04.582 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:23:04.583 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:23:04.583 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:23:04.583 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:23:04.583 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:23:04.583 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:23:04.583 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:23:04.583 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:23:04.583 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:23:04.583 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:23:04.583 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:23:04.583 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:23:04.583 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:23:04.584 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:23:04.584 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:23:04.584 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:23:04.584 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:23:04.584 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:23:04.584 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:23:04.584 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:23:04.584 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:23:04.584 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:04.584 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:23:04.584 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:23:04.584 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:23:04.584 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:23:04.585 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:23:04.585 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:23:04.585 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:23:04.585 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:23:04.585 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:23:04.585 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:23:04.585 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:23:04.585 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:23:04.585 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:23:04.585 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:23:04.585 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:23:04.585 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:23:04.585 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:23:04.586 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:23:04.586 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:23:04.586 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:23:04.586 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:23:04.586 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:23:04.586 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:23:04.586 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:23:04.586 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:23:04.586 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:23:04.586 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:23:04.586 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:23:04.586 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:23:04.586 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:23:04.587 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:04.587 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:23:04.587 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:04.587 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:23:04.587 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:23:04.587 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:23:04.587 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:23:04.587 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:04.587 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:23:04.587 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:23:04.587 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:23:04.587 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:04.588 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:04.588 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:23:04.588 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:23:04.588 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:23:04.588 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:23:04.588 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:23:04.588 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:04.588 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:23:04.588 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:23:04.588 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:23:04.588 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:23:04.588 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:23:04.589 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:04.589 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:04.589 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:23:04.589 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:23:04.589 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:23:04.589 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:23:04.589 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:04.589 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:23:04.589 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:23:04.589 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:23:04.590 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:04.590 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:04.590 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:23:04.590 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:23:04.590 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:23:04.590 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:23:04.590 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:23:04.590 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:04.590 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:23:04.590 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:23:04.590 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:23:04.590 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:23:04.590 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:23:04.591 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:04.591 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:04.591 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:23:04.591 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:23:04.591 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:23:04.591 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:23:04.591 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:04.591 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:23:04.592 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:23:04.592 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:23:04.592 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:04.592 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:04.592 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:23:04.592 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:23:04.592 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:23:04.592 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:23:04.592 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:23:04.592 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:04.592 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:23:04.592 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:23:04.592 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:23:04.593 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:23:04.593 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:23:04.593 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:23:04.593 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:23:04.593 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:04.593 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:23:04.593 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:23:04.593 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:04.593 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:23:04.593 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:23:04.593 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:23:04.593 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:23:04.593 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:23:04.594 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:23:04.594 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:04.594 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:23:04.594 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:23:04.594 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 7 2024-08-24T21:23:04.594 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:23:04.594 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:23:04.594 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:23:04.594 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:04.594 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:23:04.594 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:23:04.594 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-08-24T21:23:04.594 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:23:04.594 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:23:04.595 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:04.595 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:23:04.595 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:23:04.596 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:23:04.596 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2024-08-24T21:23:04.596 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['a'] 2024-08-24T21:23:04.596 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-08-24T21:23:04.596 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-08-24T21:23:04.597 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-08-24T21:23:04.597 INFO:teuthology.orchestra.run:waiting for 300 2024-08-24T21:23:04.614 INFO:tasks.ceph.mon.c:Stopped 2024-08-24T21:23:04.614 INFO:tasks.mon_thrash:Sending STOP to mon a 2024-08-24T21:23:04.614 INFO:tasks.ceph.mon.a:Sent signal 19 2024-08-24T21:23:04.614 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-08-24T21:23:07.477 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:23:07.487 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=a1e9f79793f57ba1d02744b8ab10d436 2024-08-24T21:23:07.487 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ a1e9f79793f57ba1d02744b8ab10d436 != \a\1\e\9\f\7\9\7\9\3\f\5\7\b\a\1\d\0\2\7\4\4\b\8\a\b\1\0\d\4\3\6 ]] 2024-08-24T21:23:07.487 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap15 2024-08-24T21:23:07.487 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap15 2024-08-24T21:23:07.488 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap15 2024-08-24T21:23:07.602 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:23:07.613 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:23:07.615 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap15 2024-08-24T21:23:07.615 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:23:07.692 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:23:07.692 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:23:07.693 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:23:07.693 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:23:07.693 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:23:07.693 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap16.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:23:19.615 INFO:tasks.mon_thrash:Sending CONT to mon a 2024-08-24T21:23:19.616 INFO:tasks.ceph.mon.a:Sent signal 18 2024-08-24T21:23:19.616 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-08-24T21:23:19.617 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:23:24.929 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":108,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:23:24.947 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-08-24T21:23:24.948 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-08-24T21:23:24.948 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:23:25.123 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:23:25.124 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:23:25.124 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:23:25.124 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:23:25.124 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 108, 2024-08-24T21:23:25.124 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 100263, 2024-08-24T21:23:25.124 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:23:25.124 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:23:25.124 INFO:teuthology.orchestra.run.smithi060.stdout: 1 2024-08-24T21:23:25.124 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:23:25.124 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:23:25.124 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:23:25.125 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:23:25.125 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:23:25.125 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:23:25.125 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:23:25.125 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:23:25.125 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:23:25.125 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:23:25.125 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:23:25.125 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:23:25.125 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:23:25.125 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:23:25.125 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:23:25.125 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:23:25.126 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:23:25.126 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:23:25.126 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:23:25.126 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:23:25.126 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:23:25.126 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:23:25.126 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:23:25.126 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:23:25.126 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:23:25.126 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:23:25.126 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:23:25.126 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:23:25.126 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:23:25.127 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:23:25.127 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:23:25.127 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:25.127 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:23:25.127 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:23:25.127 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:23:25.127 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:23:25.127 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:23:25.127 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:23:25.127 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:23:25.127 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:23:25.127 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:23:25.127 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:23:25.128 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:23:25.128 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:23:25.128 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:23:25.128 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:23:25.128 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:23:25.128 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:23:25.128 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:23:25.128 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:23:25.128 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:23:25.128 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:23:25.128 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:23:25.128 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:23:25.129 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:23:25.129 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:23:25.129 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:23:25.129 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:23:25.129 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:23:25.129 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:23:25.129 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:23:25.129 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:23:25.129 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:25.129 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:23:25.129 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:25.129 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:23:25.129 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:23:25.130 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:23:25.130 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:23:25.130 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:25.130 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:23:25.130 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:23:25.130 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:23:25.130 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:25.130 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:25.130 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:23:25.130 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:23:25.130 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:23:25.130 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:23:25.130 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:23:25.130 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:25.131 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:23:25.131 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:23:25.131 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:23:25.131 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:23:25.131 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:23:25.131 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:25.131 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:25.131 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:23:25.131 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:23:25.131 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:23:25.131 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:23:25.131 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:25.131 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:23:25.132 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:23:25.132 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:23:25.132 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:25.132 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:25.132 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:23:25.132 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:23:25.132 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:23:25.132 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:23:25.132 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:23:25.132 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:25.133 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:23:25.133 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:23:25.133 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:23:25.133 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:23:25.133 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:23:25.133 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:25.133 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:25.133 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:23:25.133 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:23:25.133 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:23:25.133 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:23:25.133 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:25.134 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:23:25.134 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:23:25.134 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:23:25.134 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:25.134 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:25.134 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:23:25.134 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:23:25.134 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:23:25.134 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:23:25.134 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:23:25.134 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:25.134 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:23:25.135 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:23:25.135 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:23:25.135 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:23:25.135 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:23:25.135 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:23:25.135 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:23:25.135 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:25.135 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:23:25.135 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:23:25.135 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:25.135 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:23:25.135 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:23:25.136 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:23:25.136 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:23:25.136 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:23:25.136 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:23:25.136 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:25.136 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:23:25.136 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:23:25.136 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:23:25.136 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:23:25.136 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:23:25.136 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:23:25.137 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:25.137 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:23:25.137 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:23:25.137 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:23:25.137 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:23:25.137 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:23:25.137 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:23:25.137 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:25.137 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:23:25.137 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:23:25.137 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:23:25.138 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:23:25.138 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:23:25.138 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:25.138 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:23:25.138 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:23:25.139 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:23:25.139 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-08-24T21:23:25.139 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:23:25.316 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:23:25.316 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:23:25.316 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:23:25.316 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:23:25.317 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 108, 2024-08-24T21:23:25.317 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 195423, 2024-08-24T21:23:25.317 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:23:25.317 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:23:25.317 INFO:teuthology.orchestra.run.smithi060.stdout: 1 2024-08-24T21:23:25.317 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:23:25.317 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:23:25.317 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:23:25.317 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:23:25.317 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:23:25.317 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:23:25.317 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:23:25.317 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:23:25.318 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:23:25.318 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:23:25.318 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:23:25.318 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:23:25.318 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:23:25.318 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:23:25.318 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:23:25.318 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:23:25.318 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:23:25.318 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:23:25.318 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:23:25.318 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:23:25.319 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:23:25.319 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:23:25.319 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:23:25.319 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:23:25.319 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:23:25.319 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:23:25.319 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:23:25.319 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:23:25.319 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:23:25.319 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:23:25.319 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:23:25.319 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:25.320 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:23:25.320 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:23:25.320 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:23:25.320 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:23:25.320 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:23:25.320 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:23:25.320 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:23:25.320 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:23:25.320 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:23:25.320 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:23:25.320 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:23:25.320 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:23:25.321 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:23:25.321 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:23:25.321 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:23:25.321 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:23:25.321 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:23:25.321 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:23:25.321 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:23:25.321 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:23:25.321 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:23:25.321 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:23:25.321 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:23:25.321 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:23:25.321 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:23:25.322 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:23:25.322 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:23:25.322 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:23:25.322 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:23:25.322 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:23:25.322 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:25.322 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:23:25.322 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:25.322 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:23:25.322 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:23:25.322 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:23:25.322 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:23:25.322 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:25.323 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:23:25.323 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:23:25.323 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:23:25.323 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:25.323 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:25.323 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:23:25.323 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:23:25.323 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:23:25.323 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:23:25.323 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:23:25.323 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:25.323 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:23:25.323 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:23:25.324 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:23:25.324 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:23:25.324 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:23:25.324 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:25.324 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:25.324 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:23:25.324 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:23:25.324 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:23:25.324 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:23:25.324 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:25.324 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:23:25.324 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:23:25.324 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:23:25.324 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:25.325 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:25.325 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:23:25.325 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:23:25.325 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:23:25.325 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:23:25.325 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:23:25.325 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:25.325 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:23:25.325 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:23:25.325 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:23:25.325 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:23:25.325 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:23:25.325 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:25.325 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:25.325 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:23:25.326 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:23:25.326 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:23:25.326 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:23:25.326 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:25.326 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:23:25.326 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:23:25.326 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:23:25.326 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:25.326 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:25.326 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:23:25.326 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:23:25.326 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:23:25.326 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:23:25.327 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:23:25.327 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:25.327 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:23:25.327 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:23:25.327 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:23:25.327 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:23:25.327 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:23:25.327 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:23:25.327 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:23:25.327 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:25.327 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:23:25.327 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:23:25.327 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:25.327 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:23:25.328 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:23:25.328 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:23:25.328 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:23:25.328 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:23:25.328 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:23:25.328 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:25.328 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:23:25.328 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:23:25.328 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 7 2024-08-24T21:23:25.328 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:23:25.328 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:23:25.328 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:23:25.328 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:23:25.329 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:23:25.329 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:23:25.329 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:23:25.329 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:23:25.329 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:23:25.329 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:23:25.329 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:23:25.329 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:23:25.331 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:23:25.331 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-08-24T21:23:25.653 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 1% complete... Importing image diff: 3% complete... Importing image diff: 4% complete... Importing image diff: 6% complete... Importing image diff: 7% complete... Importing image diff: 9% complete... Importing image diff: 10% complete... Importing image diff: 12% complete... Importing image diff: 14% complete... Importing image diff: 15% complete... Importing image diff: 17% complete... Importing image diff: 18% complete... Importing image diff: 20% complete... Importing image diff: 21% complete... Importing image diff: 23% complete... Importing image diff: 25% complete... Importing image diff: 26% complete... Importing image diff: 28% complete... Importing image diff: 29% complete... Importing image diff: 31% complete... Importing image diff: 32% complete... Importing image diff: 34% complete... Importing image diff: 35% complete... Importing image diff: 37% complete... Importing image diff: 39% complete... Importing image diff: 40% complete... Importing image diff: 42% complete... Importing image diff: 43% complete... Importing image diff: 45% complete... Importing image diff: 46% complete... Importing image diff: 48% complete... Importing image diff: 50% complete... Importing image diff: 51% complete... Importing image diff: 53% complete... Importing image diff: 54% complete... Importing image diff: 56% complete... Importing image diff: 57% complete... Importing image diff: 59% complete... Importing image diff: 60% complete... Importing image diff: 62% complete... Importing image diff: 64% complete... Importing image diff: 65% complete... Importing image diff: 67% complete... Importing image diff: 68% complete... Importing image diff: 70% complete... Importing image diff: 71% complete... Importing image diff: 73% complete... Importing image diff: 75% complete... Importing image diff: 76% complete... Importing image diff: 78% complete... Importing image diff: 79% complete... Importing image diff: 81% complete... Importing image diff: 82% complete... Importing image diff: 84% complete... Importing image diff: 85% complete... Importing image diff: 87% complete... Importing image diff: 89% complete... Importing image diff: 90% complete... Importing image diff: 92% complete... Importing image diff: 93% complete... Importing image diff: 95% complete... Importing image diff: 96% complete... Importing image diff: 98% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2024-08-24T21:23:25.675 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap16 - 2024-08-24T21:23:25.675 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:23:25.675 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:23:30.614 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:23:30.684 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=f6556dcefefe1f327fbb5c4dda5ba4ee 2024-08-24T21:23:30.685 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap16 - 2024-08-24T21:23:30.685 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:23:30.685 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:23:35.480 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:23:35.489 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=f6556dcefefe1f327fbb5c4dda5ba4ee 2024-08-24T21:23:35.489 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ f6556dcefefe1f327fbb5c4dda5ba4ee != \f\6\5\5\6\d\c\e\f\e\f\e\1\f\3\2\7\f\b\b\5\c\4\d\d\a\5\b\a\4\e\e ]] 2024-08-24T21:23:35.489 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap16 2024-08-24T21:23:35.490 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap16 2024-08-24T21:23:35.490 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap16 2024-08-24T21:23:35.595 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:23:35.606 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:23:35.608 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap16 2024-08-24T21:23:35.608 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:23:35.686 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:23:35.686 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:23:35.686 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:23:35.686 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:23:35.687 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:23:35.687 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap17.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:23:36.681 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2024-08-24T21:23:36.699 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap17 - 2024-08-24T21:23:36.700 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:23:36.701 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:23:41.482 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:23:41.539 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=903c52d3f89533b97ae646b26c4169fd 2024-08-24T21:23:41.540 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap17 - 2024-08-24T21:23:41.540 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:23:41.540 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:23:45.332 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-08-24T21:23:45.332 INFO:tasks.ceph.mon.c:Restarting daemon 2024-08-24T21:23:45.332 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-08-24T21:23:45.337 INFO:tasks.ceph.mon.c:Started 2024-08-24T21:23:45.337 INFO:tasks.mon_thrash:Sending STOP to mon a 2024-08-24T21:23:45.337 INFO:tasks.ceph.mon.a:Sent signal 19 2024-08-24T21:23:45.337 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-08-24T21:23:46.349 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:23:46.361 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=903c52d3f89533b97ae646b26c4169fd 2024-08-24T21:23:46.361 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ 903c52d3f89533b97ae646b26c4169fd != \9\0\3\c\5\2\d\3\f\8\9\5\3\3\b\9\7\a\e\6\4\6\b\2\6\c\4\1\6\9\f\d ]] 2024-08-24T21:23:46.361 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap17 2024-08-24T21:23:46.361 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap17 2024-08-24T21:23:46.361 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap17 2024-08-24T21:23:46.467 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:23:46.479 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:23:46.480 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap17 2024-08-24T21:23:46.480 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:23:46.568 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:23:46.568 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:23:46.568 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:23:46.568 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:23:46.569 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:23:46.569 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap18.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:23:54.748 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 5% complete... Importing image diff: 11% complete... Importing image diff: 16% complete... Importing image diff: 22% complete... Importing image diff: 27% complete... Importing image diff: 33% complete... Importing image diff: 38% complete... Importing image diff: 44% complete... Importing image diff: 49% complete... Importing image diff: 55% complete... Importing image diff: 60% complete... Importing image diff: 66% complete... Importing image diff: 71% complete... Importing image diff: 77% complete... Importing image diff: 82% complete... Importing image diff: 88% complete... Importing image diff: 93% complete... Importing image diff: 94% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2024-08-24T21:23:54.771 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap18 - 2024-08-24T21:23:54.772 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:23:54.772 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:23:59.748 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:23:59.798 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=918f909185b46c4e3744845ac52d2716 2024-08-24T21:23:59.799 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap18 - 2024-08-24T21:23:59.800 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:23:59.800 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:24:00.338 INFO:tasks.mon_thrash:Sending CONT to mon a 2024-08-24T21:24:00.338 INFO:tasks.ceph.mon.a:Sent signal 18 2024-08-24T21:24:00.338 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:24:00.338 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:24:00.793 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":114,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:24:00.811 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:24:00.811 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:24:00.812 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:24:00.990 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:24:00.990 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:24:00.990 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:24:00.990 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:24:00.990 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 114, 2024-08-24T21:24:00.990 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 136129, 2024-08-24T21:24:00.990 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:24:00.991 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:24:00.991 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:24:00.991 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:24:00.991 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:00.991 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:24:00.991 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:24:00.991 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:24:00.991 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:24:00.991 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:24:00.991 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:24:00.991 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:24:00.991 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:24:00.992 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:24:00.992 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:24:00.992 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:24:00.992 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:24:00.992 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:24:00.992 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:24:00.992 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:24:00.992 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:00.992 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:24:00.992 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:24:00.992 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:24:00.992 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:24:00.992 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:24:00.992 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:24:00.993 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:24:00.993 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:24:00.993 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:24:00.993 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:24:00.993 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:24:00.993 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:24:00.993 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:24:00.993 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:00.993 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:00.993 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:24:00.993 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:24:00.993 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:24:00.993 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:24:00.994 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:24:00.994 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:24:00.994 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:24:00.994 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:24:00.994 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:24:00.994 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:24:00.994 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:24:00.994 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:24:00.994 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:24:00.994 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:24:00.994 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:24:00.994 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:24:00.994 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:24:00.995 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:24:00.995 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:24:00.995 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:24:00.995 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:24:00.995 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:24:00.995 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:24:00.995 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:24:00.995 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:24:00.995 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:24:00.995 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:24:00.995 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:24:00.995 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:00.996 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:24:00.996 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:00.996 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:24:00.996 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:00.996 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:24:00.996 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:24:00.996 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:24:00.996 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:24:00.996 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:00.996 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:24:00.996 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:24:00.996 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:00.996 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:00.996 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:00.997 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:24:00.997 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:24:00.997 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:00.997 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:00.997 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:00.997 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:00.997 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:24:00.997 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:24:00.997 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:24:00.997 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:24:00.997 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:24:00.997 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:00.998 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:00.998 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:24:00.998 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:24:00.998 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:24:00.998 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:24:00.998 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:00.998 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:24:00.998 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:24:00.998 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:00.998 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:00.998 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:00.998 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:24:00.999 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:24:00.999 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:00.999 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:00.999 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:00.999 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:00.999 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:24:00.999 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:24:00.999 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:24:00.999 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:24:00.999 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:24:00.999 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:00.999 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:00.999 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:24:01.000 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:24:01.000 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:24:01.000 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:24:01.000 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:01.000 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:24:01.000 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:24:01.000 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:01.000 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:01.000 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:01.000 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:24:01.000 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:24:01.000 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:01.000 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:01.001 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:01.001 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:01.001 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:24:01.001 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:24:01.001 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:24:01.001 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:24:01.001 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:24:01.001 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:01.001 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:01.001 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:01.001 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:24:01.001 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:24:01.001 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:01.001 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:24:01.002 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:24:01.002 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:24:01.002 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:01.002 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:01.002 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:24:01.002 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:01.002 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:24:01.002 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:24:01.002 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:24:01.002 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:01.002 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:01.002 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:24:01.002 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:01.003 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:24:01.003 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:24:01.003 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:24:01.003 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:01.003 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:01.003 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:24:01.003 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:01.003 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:24:01.003 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:24:01.003 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:24:01.003 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:01.003 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:01.004 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:01.004 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:24:01.004 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:24:01.006 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:24:01.006 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:24:01.006 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:24:01.185 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:24:01.185 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:24:01.185 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:24:01.185 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:24:01.185 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 114, 2024-08-24T21:24:01.185 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 15704, 2024-08-24T21:24:01.185 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:24:01.185 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:24:01.185 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:24:01.185 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:24:01.186 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:01.186 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:24:01.186 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:24:01.186 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:24:01.186 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:24:01.186 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:24:01.186 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:24:01.186 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:24:01.186 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:24:01.186 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:24:01.186 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:24:01.186 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:24:01.186 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:24:01.187 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:24:01.187 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:24:01.187 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:24:01.187 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:01.187 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:24:01.187 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:24:01.187 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:24:01.187 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:24:01.187 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:24:01.187 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:24:01.187 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:24:01.187 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:24:01.188 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:24:01.188 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:24:01.188 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:24:01.188 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:24:01.188 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:24:01.188 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:01.188 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:01.188 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:24:01.188 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:24:01.188 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:24:01.188 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:24:01.188 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:24:01.189 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:24:01.189 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:24:01.189 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:24:01.189 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:24:01.189 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:24:01.189 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:24:01.189 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:24:01.189 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:24:01.189 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:24:01.189 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:24:01.189 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:24:01.189 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:24:01.190 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:24:01.190 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:24:01.190 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:24:01.190 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:24:01.190 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:24:01.190 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:24:01.190 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:24:01.190 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:24:01.190 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:24:01.190 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:24:01.190 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:24:01.190 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:01.190 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:24:01.191 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:01.191 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:24:01.191 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:01.191 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:24:01.191 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:24:01.191 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:24:01.191 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:24:01.191 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:01.191 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:24:01.191 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:24:01.191 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:01.191 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:01.192 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:01.192 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:24:01.192 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:24:01.192 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:01.192 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:01.192 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:01.192 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:01.192 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:24:01.192 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:24:01.192 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:24:01.192 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:24:01.192 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:24:01.192 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:01.193 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:01.193 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:24:01.193 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:24:01.193 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:24:01.193 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:24:01.193 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:01.193 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:24:01.193 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:24:01.193 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:01.193 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:01.193 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:01.193 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:24:01.193 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:24:01.194 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:01.194 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:01.194 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:01.194 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:01.194 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:24:01.194 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:24:01.194 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:24:01.194 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:24:01.194 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:24:01.194 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:01.194 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:01.194 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:24:01.195 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:24:01.195 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:24:01.195 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:24:01.195 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:01.195 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:24:01.195 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:24:01.195 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:01.195 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:01.195 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:01.195 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:24:01.195 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:24:01.195 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:01.195 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:01.196 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:01.196 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:01.196 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:24:01.196 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:24:01.196 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:24:01.196 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:24:01.196 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:24:01.196 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:01.196 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:01.196 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:01.196 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:24:01.196 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:24:01.196 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:01.196 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:24:01.197 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:24:01.197 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:24:01.197 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:01.197 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:01.197 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:24:01.197 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:01.197 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:24:01.197 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:24:01.197 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:24:01.197 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:01.197 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:01.197 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:01.198 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:24:01.198 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:24:01.199 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:24:01.200 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:24:01.200 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:24:01.378 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:24:01.378 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:24:01.378 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:24:01.378 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:24:01.378 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 114, 2024-08-24T21:24:01.379 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 231485, 2024-08-24T21:24:01.379 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:24:01.379 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:24:01.379 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:24:01.379 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:24:01.379 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:01.379 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 1, 2024-08-24T21:24:01.379 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:24:01.379 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:24:01.379 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:24:01.379 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:24:01.379 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:24:01.380 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:24:01.380 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:24:01.380 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:24:01.380 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:24:01.380 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:24:01.380 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:24:01.380 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:24:01.380 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:24:01.380 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:24:01.380 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:01.380 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:24:01.380 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:24:01.380 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:24:01.381 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:24:01.381 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:24:01.381 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:24:01.381 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:24:01.381 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:24:01.381 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:24:01.381 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:24:01.381 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:24:01.381 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:24:01.381 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:24:01.381 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:01.381 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:01.381 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:24:01.382 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:24:01.382 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:24:01.382 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:24:01.382 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:24:01.382 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:24:01.382 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:24:01.382 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:24:01.382 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:24:01.382 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:24:01.382 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:24:01.382 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:24:01.382 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:24:01.382 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:24:01.382 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:24:01.383 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:24:01.383 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:24:01.383 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:24:01.383 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:24:01.383 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:24:01.383 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:24:01.383 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:24:01.383 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:24:01.383 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:24:01.383 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:24:01.383 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:24:01.383 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:24:01.384 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:24:01.384 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:01.384 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:24:01.384 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:01.384 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:24:01.384 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:01.384 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:24:01.384 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:24:01.384 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:24:01.384 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:24:01.384 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:01.384 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:24:01.385 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:24:01.385 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:01.385 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:01.385 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:01.385 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:24:01.385 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:24:01.385 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:01.385 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:01.385 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:01.385 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:01.385 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:24:01.385 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:24:01.385 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:24:01.386 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:24:01.386 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:24:01.386 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:01.386 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:01.386 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:24:01.386 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:24:01.386 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:24:01.386 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:24:01.386 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:01.386 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:24:01.386 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:24:01.386 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:01.387 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:01.387 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:01.387 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:24:01.387 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:24:01.387 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:01.387 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:01.387 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:01.387 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:01.387 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:24:01.387 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:24:01.387 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:24:01.387 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:24:01.387 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:24:01.388 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:01.388 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:01.388 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:24:01.388 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:24:01.388 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:24:01.388 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:24:01.388 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:01.388 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:24:01.388 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:24:01.388 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:01.388 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:01.389 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:01.389 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:24:01.389 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:24:01.389 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:01.389 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:01.389 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:01.389 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:01.389 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:24:01.389 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:24:01.389 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:24:01.389 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:24:01.389 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:24:01.389 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:01.389 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:01.390 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:01.390 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:24:01.390 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:24:01.390 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:01.390 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:24:01.390 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:24:01.390 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:24:01.390 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:01.390 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:01.390 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:24:01.390 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:01.390 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:24:01.391 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:24:01.391 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 7 2024-08-24T21:24:01.391 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:01.391 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:01.391 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:24:01.391 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:01.391 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:24:01.391 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:24:01.391 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-08-24T21:24:01.391 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:01.391 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:01.391 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:01.391 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:24:01.392 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:24:01.393 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:24:01.393 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-08-24T21:24:01.393 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-08-24T21:24:01.868 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-08-24T21:24:02.869 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:24:02.869 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:24:03.338 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":114,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:24:03.357 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:24:03.357 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-08-24T21:24:03.357 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:24:03.357 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:24:03.543 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:24:03.543 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:24:03.544 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:24:03.544 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:24:03.544 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 114, 2024-08-24T21:24:03.544 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 138682, 2024-08-24T21:24:03.544 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:24:03.544 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:24:03.544 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:24:03.544 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:24:03.544 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:03.544 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 3, 2024-08-24T21:24:03.544 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:24:03.545 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:24:03.545 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:24:03.545 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:24:03.545 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:24:03.545 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:24:03.545 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:24:03.545 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:24:03.545 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:24:03.545 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:24:03.545 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:24:03.545 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:24:03.545 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:24:03.545 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:24:03.546 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:03.546 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:24:03.546 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:24:03.546 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:24:03.546 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:24:03.546 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:24:03.546 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:24:03.546 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:24:03.546 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:24:03.546 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:24:03.546 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:24:03.546 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:24:03.547 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:24:03.547 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:24:03.547 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:03.547 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:03.547 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:24:03.547 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:24:03.547 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:24:03.547 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:24:03.547 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:24:03.547 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:24:03.547 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:24:03.547 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:24:03.548 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:24:03.548 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:24:03.548 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:24:03.548 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:24:03.548 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:24:03.548 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:24:03.548 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:24:03.548 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:24:03.548 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:24:03.548 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:24:03.548 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:24:03.548 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:24:03.548 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:24:03.549 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:24:03.549 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:24:03.549 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:24:03.549 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:24:03.549 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:24:03.549 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:24:03.549 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:24:03.549 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:03.549 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:24:03.549 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:03.549 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:24:03.549 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:03.549 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:24:03.549 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:24:03.550 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:24:03.550 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:24:03.550 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:03.550 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:24:03.550 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:24:03.550 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:03.550 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:03.550 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:03.550 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:24:03.550 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:24:03.550 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:03.550 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:03.550 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:03.551 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:03.551 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:24:03.551 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:24:03.551 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:24:03.551 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:24:03.551 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:24:03.551 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:03.551 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:03.551 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:24:03.551 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:24:03.551 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:24:03.551 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:24:03.552 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:03.552 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:24:03.552 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:24:03.552 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:03.552 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:03.552 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:03.552 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:24:03.552 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:24:03.552 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:03.552 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:03.552 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:03.552 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:03.552 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:24:03.552 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:24:03.553 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:24:03.553 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:24:03.553 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:24:03.553 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:03.553 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:03.553 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:24:03.553 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:24:03.553 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:24:03.553 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:24:03.553 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:03.554 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:24:03.554 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:24:03.554 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:03.554 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:03.554 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:03.554 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:24:03.554 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:24:03.554 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:03.554 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:03.554 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:03.554 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:03.554 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:24:03.554 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:24:03.555 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:24:03.555 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:24:03.555 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:24:03.555 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:03.555 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:03.555 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:03.555 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:24:03.555 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:24:03.555 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:03.555 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:24:03.555 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:24:03.555 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:24:03.555 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:03.556 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:03.556 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:24:03.556 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:03.556 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:24:03.556 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:24:03.556 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:24:03.556 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:03.556 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:03.556 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:24:03.556 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:03.556 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:24:03.556 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:24:03.556 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:24:03.556 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:03.557 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:03.557 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:24:03.557 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:03.557 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:24:03.557 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:24:03.557 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:24:03.557 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:03.557 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:03.557 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:03.557 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:24:03.557 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:24:03.559 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:24:03.559 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:24:03.559 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:24:03.742 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:24:03.742 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:24:03.743 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:24:03.743 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:24:03.743 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 114, 2024-08-24T21:24:03.743 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 18262, 2024-08-24T21:24:03.743 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:24:03.743 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:24:03.743 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:24:03.743 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:24:03.743 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:03.743 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 3, 2024-08-24T21:24:03.743 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:24:03.744 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:24:03.744 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:24:03.744 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:24:03.744 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:24:03.744 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:24:03.744 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:24:03.744 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:24:03.744 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:24:03.744 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:24:03.744 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:24:03.744 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:24:03.744 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:24:03.745 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:24:03.745 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:03.745 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:24:03.745 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:24:03.745 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:24:03.745 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:24:03.745 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:24:03.745 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:24:03.745 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:24:03.745 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:24:03.745 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:24:03.745 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:24:03.745 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:24:03.745 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:24:03.746 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:24:03.746 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:03.746 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:03.746 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:24:03.746 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:24:03.746 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:24:03.746 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:24:03.746 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:24:03.746 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:24:03.746 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:24:03.746 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:24:03.747 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:24:03.747 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:24:03.747 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:24:03.747 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:24:03.747 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:24:03.747 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:24:03.747 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:24:03.747 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:24:03.747 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:24:03.747 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:24:03.747 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:24:03.747 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:24:03.747 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:24:03.748 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:24:03.748 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:24:03.748 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:24:03.748 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:24:03.748 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:24:03.748 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:24:03.748 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:24:03.748 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:03.748 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:24:03.748 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:03.748 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:24:03.748 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:03.749 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:24:03.749 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:24:03.749 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:24:03.749 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:24:03.749 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:03.749 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:24:03.749 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:24:03.749 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:03.749 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:03.749 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:03.749 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:24:03.749 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:24:03.750 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:03.750 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:03.750 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:03.750 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:03.750 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:24:03.750 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:24:03.750 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:24:03.750 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:24:03.750 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:24:03.750 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:03.750 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:03.750 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:24:03.750 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:24:03.751 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:24:03.751 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:24:03.751 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:03.751 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:24:03.751 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:24:03.751 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:03.751 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:03.751 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:03.751 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:24:03.751 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:24:03.751 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:03.752 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:03.752 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:03.752 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:03.752 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:24:03.752 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:24:03.752 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:24:03.752 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:24:03.752 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:24:03.752 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:03.752 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:03.752 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:24:03.752 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:24:03.752 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:24:03.753 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:24:03.753 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:03.753 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:24:03.753 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:24:03.753 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:03.753 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:03.753 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:03.753 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:24:03.753 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:24:03.753 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:03.753 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:03.753 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:03.753 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:03.754 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:24:03.754 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:24:03.754 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:24:03.754 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:24:03.754 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:24:03.754 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:03.754 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:03.754 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:03.754 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:24:03.754 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:24:03.754 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:03.754 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:24:03.754 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:24:03.755 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:24:03.755 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:03.755 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:03.755 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:24:03.755 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:03.755 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:24:03.755 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:24:03.755 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:24:03.755 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:03.755 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:03.755 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:03.756 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:24:03.756 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:24:03.758 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:24:03.758 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:24:03.758 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:24:03.945 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:24:03.945 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:24:03.945 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:24:03.945 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:24:03.945 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 114, 2024-08-24T21:24:03.945 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 234052, 2024-08-24T21:24:03.945 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:24:03.945 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:24:03.945 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:24:03.945 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:24:03.946 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:03.946 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 3, 2024-08-24T21:24:03.946 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:24:03.946 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:24:03.946 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:24:03.946 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:24:03.946 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:24:03.946 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:24:03.946 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:24:03.946 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:24:03.946 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:24:03.946 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:24:03.946 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:24:03.946 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:24:03.947 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:24:03.947 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:24:03.947 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:03.947 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:24:03.947 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:24:03.947 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:24:03.947 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:24:03.947 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:24:03.947 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:24:03.947 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:24:03.947 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:24:03.947 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:24:03.947 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:24:03.948 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:24:03.948 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:24:03.948 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:24:03.948 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:03.948 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:03.948 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:24:03.948 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:24:03.948 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:24:03.948 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:24:03.948 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:24:03.948 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:24:03.949 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:24:03.949 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:24:03.949 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:24:03.949 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:24:03.949 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:24:03.949 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:24:03.949 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:24:03.949 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:24:03.949 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:24:03.949 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:24:03.949 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:24:03.949 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:24:03.949 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:24:03.949 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:24:03.950 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:24:03.950 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:24:03.950 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:24:03.950 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:24:03.950 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:24:03.950 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:24:03.950 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:24:03.950 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:24:03.950 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:03.950 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:24:03.950 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:03.950 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:24:03.950 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:03.951 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:24:03.951 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:24:03.951 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:24:03.951 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:24:03.951 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:03.951 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:24:03.951 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:24:03.951 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:03.951 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:03.951 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:03.951 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:24:03.951 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:24:03.951 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:03.952 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:03.952 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:03.952 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:03.952 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:24:03.952 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:24:03.952 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:24:03.952 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:24:03.952 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:24:03.952 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:03.952 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:03.952 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:24:03.952 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:24:03.953 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:24:03.953 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:24:03.953 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:03.953 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:24:03.953 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:24:03.953 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:03.953 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:03.953 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:03.953 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:24:03.953 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:24:03.953 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:03.953 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:03.953 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:03.954 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:03.954 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:24:03.954 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:24:03.954 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:24:03.954 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:24:03.954 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:24:03.954 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:03.954 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:03.954 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:24:03.954 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:24:03.954 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:24:03.954 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:24:03.954 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:03.955 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:24:03.955 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:24:03.955 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:03.955 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:03.955 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:03.955 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:24:03.955 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:24:03.955 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:03.955 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:03.955 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:03.955 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:03.955 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:24:03.955 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:24:03.956 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:24:03.956 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:24:03.956 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:24:03.956 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:03.956 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:03.956 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:03.956 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:24:03.956 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:24:03.956 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:03.956 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:24:03.956 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:24:03.956 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:24:03.956 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:03.957 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:03.957 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:24:03.957 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:03.957 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:24:03.957 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:24:03.957 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 7 2024-08-24T21:24:03.957 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:03.957 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:03.957 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:24:03.957 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:03.957 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:24:03.957 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:24:03.958 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-08-24T21:24:03.958 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:03.958 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:03.958 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:03.958 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:24:03.958 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:24:03.960 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:24:03.960 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-08-24T21:24:03.960 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-08-24T21:24:03.960 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-08-24T21:24:03.961 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-08-24T21:24:03.961 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-08-24T21:24:03.961 INFO:teuthology.orchestra.run:waiting for 300 2024-08-24T21:24:03.981 INFO:tasks.ceph.mon.a:Stopped 2024-08-24T21:24:03.981 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-08-24T21:24:03.982 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:24:04.483 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":114,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:24:04.591 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:24:04.600 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=918f909185b46c4e3744845ac52d2716 2024-08-24T21:24:04.600 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ 918f909185b46c4e3744845ac52d2716 != \9\1\8\f\9\0\9\1\8\5\b\4\6\c\4\e\3\7\4\4\8\4\5\a\c\5\2\d\2\7\1\6 ]] 2024-08-24T21:24:04.601 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap18 2024-08-24T21:24:04.601 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap18 2024-08-24T21:24:04.601 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap18 2024-08-24T21:24:04.708 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:24:04.719 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:24:04.721 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap18 2024-08-24T21:24:04.721 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:24:04.798 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:24:04.798 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:24:04.798 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:24:04.798 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:24:04.798 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:24:04.798 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap19.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:24:07.503 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:24:08.176 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":114,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:24:11.195 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:24:11.645 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":114,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:24:14.663 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:24:18.505 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 3% complete... Importing image diff: 6% complete... Importing image diff: 9% complete... Importing image diff: 12% complete... Importing image diff: 15% complete... Importing image diff: 18% complete... Importing image diff: 21% complete... Importing image diff: 24% complete... Importing image diff: 27% complete... Importing image diff: 30% complete... Importing image diff: 33% complete... Importing image diff: 36% complete... Importing image diff: 39% complete... Importing image diff: 42% complete... Importing image diff: 45% complete... Importing image diff: 48% complete... Importing image diff: 51% complete... Importing image diff: 54% complete... Importing image diff: 57% complete... Importing image diff: 60% complete... Importing image diff: 63% complete... Importing image diff: 66% complete... Importing image diff: 69% complete... Importing image diff: 72% complete... Importing image diff: 75% complete... Importing image diff: 78% complete... Importing image diff: 81% complete... Importing image diff: 84% complete... Importing image diff: 87% complete... Importing image diff: 90% complete... Importing image diff: 93% complete... Importing image diff: 96% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2024-08-24T21:24:18.527 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap19 - 2024-08-24T21:24:18.527 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:24:18.528 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:24:18.762 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":116,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:24:18.781 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-08-24T21:24:18.781 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-08-24T21:24:18.781 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:24:18.958 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:24:18.958 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:24:18.958 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:24:18.958 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:24:18.958 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 116, 2024-08-24T21:24:18.958 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 33477, 2024-08-24T21:24:18.958 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:24:18.958 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:24:18.958 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:24:18.959 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:18.959 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:24:18.959 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:24:18.959 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:24:18.959 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:24:18.959 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:24:18.959 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:24:18.959 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:24:18.959 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:24:18.959 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:24:18.959 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:24:18.959 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:24:18.960 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:24:18.960 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:24:18.960 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:24:18.960 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:24:18.960 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:18.960 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:24:18.960 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:24:18.960 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:24:18.960 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:24:18.960 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:24:18.960 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:24:18.960 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:24:18.960 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:24:18.961 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:24:18.961 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:24:18.961 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:24:18.961 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:24:18.961 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:24:18.961 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:18.961 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:18.961 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:24:18.961 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:24:18.961 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:24:18.961 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:24:18.961 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:24:18.962 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:24:18.962 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:24:18.962 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:24:18.962 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:24:18.962 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:24:18.962 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:24:18.962 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:24:18.962 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:24:18.962 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:24:18.962 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:24:18.962 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:24:18.962 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:24:18.963 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:24:18.963 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:24:18.963 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:24:18.963 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:24:18.963 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:24:18.963 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:24:18.963 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:24:18.963 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:24:18.963 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:24:18.963 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:24:18.963 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:24:18.963 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:18.964 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:24:18.964 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:18.964 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:24:18.964 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:18.964 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:24:18.964 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:24:18.964 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:24:18.964 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:24:18.964 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:18.964 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:24:18.964 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:24:18.964 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:18.964 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:18.965 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:18.965 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:24:18.965 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:24:18.965 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:18.965 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:18.965 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:18.965 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:18.965 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:24:18.965 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:24:18.965 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:24:18.965 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:24:18.965 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:24:18.966 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:18.966 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:18.966 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:24:18.966 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:24:18.966 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:24:18.966 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:24:18.966 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:18.966 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:24:18.966 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:24:18.966 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:18.966 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:18.966 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:18.967 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:24:18.967 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:24:18.967 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:18.967 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:18.967 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:18.967 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:18.967 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:24:18.967 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:24:18.967 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:24:18.967 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:24:18.967 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:24:18.967 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:18.968 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:18.968 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:24:18.968 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:24:18.968 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:24:18.968 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:24:18.968 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:18.968 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:24:18.968 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:24:18.968 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:18.968 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:18.968 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:18.968 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:24:18.968 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:24:18.969 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:18.969 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:18.969 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:18.969 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:18.969 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:24:18.969 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:24:18.969 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:24:18.969 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:24:18.970 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:24:18.970 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:18.970 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:18.970 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:18.970 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:24:18.970 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:24:18.970 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:18.970 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:24:18.970 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:24:18.970 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:24:18.970 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:18.970 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:18.971 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:24:18.971 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:18.971 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:24:18.971 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:24:18.971 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:24:18.971 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:18.971 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:18.971 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:24:18.971 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:18.971 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:24:18.971 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:24:18.971 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-08-24T21:24:18.971 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:18.972 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:18.972 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:24:18.972 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:18.972 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:24:18.972 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:24:18.972 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:24:18.972 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:18.972 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:18.972 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:18.972 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:24:18.972 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:24:18.974 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:24:18.974 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-08-24T21:24:18.974 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:24:19.151 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:24:19.151 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:24:19.152 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:24:19.152 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:24:19.152 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 116, 2024-08-24T21:24:19.152 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 249259, 2024-08-24T21:24:19.152 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:24:19.152 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:24:19.152 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:24:19.152 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:19.152 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:24:19.152 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:24:19.152 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:24:19.152 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:24:19.153 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:24:19.153 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:24:19.153 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:24:19.153 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:24:19.153 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:24:19.153 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:24:19.153 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:24:19.153 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:24:19.153 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:24:19.153 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:24:19.153 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:24:19.153 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:19.153 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:24:19.154 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:24:19.154 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:24:19.154 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:24:19.154 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:24:19.154 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:24:19.154 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:24:19.154 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:24:19.154 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:24:19.154 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:24:19.154 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:24:19.154 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:24:19.154 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:24:19.154 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:19.154 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:19.155 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:24:19.155 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:24:19.155 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:24:19.155 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:24:19.155 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:24:19.155 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:24:19.155 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:24:19.155 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:24:19.155 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:24:19.155 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:24:19.155 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:24:19.155 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:24:19.155 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:24:19.156 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:24:19.156 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:24:19.156 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:24:19.156 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:24:19.156 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:24:19.156 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:24:19.156 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:24:19.156 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:24:19.156 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:24:19.156 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:24:19.156 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:24:19.156 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:24:19.156 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:24:19.157 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:24:19.157 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:24:19.157 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:19.157 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:24:19.157 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:19.157 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:24:19.157 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:19.157 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:24:19.157 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:24:19.157 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:24:19.157 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:24:19.157 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:19.158 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:24:19.158 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:24:19.158 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:19.158 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:19.158 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:19.158 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:24:19.158 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:24:19.158 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:19.158 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:19.158 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:19.158 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:19.158 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:24:19.158 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:24:19.159 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:24:19.159 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:24:19.159 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:24:19.159 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:19.159 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:19.159 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:24:19.159 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:24:19.159 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:24:19.159 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:24:19.159 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:19.159 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:24:19.159 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:24:19.159 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:19.160 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:19.160 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:19.160 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:24:19.160 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:24:19.160 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:19.160 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:19.160 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:19.160 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:19.160 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:24:19.160 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:24:19.160 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:24:19.160 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:24:19.160 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:24:19.161 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:19.161 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:19.161 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:24:19.161 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:24:19.161 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:24:19.161 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:24:19.161 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:19.161 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:24:19.161 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:24:19.161 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:19.161 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:19.161 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:19.161 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:24:19.162 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:24:19.162 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:19.162 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:19.162 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:19.162 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:19.162 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:24:19.162 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:24:19.162 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:24:19.162 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:24:19.162 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:24:19.162 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:19.162 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:19.162 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:19.162 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:24:19.163 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:24:19.163 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:19.163 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:24:19.163 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:24:19.163 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:24:19.163 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:19.163 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:19.163 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:24:19.163 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:19.163 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:24:19.163 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:24:19.163 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 7 2024-08-24T21:24:19.163 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:19.164 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:19.164 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:24:19.164 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:19.164 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:24:19.164 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:24:19.164 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-08-24T21:24:19.164 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:19.164 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:19.164 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:24:19.164 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:19.164 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:24:19.164 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:24:19.164 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:24:19.164 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:19.165 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:19.165 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:19.165 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:24:19.165 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:24:19.166 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:24:19.166 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-08-24T21:24:23.479 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:24:23.567 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=e9e5da706de44a6f39dd1587096ef6d4 2024-08-24T21:24:23.568 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap19 - 2024-08-24T21:24:23.568 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:24:23.568 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:24:28.604 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:24:28.615 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=e9e5da706de44a6f39dd1587096ef6d4 2024-08-24T21:24:28.615 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ e9e5da706de44a6f39dd1587096ef6d4 != \e\9\e\5\d\a\7\0\6\d\e\4\4\a\6\f\3\9\d\d\1\5\8\7\0\9\6\e\f\6\d\4 ]] 2024-08-24T21:24:28.615 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap19 2024-08-24T21:24:28.615 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap19 2024-08-24T21:24:28.615 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap19 2024-08-24T21:24:28.719 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:24:28.731 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:24:28.732 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap19 2024-08-24T21:24:28.732 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:24:28.810 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:24:28.810 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:24:28.810 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:24:28.810 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:24:28.810 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:24:28.810 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap20.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:24:30.530 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 5% complete... Importing image diff: 11% complete... Importing image diff: 12% complete... Importing image diff: 18% complete... Importing image diff: 23% complete... Importing image diff: 29% complete... Importing image diff: 35% complete... Importing image diff: 41% complete... Importing image diff: 47% complete... Importing image diff: 52% complete... Importing image diff: 58% complete... Importing image diff: 64% complete... Importing image diff: 70% complete... Importing image diff: 71% complete... Importing image diff: 76% complete... Importing image diff: 82% complete... Importing image diff: 88% complete... Importing image diff: 94% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2024-08-24T21:24:30.548 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap20 - 2024-08-24T21:24:30.548 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:24:30.548 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:24:35.470 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:24:35.540 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=64f2005b1317e07173e83d177ef5fd4b 2024-08-24T21:24:35.541 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap20 - 2024-08-24T21:24:35.541 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:24:35.542 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:24:39.166 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-08-24T21:24:39.167 INFO:tasks.ceph.mon.a:Restarting daemon 2024-08-24T21:24:39.167 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-08-24T21:24:39.171 INFO:tasks.ceph.mon.a:Started 2024-08-24T21:24:39.171 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:24:39.172 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:24:39.633 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":116,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":21,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:24:40.771 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:24:40.781 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=64f2005b1317e07173e83d177ef5fd4b 2024-08-24T21:24:40.781 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ 64f2005b1317e07173e83d177ef5fd4b != \6\4\f\2\0\0\5\b\1\3\1\7\e\0\7\1\7\3\e\8\3\d\1\7\7\e\f\5\f\d\4\b ]] 2024-08-24T21:24:40.782 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap20 2024-08-24T21:24:40.782 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap20 2024-08-24T21:24:40.782 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap20 2024-08-24T21:24:40.887 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:24:40.899 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:24:40.902 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap20 2024-08-24T21:24:40.902 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:24:40.978 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:24:40.978 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:24:40.978 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:24:40.978 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:24:40.979 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:24:40.979 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap21.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:24:41.559 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 52% complete... Importing image diff: 77% complete... Importing image diff: 97% complete... Importing image diff: 100% complete...done. 2024-08-24T21:24:41.577 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap21 - 2024-08-24T21:24:41.577 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:24:41.577 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:24:42.654 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:24:43.129 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":116,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":24,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:24:46.149 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:24:46.504 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:24:46.584 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=64f2005b1317e07173e83d177ef5fd4b 2024-08-24T21:24:46.585 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap21 - 2024-08-24T21:24:46.585 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:24:46.585 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:24:52.251 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":124,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:24:52.270 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:24:52.270 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:24:52.270 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:24:52.456 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:24:52.456 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:24:52.456 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:24:52.456 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:24:52.456 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 124, 2024-08-24T21:24:52.456 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 13136, 2024-08-24T21:24:52.456 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:24:52.456 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:24:52.456 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:24:52.457 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:24:52.457 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:52.457 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:24:52.457 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:24:52.457 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:24:52.457 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:24:52.457 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:24:52.457 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:24:52.457 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:24:52.457 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:24:52.457 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:24:52.457 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:24:52.458 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:24:52.458 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:24:52.458 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:24:52.458 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:24:52.458 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:24:52.458 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:52.458 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:24:52.458 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:24:52.458 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:24:52.458 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:24:52.458 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:24:52.458 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:24:52.459 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:24:52.459 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:24:52.459 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:24:52.459 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:24:52.459 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:24:52.459 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:24:52.459 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:24:52.459 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:52.459 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:52.459 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:24:52.459 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:24:52.459 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:24:52.459 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:24:52.460 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:24:52.460 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:24:52.460 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:24:52.460 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:24:52.460 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:24:52.460 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:24:52.460 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:24:52.460 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:24:52.460 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:24:52.460 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:24:52.460 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:24:52.460 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:24:52.461 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:24:52.461 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:24:52.461 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:24:52.461 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:24:52.461 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:24:52.461 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:24:52.461 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:24:52.461 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:24:52.461 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:24:52.461 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:24:52.461 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:24:52.461 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:24:52.462 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:52.462 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:24:52.462 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:52.462 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:24:52.462 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:52.462 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:24:52.462 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:24:52.462 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:24:52.462 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:24:52.462 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:52.462 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:24:52.462 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:24:52.462 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:52.463 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:52.463 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:52.463 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:24:52.463 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:24:52.463 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:52.463 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:52.463 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:52.463 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:52.463 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:24:52.463 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:24:52.463 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:24:52.463 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:24:52.464 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:24:52.464 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:52.464 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:52.464 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:24:52.464 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:24:52.464 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:24:52.464 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:24:52.464 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:52.464 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:24:52.464 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:24:52.464 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:52.464 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:52.464 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:52.465 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:24:52.465 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:24:52.465 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:52.465 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:52.465 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:52.465 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:52.465 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:24:52.465 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:24:52.465 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:24:52.465 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:24:52.465 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:24:52.465 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:52.466 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:52.466 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:24:52.466 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:24:52.466 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:24:52.466 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:24:52.466 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:52.466 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:24:52.466 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:24:52.466 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:52.466 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:52.466 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:52.466 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:24:52.466 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:24:52.467 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:52.467 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:52.467 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:52.467 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:52.467 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:24:52.467 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:24:52.467 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:24:52.467 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:24:52.467 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:24:52.467 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:52.467 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:52.467 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:52.467 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:24:52.468 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:24:52.468 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:52.468 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:24:52.468 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:24:52.468 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:24:52.468 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:52.468 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:52.468 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:24:52.468 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:52.468 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:24:52.468 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:24:52.468 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:24:52.468 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:52.469 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:52.469 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:52.469 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:24:52.469 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:24:52.471 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:24:52.471 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:24:52.471 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:24:52.652 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:24:52.653 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:24:52.653 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:24:52.653 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:24:52.653 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 124, 2024-08-24T21:24:52.653 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 67173, 2024-08-24T21:24:52.653 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:24:52.653 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:24:52.653 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:24:52.653 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:24:52.653 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:52.654 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:24:52.654 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:24:52.654 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:24:52.654 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:24:52.654 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:24:52.654 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:24:52.654 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:24:52.654 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:24:52.654 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:24:52.654 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:24:52.654 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:24:52.654 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:24:52.655 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:24:52.655 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:24:52.655 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:24:52.655 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:52.655 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:24:52.655 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:24:52.655 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:24:52.655 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:24:52.655 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:24:52.655 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:24:52.655 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:24:52.655 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:24:52.656 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:24:52.656 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:24:52.656 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:24:52.656 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:24:52.656 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:24:52.656 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:52.656 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:52.656 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:24:52.656 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:24:52.656 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:24:52.656 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:24:52.656 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:24:52.656 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:24:52.657 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:24:52.657 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:24:52.657 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:24:52.657 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:24:52.657 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:24:52.657 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:24:52.657 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:24:52.657 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:24:52.657 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:24:52.657 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:24:52.657 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:24:52.657 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:24:52.658 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:24:52.658 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:24:52.658 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:24:52.658 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:24:52.658 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:24:52.658 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:24:52.658 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:24:52.658 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:24:52.658 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:24:52.658 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:24:52.658 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:52.658 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:24:52.658 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:52.659 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:24:52.659 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:52.659 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:24:52.659 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:24:52.659 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:24:52.659 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:24:52.659 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:52.659 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:24:52.659 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:24:52.659 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:52.659 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:52.659 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:52.660 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:24:52.660 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:24:52.660 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:52.660 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:52.660 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:52.660 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:52.660 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:24:52.660 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:24:52.660 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:24:52.660 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:24:52.660 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:24:52.660 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:52.660 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:52.661 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:24:52.661 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:24:52.661 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:24:52.661 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:24:52.661 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:52.661 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:24:52.661 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:24:52.661 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:52.661 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:52.661 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:52.661 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:24:52.661 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:24:52.661 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:52.662 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:52.662 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:52.662 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:52.662 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:24:52.662 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:24:52.662 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:24:52.662 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:24:52.662 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:24:52.662 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:52.662 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:52.662 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:24:52.662 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:24:52.662 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:24:52.663 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:24:52.663 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:52.663 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:24:52.663 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:24:52.663 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:52.663 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:52.663 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:52.663 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:24:52.663 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:24:52.663 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:52.663 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:52.663 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:52.664 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:52.664 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:24:52.664 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:24:52.664 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:24:52.664 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:24:52.664 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:24:52.664 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:52.664 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:52.664 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:52.664 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:24:52.664 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:24:52.664 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:52.664 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:24:52.664 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:24:52.665 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:24:52.665 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:52.665 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:52.665 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:24:52.665 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:52.665 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:24:52.665 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:24:52.665 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:24:52.665 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:52.665 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:52.665 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:24:52.665 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:52.665 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:24:52.666 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:24:52.666 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:24:52.666 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:52.666 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:52.666 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:24:52.666 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:52.666 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:24:52.666 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:24:52.666 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:24:52.666 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:52.666 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:52.666 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:52.666 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:24:52.667 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:24:52.668 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:24:52.668 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:24:52.668 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:24:52.848 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:24:52.849 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:24:52.849 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:24:52.849 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:24:52.849 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 124, 2024-08-24T21:24:52.849 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 282957, 2024-08-24T21:24:52.849 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:24:52.849 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:24:52.849 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:24:52.849 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:24:52.849 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:52.850 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:24:52.850 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:24:52.850 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:24:52.850 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:24:52.850 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:24:52.850 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:24:52.850 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:24:52.850 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:24:52.850 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:24:52.850 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:24:52.850 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:24:52.850 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:24:52.851 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:24:52.851 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:24:52.851 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:24:52.851 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:52.851 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:24:52.851 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:24:52.851 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:24:52.851 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:24:52.851 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:24:52.851 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:24:52.851 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:24:52.852 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:24:52.852 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:24:52.852 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:24:52.852 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:24:52.852 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:24:52.852 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:24:52.852 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:52.852 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:52.852 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:24:52.852 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:24:52.852 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:24:52.852 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:24:52.853 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:24:52.853 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:24:52.853 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:24:52.853 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:24:52.853 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:24:52.853 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:24:52.853 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:24:52.853 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:24:52.853 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:24:52.853 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:24:52.853 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:24:52.853 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:24:52.854 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:24:52.854 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:24:52.854 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:24:52.854 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:24:52.854 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:24:52.854 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:24:52.854 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:24:52.854 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:24:52.854 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:24:52.854 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:24:52.854 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:24:52.854 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:24:52.855 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:52.855 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:24:52.855 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:52.855 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:24:52.855 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:52.855 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:24:52.855 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:24:52.855 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:24:52.855 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:24:52.855 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:52.855 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:24:52.855 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:24:52.856 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:52.856 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:52.856 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:52.856 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:24:52.856 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:24:52.856 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:52.856 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:52.856 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:52.856 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:52.856 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:24:52.856 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:24:52.856 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:24:52.857 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:24:52.857 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:24:52.857 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:52.857 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:52.857 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:24:52.857 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:24:52.857 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:24:52.857 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:24:52.857 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:52.857 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:24:52.857 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:24:52.857 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:52.858 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:52.858 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:52.858 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:24:52.858 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:24:52.858 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:52.858 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:52.858 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:52.858 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:52.858 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:24:52.858 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:24:52.858 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:24:52.858 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:24:52.858 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:24:52.859 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:52.859 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:52.859 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:24:52.859 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:24:52.859 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:24:52.859 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:24:52.859 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:52.859 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:24:52.859 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:24:52.859 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:52.859 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:52.859 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:52.860 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:24:52.860 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:24:52.860 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:52.860 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:52.860 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:52.860 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:52.860 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:24:52.860 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:24:52.860 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:24:52.860 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:24:52.860 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:24:52.860 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:52.860 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:52.861 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:52.861 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:24:52.861 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:24:52.861 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:52.861 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:24:52.861 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:24:52.861 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:24:52.861 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:52.861 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:52.861 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:24:52.861 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:52.861 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:24:52.861 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:24:52.862 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 7 2024-08-24T21:24:52.862 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:52.862 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:52.862 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:24:52.862 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:52.862 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:24:52.862 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:24:52.862 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:24:52.862 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:52.862 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:52.862 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:24:52.862 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:52.862 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:24:52.863 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:24:52.863 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:24:52.863 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:52.863 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:52.863 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:52.863 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:24:52.863 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:24:52.864 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:24:52.864 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-08-24T21:24:52.865 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-08-24T21:24:53.339 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-08-24T21:24:54.341 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:24:54.341 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:24:54.809 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":124,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:24:54.829 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:24:54.829 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-08-24T21:24:54.829 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:24:54.829 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:24:55.015 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:24:55.016 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:24:55.016 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:24:55.016 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:24:55.016 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 124, 2024-08-24T21:24:55.016 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 15696, 2024-08-24T21:24:55.016 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:24:55.016 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:24:55.016 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:24:55.016 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:24:55.016 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:55.016 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 3, 2024-08-24T21:24:55.016 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:24:55.016 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:24:55.017 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:24:55.017 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:24:55.017 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:24:55.017 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:24:55.017 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:24:55.017 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:24:55.017 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:24:55.017 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:24:55.017 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:24:55.017 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:24:55.017 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:24:55.017 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:24:55.017 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:55.018 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:24:55.018 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:24:55.018 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:24:55.018 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:24:55.018 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:24:55.018 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:24:55.018 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:24:55.018 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:24:55.018 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:24:55.018 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:24:55.018 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:24:55.018 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:24:55.018 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:24:55.018 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:55.019 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:55.019 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:24:55.019 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:24:55.019 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:24:55.019 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:24:55.019 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:24:55.019 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:24:55.019 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:24:55.019 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:24:55.019 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:24:55.019 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:24:55.020 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:24:55.020 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:24:55.020 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:24:55.020 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:24:55.020 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:24:55.020 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:24:55.020 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:24:55.020 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:24:55.020 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:24:55.020 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:24:55.020 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:24:55.020 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:24:55.021 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:24:55.021 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:24:55.021 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:24:55.021 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:24:55.021 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:24:55.021 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:24:55.021 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:55.021 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:24:55.021 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:55.021 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:24:55.021 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:55.021 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:24:55.021 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:24:55.022 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:24:55.022 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:24:55.022 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:55.022 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:24:55.022 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:24:55.022 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:55.022 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:55.022 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:55.022 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:24:55.022 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:24:55.022 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:55.022 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:55.023 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:55.023 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:55.023 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:24:55.023 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:24:55.023 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:24:55.023 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:24:55.023 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:24:55.023 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:55.023 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:55.023 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:24:55.023 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:24:55.023 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:24:55.023 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:24:55.024 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:55.024 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:24:55.024 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:24:55.024 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:55.024 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:55.024 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:55.024 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:24:55.024 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:24:55.024 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:55.024 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:55.025 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:55.025 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:55.025 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:24:55.025 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:24:55.025 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:24:55.025 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:24:55.025 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:24:55.025 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:55.025 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:55.025 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:24:55.025 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:24:55.025 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:24:55.026 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:24:55.026 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:55.026 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:24:55.026 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:24:55.026 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:55.026 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:55.026 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:55.026 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:24:55.026 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:24:55.026 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:55.026 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:55.026 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:55.027 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:55.027 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:24:55.027 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:24:55.027 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:24:55.027 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:24:55.027 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:24:55.027 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:55.027 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:55.027 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:55.027 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:24:55.027 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:24:55.027 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:55.028 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:24:55.028 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:24:55.028 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:24:55.028 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:55.028 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:55.028 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:24:55.028 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:55.028 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:24:55.028 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:24:55.028 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:24:55.028 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:55.028 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:55.028 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:55.029 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:24:55.029 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:24:55.031 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:24:55.031 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:24:55.031 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:24:55.218 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:24:55.218 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:24:55.218 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:24:55.218 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:24:55.219 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 124, 2024-08-24T21:24:55.219 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 69738, 2024-08-24T21:24:55.219 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:24:55.219 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:24:55.219 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:24:55.219 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:24:55.219 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:55.219 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 3, 2024-08-24T21:24:55.219 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:24:55.219 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:24:55.219 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:24:55.220 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:24:55.220 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:24:55.220 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:24:55.220 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:24:55.220 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:24:55.220 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:24:55.220 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:24:55.220 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:24:55.220 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:24:55.220 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:24:55.220 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:24:55.220 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:55.221 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:24:55.221 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:24:55.221 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:24:55.221 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:24:55.221 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:24:55.221 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:24:55.221 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:24:55.221 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:24:55.221 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:24:55.221 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:24:55.221 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:24:55.221 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:24:55.222 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:24:55.222 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:55.222 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:55.222 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:24:55.222 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:24:55.222 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:24:55.222 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:24:55.222 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:24:55.223 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:24:55.223 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:24:55.223 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:24:55.223 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:24:55.223 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:24:55.223 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:24:55.223 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:24:55.223 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:24:55.223 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:24:55.223 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:24:55.223 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:24:55.223 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:24:55.223 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:24:55.224 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:24:55.224 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:24:55.224 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:24:55.224 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:24:55.224 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:24:55.224 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:24:55.224 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:24:55.224 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:24:55.224 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:24:55.224 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:24:55.224 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:55.224 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:24:55.224 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:55.225 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:24:55.225 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:55.225 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:24:55.225 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:24:55.225 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:24:55.225 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:24:55.225 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:55.225 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:24:55.225 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:24:55.225 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:55.225 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:55.225 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:55.225 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:24:55.226 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:24:55.226 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:55.226 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:55.226 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:55.226 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:55.226 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:24:55.226 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:24:55.226 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:24:55.226 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:24:55.226 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:24:55.226 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:55.226 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:55.227 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:24:55.227 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:24:55.227 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:24:55.227 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:24:55.227 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:55.227 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:24:55.227 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:24:55.227 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:55.227 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:55.227 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:55.227 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:24:55.227 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:24:55.227 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:55.228 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:55.228 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:55.228 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:55.228 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:24:55.228 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:24:55.228 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:24:55.228 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:24:55.228 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:24:55.228 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:55.228 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:55.228 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:24:55.228 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:24:55.228 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:24:55.228 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:24:55.229 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:55.229 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:24:55.229 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:24:55.229 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:55.229 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:55.229 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:55.229 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:24:55.229 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:24:55.229 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:55.229 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:55.229 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:55.229 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:55.229 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:24:55.230 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:24:55.230 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:24:55.230 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:24:55.230 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:24:55.230 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:55.230 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:55.230 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:55.230 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:24:55.230 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:24:55.230 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:55.230 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:24:55.230 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:24:55.230 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:24:55.231 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:55.231 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:55.231 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:24:55.231 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:55.231 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:24:55.231 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:24:55.231 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:24:55.231 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:55.231 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:55.231 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:24:55.231 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:55.231 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:24:55.231 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:24:55.232 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:24:55.232 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:55.232 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:55.232 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:24:55.232 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:55.232 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:24:55.232 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:24:55.232 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:24:55.232 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:55.232 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:55.232 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:55.232 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:24:55.232 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:24:55.234 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:24:55.234 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:24:55.234 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:24:55.418 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:24:55.419 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:24:55.419 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:24:55.419 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:24:55.419 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 124, 2024-08-24T21:24:55.419 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 285526, 2024-08-24T21:24:55.419 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:24:55.419 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:24:55.419 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:24:55.419 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:24:55.419 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:55.420 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 3, 2024-08-24T21:24:55.420 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:24:55.420 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:24:55.420 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:24:55.420 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:24:55.420 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:24:55.420 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:24:55.420 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:24:55.420 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:24:55.420 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:24:55.420 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:24:55.420 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:24:55.421 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:24:55.421 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:24:55.421 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:24:55.421 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:55.421 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:24:55.421 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:24:55.421 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:24:55.421 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:24:55.421 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:24:55.421 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:24:55.421 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:24:55.421 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:24:55.421 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:24:55.422 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:24:55.422 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:24:55.422 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:24:55.422 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:24:55.422 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:55.422 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:55.422 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:24:55.422 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:24:55.422 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:24:55.422 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:24:55.423 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:24:55.423 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:24:55.423 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:24:55.423 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:24:55.423 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:24:55.423 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:24:55.423 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:24:55.423 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:24:55.423 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:24:55.424 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:24:55.424 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:24:55.424 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:24:55.424 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:24:55.424 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:24:55.424 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:24:55.424 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:24:55.424 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:24:55.424 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:24:55.424 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:24:55.424 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:24:55.424 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:24:55.424 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:24:55.425 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:24:55.425 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:24:55.425 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:55.425 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:24:55.425 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:55.425 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:24:55.425 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:55.425 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:24:55.425 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:24:55.425 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:24:55.425 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:24:55.425 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:55.425 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:24:55.426 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:24:55.426 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:55.426 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:55.426 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:55.426 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:24:55.426 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:24:55.426 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:55.426 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:55.426 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:55.426 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:55.426 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:24:55.426 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:24:55.427 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:24:55.427 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:24:55.427 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:24:55.427 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:55.427 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:55.427 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:24:55.427 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:24:55.427 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:24:55.427 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:24:55.427 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:55.427 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:24:55.427 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:24:55.427 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:55.428 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:55.428 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:55.428 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:24:55.428 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:24:55.428 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:55.428 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:55.428 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:55.428 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:55.428 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:24:55.428 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:24:55.428 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:24:55.428 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:24:55.428 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:24:55.429 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:55.429 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:55.429 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:24:55.429 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:24:55.429 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:24:55.429 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:24:55.429 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:55.429 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:24:55.429 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:24:55.429 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:55.429 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:55.429 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:55.429 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:24:55.430 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:24:55.430 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:24:55.430 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:55.430 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:55.430 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:55.430 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:24:55.430 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:24:55.430 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:24:55.430 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:24:55.430 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:24:55.430 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:55.430 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:55.431 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:55.431 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:24:55.431 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:24:55.431 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:55.431 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:24:55.431 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:24:55.431 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:24:55.431 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:55.431 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:55.431 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:24:55.431 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:55.432 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:24:55.432 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:24:55.432 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 7 2024-08-24T21:24:55.432 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:55.432 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:55.432 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:24:55.432 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:55.432 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:24:55.432 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:24:55.432 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:24:55.432 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:55.432 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:24:55.432 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:24:55.432 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:24:55.433 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:24:55.433 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:24:55.433 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:24:55.433 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:24:55.433 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:24:55.433 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:24:55.433 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:24:55.433 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:24:55.434 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:24:55.435 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2024-08-24T21:24:55.435 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['a'] 2024-08-24T21:24:55.435 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-08-24T21:24:55.435 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-08-24T21:24:55.435 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-08-24T21:24:55.435 INFO:teuthology.orchestra.run:waiting for 300 2024-08-24T21:24:55.459 INFO:tasks.ceph.mon.b:Stopped 2024-08-24T21:24:55.459 INFO:tasks.mon_thrash:Sending STOP to mon a 2024-08-24T21:24:55.459 INFO:tasks.ceph.mon.a:Sent signal 19 2024-08-24T21:24:55.460 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-08-24T21:24:56.956 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:24:56.969 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=64f2005b1317e07173e83d177ef5fd4b 2024-08-24T21:24:56.969 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ 64f2005b1317e07173e83d177ef5fd4b != \6\4\f\2\0\0\5\b\1\3\1\7\e\0\7\1\7\3\e\8\3\d\1\7\7\e\f\5\f\d\4\b ]] 2024-08-24T21:24:56.969 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap21 2024-08-24T21:24:56.969 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap21 2024-08-24T21:24:56.969 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap21 2024-08-24T21:24:57.077 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:24:57.091 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:24:57.092 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap21 2024-08-24T21:24:57.092 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:24:57.171 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:24:57.171 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:24:57.172 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:24:57.172 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:24:57.172 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:24:57.172 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap22.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:25:10.460 INFO:tasks.mon_thrash:Sending CONT to mon a 2024-08-24T21:25:10.461 INFO:tasks.ceph.mon.a:Sent signal 18 2024-08-24T21:25:10.461 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-08-24T21:25:10.461 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:25:15.767 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":128,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:25:15.786 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-08-24T21:25:15.786 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-08-24T21:25:15.786 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:25:15.962 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:25:15.962 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:25:15.963 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:25:15.963 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:25:15.963 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 128, 2024-08-24T21:25:15.963 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 36643, 2024-08-24T21:25:15.963 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:25:15.963 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:25:15.963 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:25:15.963 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:25:15.963 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:25:15.963 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:25:15.963 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:25:15.963 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:25:15.963 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:25:15.964 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:25:15.964 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:25:15.964 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:25:15.964 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:25:15.964 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:25:15.964 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:25:15.964 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:25:15.964 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:25:15.964 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:25:15.964 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:25:15.964 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:25:15.964 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:25:15.964 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:25:15.965 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:25:15.965 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:25:15.965 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:25:15.965 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:25:15.965 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:25:15.965 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:25:15.965 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:25:15.965 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:25:15.965 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:25:15.965 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:25:15.965 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:25:15.966 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:25:15.966 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:25:15.966 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:25:15.966 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:25:15.966 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:25:15.966 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:25:15.966 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:25:15.966 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:25:15.966 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:25:15.966 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:25:15.966 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:25:15.966 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:25:15.967 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:25:15.967 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:25:15.967 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:25:15.967 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:25:15.967 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:25:15.967 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:25:15.967 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:25:15.967 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:25:15.967 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:25:15.967 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:25:15.967 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:25:15.967 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:25:15.968 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:25:15.968 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:25:15.968 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:25:15.968 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:25:15.968 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:25:15.968 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:25:15.968 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:25:15.968 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:25:15.968 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:25:15.968 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:25:15.968 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:25:15.968 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:25:15.969 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:25:15.969 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:25:15.969 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:25:15.969 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:25:15.969 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:25:15.969 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:25:15.969 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:25:15.969 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:25:15.969 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:25:15.969 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:25:15.969 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:25:15.969 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:25:15.969 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:25:15.970 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:25:15.970 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:25:15.970 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:25:15.970 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:25:15.970 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:25:15.970 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:25:15.970 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:25:15.970 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:25:15.970 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:25:15.970 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:25:15.970 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:25:15.970 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:25:15.970 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:25:15.971 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:25:15.971 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:25:15.971 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:25:15.971 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:25:15.971 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:25:15.971 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:25:15.971 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:25:15.971 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:25:15.971 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:25:15.971 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:25:15.971 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:25:15.971 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:25:15.972 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:25:15.972 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:25:15.972 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:25:15.972 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:25:15.972 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:25:15.972 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:25:15.972 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:25:15.972 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:25:15.972 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:25:15.972 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:25:15.972 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:25:15.972 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:25:15.973 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:25:15.973 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:25:15.973 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:25:15.973 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:25:15.973 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:25:15.973 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:25:15.973 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:25:15.973 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:25:15.973 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:25:15.973 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:25:15.973 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:25:15.973 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:25:15.973 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:25:15.973 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:25:15.974 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:25:15.974 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:25:15.974 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:25:15.974 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:25:15.974 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:25:15.974 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:25:15.974 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:25:15.974 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:25:15.974 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:25:15.974 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:25:15.974 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:25:15.974 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:25:15.974 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:25:15.975 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:25:15.975 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:25:15.975 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:25:15.975 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:25:15.975 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 6 2024-08-24T21:25:15.975 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:25:15.975 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:25:15.975 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:25:15.975 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:25:15.975 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:25:15.975 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:25:15.975 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:25:15.975 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:25:15.975 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:25:15.976 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:25:15.976 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:25:15.976 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:25:15.976 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:25:15.976 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:25:15.976 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:25:15.976 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:25:15.976 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:25:15.976 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:25:15.976 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:25:15.977 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:25:15.978 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-08-24T21:25:15.978 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:25:16.152 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:25:16.152 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:25:16.152 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:25:16.152 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:25:16.152 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 128, 2024-08-24T21:25:16.152 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 90672, 2024-08-24T21:25:16.152 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:25:16.153 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:25:16.153 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:25:16.153 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:25:16.153 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:25:16.153 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:25:16.153 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:25:16.153 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:25:16.153 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:25:16.153 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:25:16.153 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:25:16.153 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:25:16.153 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:25:16.153 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:25:16.153 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:25:16.154 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:25:16.154 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:25:16.154 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:25:16.154 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:25:16.154 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:25:16.154 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:25:16.154 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:25:16.154 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:25:16.154 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:25:16.154 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:25:16.154 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:25:16.154 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:25:16.154 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:25:16.155 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:25:16.155 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:25:16.155 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:25:16.155 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:25:16.155 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:25:16.155 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:25:16.155 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:25:16.155 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:25:16.155 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:25:16.155 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:25:16.156 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:25:16.156 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:25:16.156 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:25:16.156 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:25:16.156 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:25:16.156 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:25:16.156 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:25:16.156 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:25:16.156 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:25:16.156 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:25:16.156 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:25:16.156 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:25:16.156 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:25:16.156 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:25:16.157 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:25:16.157 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:25:16.157 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:25:16.157 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:25:16.157 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:25:16.157 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:25:16.157 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:25:16.157 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:25:16.157 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:25:16.157 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:25:16.157 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:25:16.157 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:25:16.157 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:25:16.158 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:25:16.158 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:25:16.158 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:25:16.158 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:25:16.158 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:25:16.158 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:25:16.158 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:25:16.158 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:25:16.158 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:25:16.158 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:25:16.158 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:25:16.158 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:25:16.159 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:25:16.159 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:25:16.159 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:25:16.159 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:25:16.159 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:25:16.159 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:25:16.159 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:25:16.159 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:25:16.159 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:25:16.159 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:25:16.159 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:25:16.159 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:25:16.159 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:25:16.159 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:25:16.160 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:25:16.160 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:25:16.160 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:25:16.160 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:25:16.160 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:25:16.160 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:25:16.160 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:25:16.160 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:25:16.160 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:25:16.160 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:25:16.160 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:25:16.160 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:25:16.160 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:25:16.160 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:25:16.161 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:25:16.161 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:25:16.161 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:25:16.161 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:25:16.161 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:25:16.161 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:25:16.161 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:25:16.161 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:25:16.161 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:25:16.161 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:25:16.161 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:25:16.161 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:25:16.162 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:25:16.162 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:25:16.162 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:25:16.162 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:25:16.162 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:25:16.162 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:25:16.162 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:25:16.162 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:25:16.162 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:25:16.162 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:25:16.162 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:25:16.162 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:25:16.162 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:25:16.163 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:25:16.163 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:25:16.163 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:25:16.163 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:25:16.163 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:25:16.163 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:25:16.163 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:25:16.163 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:25:16.163 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:25:16.163 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:25:16.163 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:25:16.163 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:25:16.163 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:25:16.163 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:25:16.164 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:25:16.164 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:25:16.164 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:25:16.164 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:25:16.164 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:25:16.164 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:25:16.164 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:25:16.164 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:25:16.164 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:25:16.164 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:25:16.164 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:25:16.164 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:25:16.164 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:25:16.164 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-08-24T21:25:16.165 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:25:16.165 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:25:16.165 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:25:16.165 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:25:16.165 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:25:16.165 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:25:16.165 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:25:16.165 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:25:16.165 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:25:16.165 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:25:16.165 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:25:16.165 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:25:16.166 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:25:16.167 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-08-24T21:25:16.492 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 50% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2024-08-24T21:25:16.514 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap22 - 2024-08-24T21:25:16.514 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:25:16.515 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:25:21.531 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:25:21.607 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=f268adb9e831f92c1154375001e66738 2024-08-24T21:25:21.609 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap22 - 2024-08-24T21:25:21.609 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:25:21.609 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:25:26.707 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:25:26.718 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=f268adb9e831f92c1154375001e66738 2024-08-24T21:25:26.718 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ f268adb9e831f92c1154375001e66738 != \f\2\6\8\a\d\b\9\e\8\3\1\f\9\2\c\1\1\5\4\3\7\5\0\0\1\e\6\6\7\3\8 ]] 2024-08-24T21:25:26.718 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap22 2024-08-24T21:25:26.718 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap22 2024-08-24T21:25:26.718 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap22 2024-08-24T21:25:26.827 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:25:26.839 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:25:26.840 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap22 2024-08-24T21:25:26.840 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:25:26.917 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:25:26.917 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:25:26.917 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:25:26.918 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:25:26.918 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:25:26.918 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap23.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:25:27.508 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 1% complete... Importing image diff: 2% complete... Importing image diff: 3% complete... Importing image diff: 4% complete... Importing image diff: 5% complete... Importing image diff: 6% complete... Importing image diff: 7% complete... Importing image diff: 8% complete... Importing image diff: 9% complete... Importing image diff: 10% complete... Importing image diff: 11% complete... Importing image diff: 12% complete... Importing image diff: 13% complete... Importing image diff: 14% complete... Importing image diff: 15% complete... Importing image diff: 16% complete... Importing image diff: 17% complete... Importing image diff: 18% complete... Importing image diff: 19% complete... Importing image diff: 20% complete... Importing image diff: 21% complete... Importing image diff: 22% complete... Importing image diff: 23% complete... Importing image diff: 24% complete... Importing image diff: 25% complete... Importing image diff: 26% complete... Importing image diff: 27% complete... Importing image diff: 28% complete... Importing image diff: 29% complete... Importing image diff: 30% complete... Importing image diff: 31% complete... Importing image diff: 32% complete... Importing image diff: 33% complete... Importing image diff: 34% complete... Importing image diff: 35% complete... Importing image diff: 36% complete... Importing image diff: 37% complete... Importing image diff: 38% complete... Importing image diff: 39% complete... Importing image diff: 40% complete... Importing image diff: 41% complete... Importing image diff: 42% complete... Importing image diff: 43% complete... Importing image diff: 44% complete... Importing image diff: 45% complete... Importing image diff: 46% complete... Importing image diff: 47% complete... Importing image diff: 48% complete... Importing image diff: 49% complete... Importing image diff: 50% complete... Importing image diff: 51% complete... Importing image diff: 52% complete... Importing image diff: 53% complete... Importing image diff: 54% complete... Importing image diff: 55% complete... Importing image diff: 56% complete... Importing image diff: 57% complete... Importing image diff: 58% complete... Importing image diff: 59% complete... Importing image diff: 60% complete... Importing image diff: 61% complete... Importing image diff: 62% complete... Importing image diff: 63% complete... Importing image diff: 64% complete... Importing image diff: 65% complete... Importing image diff: 66% complete... Importing image diff: 67% complete... Importing image diff: 68% complete... Importing image diff: 69% complete... Importing image diff: 70% complete... Importing image diff: 71% complete... Importing image diff: 72% complete... Importing image diff: 73% complete... Importing image diff: 74% complete... Importing image diff: 75% complete... Importing image diff: 76% complete... Importing image diff: 77% complete... Importing image diff: 78% complete... Importing image diff: 79% complete... Importing image diff: 80% complete... Importing image diff: 81% complete... Importing image diff: 82% complete... Importing image diff: 83% complete... Importing image diff: 84% complete... Importing image diff: 85% complete... Importing image diff: 86% complete... Importing image diff: 87% complete... Importing image diff: 88% complete... Importing image diff: 89% complete... Importing image diff: 90% complete... Importing image diff: 91% complete... Importing image diff: 92% complete... Importing image diff: 93% complete... Importing image diff: 94% complete... Importing image diff: 95% complete... Importing image diff: 96% complete... Importing image diff: 97% complete... Importing image diff: 98% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2024-08-24T21:25:27.528 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap23 - 2024-08-24T21:25:27.528 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:25:27.529 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:25:32.453 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:25:32.533 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=7e090d1170da147c882da3f90b5a065e 2024-08-24T21:25:32.534 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap23 - 2024-08-24T21:25:32.534 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:25:32.535 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:25:36.167 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-08-24T21:25:36.167 INFO:tasks.ceph.mon.b:Restarting daemon 2024-08-24T21:25:36.167 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-08-24T21:25:36.172 INFO:tasks.ceph.mon.b:Started 2024-08-24T21:25:36.172 INFO:tasks.mon_thrash:Sending STOP to mon a 2024-08-24T21:25:36.172 INFO:tasks.ceph.mon.a:Sent signal 19 2024-08-24T21:25:36.172 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-08-24T21:25:37.551 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:25:37.561 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=7e090d1170da147c882da3f90b5a065e 2024-08-24T21:25:37.561 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ 7e090d1170da147c882da3f90b5a065e != \7\e\0\9\0\d\1\1\7\0\d\a\1\4\7\c\8\8\2\d\a\3\f\9\0\b\5\a\0\6\5\e ]] 2024-08-24T21:25:37.561 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap23 2024-08-24T21:25:37.561 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap23 2024-08-24T21:25:37.561 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap23 2024-08-24T21:25:40.691 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:25:40.705 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:25:40.706 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap23 2024-08-24T21:25:40.706 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:25:43.797 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:25:43.797 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:25:43.797 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:25:43.797 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:25:43.797 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:25:43.797 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap24.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:25:51.173 INFO:tasks.mon_thrash:Sending CONT to mon a 2024-08-24T21:25:51.174 INFO:tasks.ceph.mon.a:Sent signal 18 2024-08-24T21:25:51.174 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:25:51.174 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:25:57.219 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 1% complete... Importing image diff: 3% complete... Importing image diff: 4% complete... Importing image diff: 6% complete... Importing image diff: 7% complete... Importing image diff: 9% complete... Importing image diff: 10% complete... Importing image diff: 12% complete... Importing image diff: 14% complete... Importing image diff: 15% complete... Importing image diff: 17% complete... Importing image diff: 18% complete... Importing image diff: 20% complete... Importing image diff: 21% complete... Importing image diff: 23% complete... Importing image diff: 25% complete... Importing image diff: 26% complete... Importing image diff: 28% complete... Importing image diff: 29% complete... Importing image diff: 31% complete... Importing image diff: 32% complete... Importing image diff: 34% complete... Importing image diff: 35% complete... Importing image diff: 37% complete... Importing image diff: 39% complete... Importing image diff: 40% complete... Importing image diff: 42% complete... Importing image diff: 43% complete... Importing image diff: 45% complete... Importing image diff: 46% complete... Importing image diff: 48% complete... Importing image diff: 50% complete... Importing image diff: 51% complete... Importing image diff: 53% complete... Importing image diff: 54% complete... Importing image diff: 56% complete... Importing image diff: 57% complete... Importing image diff: 59% complete... Importing image diff: 60% complete... Importing image diff: 62% complete... Importing image diff: 64% complete... Importing image diff: 65% complete... Importing image diff: 67% complete... Importing image diff: 68% complete... Importing image diff: 70% complete... Importing image diff: 71% complete... Importing image diff: 73% complete... Importing image diff: 75% complete... Importing image diff: 76% complete... Importing image diff: 78% complete... Importing image diff: 79% complete... Importing image diff: 81% complete... Importing image diff: 82% complete... Importing image diff: 84% complete... Importing image diff: 85% complete... Importing image diff: 87% complete... Importing image diff: 89% complete... Importing image diff: 90% complete... Importing image diff: 92% complete... Importing image diff: 93% complete... Importing image diff: 95% complete... Importing image diff: 96% complete... Importing image diff: 98% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2024-08-24T21:25:57.242 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap24 - 2024-08-24T21:25:57.242 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:25:57.243 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:25:57.647 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":132,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:26:00.666 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:26:01.122 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":134,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:26:01.141 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:26:01.142 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:26:01.142 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:26:01.340 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:26:01.340 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:26:01.340 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:26:01.340 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:26:01.340 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 134, 2024-08-24T21:26:01.340 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 82021, 2024-08-24T21:26:01.340 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:26:01.340 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:26:01.340 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:26:01.340 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:26:01.341 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:26:01.341 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 2, 2024-08-24T21:26:01.341 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:26:01.341 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:26:01.341 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:26:01.341 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:26:01.341 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:26:01.341 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:26:01.341 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:26:01.341 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:26:01.341 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:26:01.341 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:26:01.341 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:26:01.341 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:26:01.342 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:26:01.342 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:26:01.342 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:26:01.342 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:26:01.342 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:26:01.342 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:26:01.342 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:26:01.342 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:26:01.342 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:26:01.342 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:26:01.342 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:26:01.342 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:26:01.343 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:26:01.343 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:26:01.343 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:26:01.343 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:26:01.343 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:26:01.343 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:01.343 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:26:01.343 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:26:01.343 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:26:01.343 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:26:01.343 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:26:01.343 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:26:01.344 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:26:01.344 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:26:01.344 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:26:01.344 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:26:01.344 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:26:01.344 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:26:01.344 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:26:01.344 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:26:01.344 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:26:01.344 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:26:01.344 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:26:01.344 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:26:01.344 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:26:01.344 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:26:01.345 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:26:01.345 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:26:01.345 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:26:01.345 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:26:01.345 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:26:01.345 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:26:01.345 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:26:01.345 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:26:01.345 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:26:01.345 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:26:01.345 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:01.345 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:26:01.345 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:01.346 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:26:01.346 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:26:01.346 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:26:01.346 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:26:01.346 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:01.346 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:26:01.346 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:26:01.346 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:26:01.346 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:01.346 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:01.346 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:26:01.346 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:26:01.346 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:26:01.346 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:26:01.347 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:26:01.347 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:01.347 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:26:01.347 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:26:01.347 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:26:01.347 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:26:01.347 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:26:01.347 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:01.347 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:01.347 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:26:01.347 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:26:01.347 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:26:01.347 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:26:01.347 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:01.347 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:26:01.348 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:26:01.348 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:26:01.348 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:01.348 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:01.348 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:26:01.348 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:26:01.348 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:26:01.348 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:26:01.348 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:26:01.348 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:01.348 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:26:01.348 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:26:01.349 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:26:01.349 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:26:01.349 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:26:01.349 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:01.349 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:01.349 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:26:01.349 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:26:01.349 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:26:01.349 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:26:01.349 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:01.349 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:26:01.349 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:26:01.349 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:26:01.350 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:01.350 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:01.350 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:26:01.350 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:26:01.350 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:26:01.350 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:26:01.350 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:26:01.350 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:01.350 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:26:01.350 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:26:01.350 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:26:01.350 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:26:01.350 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:26:01.351 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:26:01.351 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:26:01.351 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:01.351 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:26:01.351 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:26:01.351 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:01.351 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:26:01.351 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:26:01.351 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:26:01.351 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:26:01.351 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:26:01.352 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:26:01.352 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:01.352 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:26:01.352 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:26:01.352 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 6 2024-08-24T21:26:01.352 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:26:01.352 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:26:01.352 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:26:01.352 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:01.352 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:26:01.352 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:26:01.352 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:26:01.352 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:26:01.352 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:26:01.353 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:26:01.353 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:01.353 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:26:01.353 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:26:01.353 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:26:01.353 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:26:01.353 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:26:01.353 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:01.353 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:26:01.353 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:26:01.354 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:26:01.355 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:26:01.355 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:26:01.530 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:26:01.530 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:26:01.530 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:26:01.530 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:26:01.531 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 134, 2024-08-24T21:26:01.531 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 136049, 2024-08-24T21:26:01.531 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:26:01.531 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:26:01.531 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:26:01.531 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:26:01.531 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:26:01.531 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 2, 2024-08-24T21:26:01.531 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:26:01.531 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:26:01.531 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:26:01.531 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:26:01.532 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:26:01.532 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:26:01.532 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:26:01.532 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:26:01.532 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:26:01.532 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:26:01.532 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:26:01.532 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:26:01.532 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:26:01.532 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:26:01.532 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:26:01.532 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:26:01.532 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:26:01.532 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:26:01.533 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:26:01.533 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:26:01.533 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:26:01.533 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:26:01.533 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:26:01.533 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:26:01.533 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:26:01.533 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:26:01.533 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:26:01.533 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:26:01.533 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:26:01.533 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:01.533 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:26:01.534 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:26:01.534 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:26:01.534 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:26:01.534 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:26:01.534 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:26:01.534 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:26:01.534 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:26:01.534 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:26:01.534 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:26:01.534 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:26:01.534 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:26:01.534 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:26:01.535 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:26:01.535 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:26:01.535 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:26:01.535 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:26:01.535 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:26:01.535 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:26:01.535 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:26:01.535 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:26:01.535 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:26:01.535 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:26:01.535 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:26:01.535 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:26:01.535 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:26:01.536 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:26:01.536 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:26:01.536 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:26:01.536 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:26:01.536 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:01.536 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:26:01.536 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:01.536 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:26:01.536 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:26:01.536 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:26:01.536 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:26:01.536 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:01.536 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:26:01.536 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:26:01.537 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:26:01.537 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:01.537 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:01.537 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:26:01.537 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:26:01.537 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:26:01.537 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:26:01.537 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:26:01.537 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:01.537 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:26:01.537 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:26:01.537 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:26:01.538 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:26:01.538 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:26:01.538 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:01.538 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:01.538 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:26:01.538 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:26:01.538 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:26:01.538 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:26:01.538 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:01.538 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:26:01.538 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:26:01.538 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:26:01.539 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:01.539 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:01.539 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:26:01.539 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:26:01.539 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:26:01.539 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:26:01.539 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:26:01.539 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:01.539 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:26:01.539 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:26:01.539 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:26:01.539 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:26:01.540 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:26:01.540 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:01.540 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:01.540 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:26:01.540 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:26:01.540 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:26:01.540 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:26:01.540 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:01.540 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:26:01.540 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:26:01.540 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:26:01.540 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:01.540 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:01.540 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:26:01.541 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:26:01.541 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:26:01.541 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:26:01.541 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:26:01.541 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:01.541 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:26:01.541 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:26:01.541 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:26:01.541 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:26:01.541 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:26:01.541 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:26:01.541 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:26:01.541 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:01.542 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:26:01.542 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:26:01.542 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:01.542 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:26:01.542 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:26:01.542 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:26:01.542 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:26:01.542 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:26:01.542 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:26:01.542 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:01.542 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:26:01.542 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:26:01.542 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:26:01.543 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:26:01.543 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:26:01.543 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:26:01.543 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:01.543 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:26:01.543 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:26:01.543 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:26:01.543 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:26:01.543 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:26:01.543 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:26:01.543 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:01.543 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:26:01.543 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:26:01.543 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:26:01.544 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:26:01.544 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:26:01.544 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:01.544 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:26:01.544 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:26:01.545 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:26:01.545 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:26:01.545 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:26:01.722 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:26:01.722 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:26:01.722 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:26:01.722 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:26:01.722 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 134, 2024-08-24T21:26:01.722 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 25396, 2024-08-24T21:26:01.722 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:26:01.722 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:26:01.722 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:26:01.723 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:26:01.723 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:26:01.723 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 2, 2024-08-24T21:26:01.723 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:26:01.723 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:26:01.723 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:26:01.723 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:26:01.723 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:26:01.723 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:26:01.723 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:26:01.723 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:26:01.723 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:26:01.723 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:26:01.724 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:26:01.724 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:26:01.724 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:26:01.724 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:26:01.724 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:26:01.724 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:26:01.724 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:26:01.724 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:26:01.724 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:26:01.724 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:26:01.724 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:26:01.724 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:26:01.724 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:26:01.725 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:26:01.725 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:26:01.725 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:26:01.725 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:26:01.725 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:26:01.725 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:26:01.725 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:01.725 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:26:01.725 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:26:01.725 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:26:01.725 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:26:01.725 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:26:01.725 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:26:01.726 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:26:01.726 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:26:01.726 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:26:01.726 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:26:01.726 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:26:01.726 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:26:01.726 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:26:01.726 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:26:01.726 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:26:01.726 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:26:01.726 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:26:01.726 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:26:01.726 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:26:01.727 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:26:01.727 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:26:01.727 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:26:01.727 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:26:01.727 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:26:01.727 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:26:01.727 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:26:01.727 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:26:01.727 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:26:01.727 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:26:01.727 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:26:01.727 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:01.728 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:26:01.728 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:01.728 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:26:01.728 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:26:01.728 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:26:01.728 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:26:01.728 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:01.728 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:26:01.728 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:26:01.728 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:26:01.728 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:01.728 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:01.729 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:26:01.729 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:26:01.729 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:26:01.729 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:26:01.729 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:26:01.729 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:01.729 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:26:01.729 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:26:01.729 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:26:01.729 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:26:01.729 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:26:01.729 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:01.729 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:01.729 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:26:01.730 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:26:01.730 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:26:01.730 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:26:01.730 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:01.730 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:26:01.730 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:26:01.730 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:26:01.730 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:01.730 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:01.730 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:26:01.730 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:26:01.730 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:26:01.731 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:26:01.731 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:26:01.731 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:01.731 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:26:01.731 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:26:01.731 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:26:01.731 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:26:01.731 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:26:01.731 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:01.731 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:01.731 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:26:01.731 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:26:01.731 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:26:01.732 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:26:01.732 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:01.732 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:26:01.732 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:26:01.732 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:26:01.732 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:01.732 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:01.732 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:26:01.732 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:26:01.732 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:26:01.732 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:26:01.732 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:26:01.732 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:01.733 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:26:01.733 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:26:01.733 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:26:01.733 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:26:01.733 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:26:01.733 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:26:01.733 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:26:01.734 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:01.734 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:26:01.734 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:26:01.734 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:01.734 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:26:01.734 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:26:01.734 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:26:01.734 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:26:01.734 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:26:01.734 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:26:01.734 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:01.734 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:26:01.734 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:26:01.734 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:26:01.735 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:26:01.735 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:26:01.735 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:01.735 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:26:01.735 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:26:01.736 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:26:01.736 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-08-24T21:26:01.737 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-08-24T21:26:02.195 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:26:02.218 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-08-24T21:26:02.258 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=00817a229a6e08bf2c046aac6d919fe0 2024-08-24T21:26:02.260 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap24 - 2024-08-24T21:26:02.260 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:26:02.260 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:26:03.219 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:26:03.220 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:26:03.672 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":134,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:26:03.691 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:26:03.691 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-08-24T21:26:03.691 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:26:03.691 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:26:03.878 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:26:03.879 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:26:03.879 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:26:03.879 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:26:03.879 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 134, 2024-08-24T21:26:03.879 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 84558, 2024-08-24T21:26:03.879 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:26:03.879 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:26:03.879 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:26:03.879 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:26:03.879 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:26:03.879 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 4, 2024-08-24T21:26:03.880 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:26:03.880 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:26:03.880 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:26:03.880 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:26:03.880 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:26:03.880 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:26:03.880 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:26:03.881 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:26:03.881 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:26:03.881 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:26:03.881 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:26:03.881 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:26:03.881 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:26:03.881 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:26:03.881 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:26:03.881 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:26:03.881 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:26:03.881 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:26:03.881 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:26:03.882 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:26:03.882 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:26:03.882 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:26:03.882 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:26:03.882 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:26:03.882 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:26:03.882 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:26:03.882 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:26:03.883 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:26:03.883 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:26:03.883 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:03.883 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:26:03.883 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:26:03.883 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:26:03.883 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:26:03.883 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:26:03.883 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:26:03.883 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:26:03.883 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:26:03.883 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:26:03.884 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:26:03.884 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:26:03.884 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:26:03.884 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:26:03.884 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:26:03.884 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:26:03.884 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:26:03.884 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:26:03.884 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:26:03.884 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:26:03.884 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:26:03.884 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:26:03.885 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:26:03.885 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:26:03.885 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:26:03.885 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:26:03.885 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:26:03.885 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:26:03.885 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:26:03.885 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:26:03.885 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:26:03.885 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:03.885 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:26:03.885 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:03.885 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:26:03.886 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:26:03.886 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:26:03.886 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:26:03.886 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:03.886 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:26:03.886 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:26:03.886 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:26:03.886 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:03.886 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:03.886 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:26:03.886 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:26:03.886 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:26:03.886 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:26:03.887 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:26:03.887 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:03.887 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:26:03.887 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:26:03.887 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:26:03.887 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:26:03.887 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:26:03.887 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:03.887 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:03.888 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:26:03.888 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:26:03.888 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:26:03.888 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:26:03.888 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:03.888 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:26:03.888 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:26:03.888 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:26:03.888 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:03.888 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:03.888 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:26:03.888 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:26:03.889 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:26:03.889 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:26:03.889 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:26:03.889 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:03.889 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:26:03.889 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:26:03.889 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:26:03.889 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:26:03.889 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:26:03.889 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:03.889 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:03.889 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:26:03.889 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:26:03.890 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:26:03.890 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:26:03.890 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:03.890 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:26:03.890 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:26:03.890 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:26:03.890 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:03.890 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:03.890 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:26:03.891 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:26:03.891 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:26:03.891 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:26:03.891 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:26:03.891 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:03.891 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:26:03.891 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:26:03.891 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:26:03.891 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:26:03.891 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:26:03.891 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:26:03.891 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:26:03.892 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:03.892 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:26:03.892 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:26:03.892 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:03.892 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:26:03.892 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:26:03.892 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:26:03.892 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:26:03.892 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:26:03.892 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:26:03.892 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:03.892 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:26:03.892 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:26:03.892 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 6 2024-08-24T21:26:03.893 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:26:03.893 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:26:03.893 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:26:03.893 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:03.893 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:26:03.893 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:26:03.893 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:26:03.893 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:26:03.893 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:26:03.893 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:26:03.893 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:03.893 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:26:03.893 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:26:03.894 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:26:03.894 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:26:03.894 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:26:03.894 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:03.894 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:26:03.894 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:26:03.895 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:26:03.895 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:26:03.895 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:26:04.079 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:26:04.079 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:26:04.079 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:26:04.079 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:26:04.079 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 134, 2024-08-24T21:26:04.079 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 138598, 2024-08-24T21:26:04.079 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:26:04.079 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:26:04.079 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:26:04.080 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:26:04.080 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:26:04.080 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 5, 2024-08-24T21:26:04.080 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:26:04.080 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:26:04.080 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:26:04.080 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:26:04.080 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:26:04.080 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:26:04.080 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:26:04.081 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:26:04.081 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:26:04.081 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:26:04.081 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:26:04.081 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:26:04.081 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:26:04.081 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:26:04.081 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:26:04.081 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:26:04.081 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:26:04.081 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:26:04.081 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:26:04.082 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:26:04.082 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:26:04.082 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:26:04.082 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:26:04.082 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:26:04.082 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:26:04.082 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:26:04.082 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:26:04.082 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:26:04.083 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:26:04.083 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:04.083 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:26:04.083 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:26:04.083 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:26:04.083 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:26:04.083 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:26:04.083 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:26:04.084 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:26:04.084 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:26:04.084 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:26:04.084 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:26:04.084 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:26:04.084 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:26:04.084 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:26:04.084 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:26:04.084 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:26:04.084 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:26:04.084 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:26:04.084 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:26:04.084 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:26:04.085 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:26:04.085 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:26:04.085 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:26:04.085 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:26:04.085 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:26:04.085 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:26:04.085 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:26:04.085 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:26:04.085 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:26:04.085 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:26:04.085 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:26:04.085 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:04.085 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:26:04.086 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:04.086 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:26:04.086 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:26:04.086 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:26:04.086 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:26:04.086 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:04.086 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:26:04.086 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:26:04.086 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:26:04.086 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:04.086 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:04.086 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:26:04.087 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:26:04.087 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:26:04.087 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:26:04.087 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:26:04.087 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:04.087 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:26:04.087 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:26:04.087 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:26:04.087 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:26:04.087 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:26:04.087 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:04.087 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:04.087 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:26:04.088 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:26:04.088 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:26:04.088 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:26:04.088 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:04.088 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:26:04.088 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:26:04.088 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:26:04.088 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:04.088 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:04.088 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:26:04.088 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:26:04.088 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:26:04.089 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:26:04.089 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:26:04.089 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:04.089 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:26:04.089 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:26:04.089 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:26:04.089 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:26:04.089 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:26:04.089 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:04.089 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:04.089 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:26:04.089 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:26:04.090 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:26:04.090 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:26:04.090 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:04.090 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:26:04.090 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:26:04.090 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:26:04.090 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:04.090 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:04.090 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:26:04.090 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:26:04.090 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:26:04.090 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:26:04.091 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:26:04.091 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:04.091 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:26:04.091 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:26:04.091 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:26:04.091 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:26:04.091 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:26:04.091 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:26:04.091 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:26:04.092 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:04.092 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:26:04.092 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:26:04.092 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:04.092 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:26:04.092 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:26:04.092 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:26:04.092 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:26:04.092 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:26:04.092 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:26:04.092 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:04.092 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:26:04.093 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:26:04.093 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:26:04.093 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:26:04.093 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:26:04.093 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:26:04.093 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:04.093 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:26:04.093 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:26:04.093 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-08-24T21:26:04.093 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:26:04.093 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:26:04.093 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:26:04.093 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:04.094 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:26:04.094 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:26:04.094 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:26:04.094 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:26:04.094 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:26:04.094 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:04.094 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:26:04.094 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:26:04.095 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:26:04.096 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:26:04.096 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:26:04.286 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:26:04.286 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:26:04.286 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:26:04.286 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:26:04.286 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 134, 2024-08-24T21:26:04.286 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 27960, 2024-08-24T21:26:04.286 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:26:04.286 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:26:04.287 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:26:04.287 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:26:04.287 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:26:04.287 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 5, 2024-08-24T21:26:04.287 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:26:04.287 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:26:04.287 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:26:04.287 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:26:04.287 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:26:04.287 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:26:04.287 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:26:04.287 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:26:04.287 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:26:04.288 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:26:04.288 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:26:04.288 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:26:04.288 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:26:04.288 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:26:04.288 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:26:04.288 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:26:04.288 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:26:04.288 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:26:04.288 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:26:04.289 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:26:04.289 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:26:04.289 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:26:04.289 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:26:04.289 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:26:04.289 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:26:04.289 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:26:04.289 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:26:04.289 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:26:04.289 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:26:04.289 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:04.289 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:26:04.289 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:26:04.290 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:26:04.290 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:26:04.290 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:26:04.290 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:26:04.290 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:26:04.290 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:26:04.290 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:26:04.290 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:26:04.290 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:26:04.290 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:26:04.290 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:26:04.290 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:26:04.290 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:26:04.291 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:26:04.291 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:26:04.291 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:26:04.291 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:26:04.291 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:26:04.291 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:26:04.291 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:26:04.291 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:26:04.291 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:26:04.291 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:26:04.291 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:26:04.291 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:26:04.291 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:26:04.292 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:26:04.292 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:26:04.292 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:04.292 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:26:04.292 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:04.292 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:26:04.292 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:26:04.292 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:26:04.292 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:26:04.292 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:04.292 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:26:04.292 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:26:04.292 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:26:04.293 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:04.293 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:04.293 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:26:04.293 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:26:04.293 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:26:04.293 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:26:04.293 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:26:04.293 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:04.293 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:26:04.294 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:26:04.294 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:26:04.294 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:26:04.294 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:26:04.294 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:04.294 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:04.294 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:26:04.294 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:26:04.294 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:26:04.294 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:26:04.294 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:04.294 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:26:04.295 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:26:04.295 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:26:04.295 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:04.295 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:04.295 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:26:04.295 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:26:04.295 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:26:04.295 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:26:04.295 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:26:04.295 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:04.295 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:26:04.295 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:26:04.295 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:26:04.296 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:26:04.296 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:26:04.296 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:04.296 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:04.296 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:26:04.296 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:26:04.296 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:26:04.296 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:26:04.296 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:04.296 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:26:04.296 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:26:04.296 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:26:04.296 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:04.296 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:04.297 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:26:04.297 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:26:04.297 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:26:04.297 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:26:04.297 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:26:04.297 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:04.297 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:26:04.297 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:26:04.297 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:26:04.297 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:26:04.297 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:26:04.297 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:26:04.297 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:26:04.298 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:04.298 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:26:04.298 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:26:04.298 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:04.298 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:26:04.298 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:26:04.298 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:26:04.298 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:26:04.298 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:26:04.298 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:26:04.298 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:04.298 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:26:04.298 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:26:04.299 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:26:04.299 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:26:04.299 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:26:04.299 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:04.299 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:26:04.299 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:26:04.302 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:26:04.302 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2024-08-24T21:26:04.302 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['a'] 2024-08-24T21:26:04.303 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-08-24T21:26:04.303 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-08-24T21:26:04.303 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-08-24T21:26:04.304 INFO:teuthology.orchestra.run:waiting for 300 2024-08-24T21:26:04.320 INFO:tasks.ceph.mon.b:Stopped 2024-08-24T21:26:04.320 INFO:tasks.mon_thrash:Sending STOP to mon a 2024-08-24T21:26:04.320 INFO:tasks.ceph.mon.a:Sent signal 19 2024-08-24T21:26:04.321 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-08-24T21:26:07.346 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:26:07.357 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=00817a229a6e08bf2c046aac6d919fe0 2024-08-24T21:26:07.357 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ 00817a229a6e08bf2c046aac6d919fe0 != \0\0\8\1\7\a\2\2\9\a\6\e\0\8\b\f\2\c\0\4\6\a\a\c\6\d\9\1\9\f\e\0 ]] 2024-08-24T21:26:07.357 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap24 2024-08-24T21:26:07.357 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap24 2024-08-24T21:26:07.358 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap24 2024-08-24T21:26:07.464 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:26:07.476 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:26:07.478 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap24 2024-08-24T21:26:07.478 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:26:07.557 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:26:07.557 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:26:07.557 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:26:07.558 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:26:07.558 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:26:07.558 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap25.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:26:19.322 INFO:tasks.mon_thrash:Sending CONT to mon a 2024-08-24T21:26:19.322 INFO:tasks.ceph.mon.a:Sent signal 18 2024-08-24T21:26:19.322 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-08-24T21:26:19.323 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:26:25.355 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 33% complete... Importing image diff: 66% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2024-08-24T21:26:25.375 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap25 - 2024-08-24T21:26:25.375 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:26:25.375 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:26:25.793 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":138,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:26:25.811 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-08-24T21:26:25.811 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-08-24T21:26:25.811 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:26:25.988 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:26:25.988 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:26:25.988 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:26:25.988 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:26:25.988 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 138, 2024-08-24T21:26:25.988 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 106668, 2024-08-24T21:26:25.988 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:26:25.988 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:26:25.988 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:26:25.988 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:26:25.989 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 1, 2024-08-24T21:26:25.989 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:26:25.989 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:26:25.989 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:26:25.989 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:26:25.989 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:26:25.989 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:26:25.989 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:26:25.989 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:26:25.989 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:26:25.989 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:26:25.989 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:26:25.989 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:26:25.989 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:26:25.990 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:26:25.990 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:26:25.990 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:26:25.990 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:26:25.990 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:26:25.990 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:26:25.990 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:26:25.990 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:26:25.990 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:26:25.990 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:26:25.990 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:26:25.990 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:26:25.991 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:26:25.991 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:26:25.991 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:26:25.991 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:26:25.991 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:25.991 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:26:25.991 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:26:25.991 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:26:25.991 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:26:25.991 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:26:25.991 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:26:25.991 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:26:25.992 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:26:25.992 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:26:25.992 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:26:25.992 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:26:25.992 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:26:25.992 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:26:25.992 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:26:25.992 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:26:25.992 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:26:25.992 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:26:25.992 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:26:25.992 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:26:25.992 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:26:25.993 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:26:25.993 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:26:25.993 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:26:25.993 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:26:25.993 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:26:25.993 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:26:25.993 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:26:25.993 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:26:25.993 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:26:25.993 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:26:25.993 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:25.993 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:26:25.993 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:25.994 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:26:25.994 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:26:25.994 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:26:25.994 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:26:25.994 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:25.994 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:26:25.994 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:26:25.994 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:26:25.994 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:25.994 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:25.994 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:26:25.994 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:26:25.994 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:26:25.995 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:26:25.995 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:26:25.995 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:25.995 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:26:25.995 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:26:25.995 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:26:25.995 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:26:25.995 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:26:25.995 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:25.995 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:25.995 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:26:25.995 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:26:25.996 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:26:25.996 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:26:25.996 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:25.996 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:26:25.996 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:26:25.996 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:26:25.996 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:25.996 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:25.996 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:26:25.996 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:26:25.996 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:26:25.996 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:26:25.996 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:26:25.997 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:25.997 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:26:25.997 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:26:25.997 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:26:25.997 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:26:25.997 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:26:25.997 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:25.997 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:25.997 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:26:25.997 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:26:25.997 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:26:25.997 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:26:25.997 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:25.998 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:26:25.998 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:26:25.998 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:26:25.998 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:25.998 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:25.998 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:26:25.998 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:26:25.998 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:26:25.998 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:26:25.998 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:26:25.998 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:25.998 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:26:25.998 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:26:25.999 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:26:25.999 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:26:25.999 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:26:25.999 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:26:25.999 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:26:25.999 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:25.999 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:26:25.999 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:26:25.999 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:25.999 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:26:25.999 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:26:25.999 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:26:25.999 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:26:26.000 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:26:26.000 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:26:26.000 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:26.000 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:26:26.000 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:26:26.000 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 6 2024-08-24T21:26:26.000 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:26:26.000 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:26:26.000 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:26:26.000 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:26.000 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:26:26.000 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:26:26.000 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-08-24T21:26:26.000 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:26:26.001 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:26:26.001 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:26:26.001 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:26.001 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:26:26.001 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:26:26.001 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:26:26.001 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:26:26.001 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:26:26.001 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:26.001 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:26:26.001 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:26:26.002 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:26:26.003 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-08-24T21:26:26.003 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:26:26.182 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:26:26.182 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:26:26.182 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:26:26.182 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:26:26.182 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 138, 2024-08-24T21:26:26.182 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 160701, 2024-08-24T21:26:26.182 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:26:26.182 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:26:26.183 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:26:26.183 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:26:26.183 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 1, 2024-08-24T21:26:26.183 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:26:26.183 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:26:26.183 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:26:26.183 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:26:26.183 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:26:26.183 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:26:26.183 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:26:26.183 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:26:26.183 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:26:26.183 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:26:26.184 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:26:26.184 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:26:26.184 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:26:26.184 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:26:26.184 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:26:26.184 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:26:26.184 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:26:26.184 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:26:26.184 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:26:26.184 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:26:26.184 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:26:26.184 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:26:26.184 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:26:26.185 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:26:26.185 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:26:26.185 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:26:26.185 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:26:26.185 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:26:26.185 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:26:26.185 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:26.185 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:26:26.185 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:26:26.185 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:26:26.185 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:26:26.185 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:26:26.185 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:26:26.186 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:26:26.186 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:26:26.186 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:26:26.186 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:26:26.186 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:26:26.186 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:26:26.186 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:26:26.186 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:26:26.186 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:26:26.186 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:26:26.186 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:26:26.186 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:26:26.186 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:26:26.187 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:26:26.187 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:26:26.187 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:26:26.187 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:26:26.187 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:26:26.187 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:26:26.187 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:26:26.187 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:26:26.187 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:26:26.187 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:26:26.187 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:26:26.187 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:26.187 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:26:26.188 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:26.188 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:26:26.188 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:26:26.188 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:26:26.188 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:26:26.188 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:26.188 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:26:26.188 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:26:26.188 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:26:26.188 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:26.188 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:26.188 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:26:26.188 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:26:26.189 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:26:26.189 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:26:26.189 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:26:26.189 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:26.189 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:26:26.189 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:26:26.189 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:26:26.189 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:26:26.189 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:26:26.189 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:26.189 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:26.189 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:26:26.189 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:26:26.189 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:26:26.190 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:26:26.190 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:26.190 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:26:26.190 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:26:26.190 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:26:26.190 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:26.190 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:26.190 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:26:26.190 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:26:26.190 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:26:26.190 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:26:26.190 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:26:26.190 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:26.191 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:26:26.191 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:26:26.191 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:26:26.191 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:26:26.191 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:26:26.191 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:26.191 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:26.191 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:26:26.191 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:26:26.191 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:26:26.191 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:26:26.191 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:26.191 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:26:26.192 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:26:26.192 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:26:26.192 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:26.192 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:26.192 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:26:26.192 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:26:26.192 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:26:26.192 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:26:26.192 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:26:26.192 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:26.192 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:26:26.192 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:26:26.192 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:26:26.193 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:26:26.193 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:26:26.193 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:26:26.193 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:26:26.193 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:26.193 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:26:26.193 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:26:26.193 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:26.193 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:26:26.193 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:26:26.193 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:26:26.193 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:26:26.193 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:26:26.194 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:26:26.194 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:26.194 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:26:26.194 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:26:26.194 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:26:26.194 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:26:26.194 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:26:26.194 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:26:26.194 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:26.194 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:26:26.194 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:26:26.194 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:26:26.194 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:26:26.195 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:26:26.195 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:26:26.195 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:26:26.195 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:26:26.195 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:26:26.195 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:26:26.195 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:26:26.195 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:26:26.195 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:26:26.195 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:26:26.195 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:26:26.197 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:26:26.197 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-08-24T21:26:30.403 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:26:30.500 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=94bf2e329470ddf3136bfb94e0cfd3c8 2024-08-24T21:26:30.501 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap25 - 2024-08-24T21:26:30.501 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:26:30.501 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:26:35.579 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:26:35.590 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=94bf2e329470ddf3136bfb94e0cfd3c8 2024-08-24T21:26:35.590 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ 94bf2e329470ddf3136bfb94e0cfd3c8 != \9\4\b\f\2\e\3\2\9\4\7\0\d\d\f\3\1\3\6\b\f\b\9\4\e\0\c\f\d\3\c\8 ]] 2024-08-24T21:26:35.591 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap25 2024-08-24T21:26:35.591 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap25 2024-08-24T21:26:35.591 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap25 2024-08-24T21:26:35.699 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:26:35.711 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:26:35.712 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap25 2024-08-24T21:26:35.712 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:26:35.791 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:26:35.791 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:26:35.792 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:26:35.792 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:26:35.792 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:26:35.792 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap26.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:26:38.378 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 5% complete... Importing image diff: 11% complete... Importing image diff: 17% complete... Importing image diff: 23% complete... Importing image diff: 29% complete... Importing image diff: 35% complete... Importing image diff: 41% complete... Importing image diff: 47% complete... Importing image diff: 52% complete... Importing image diff: 58% complete... Importing image diff: 64% complete... Importing image diff: 70% complete... Importing image diff: 76% complete... Importing image diff: 82% complete... Importing image diff: 88% complete... Importing image diff: 94% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2024-08-24T21:26:38.401 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap26 - 2024-08-24T21:26:38.401 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:26:38.401 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:26:43.438 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:26:43.506 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=2956bb3636914edd11b1898f464c5b73 2024-08-24T21:26:43.507 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap26 - 2024-08-24T21:26:43.508 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:26:43.508 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:26:46.198 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-08-24T21:26:46.198 INFO:tasks.ceph.mon.b:Restarting daemon 2024-08-24T21:26:46.199 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-08-24T21:26:46.203 INFO:tasks.ceph.mon.b:Started 2024-08-24T21:26:46.203 INFO:tasks.mon_thrash:Sending STOP to mon a 2024-08-24T21:26:46.203 INFO:tasks.ceph.mon.a:Sent signal 19 2024-08-24T21:26:46.204 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-08-24T21:26:48.619 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:26:48.629 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=2956bb3636914edd11b1898f464c5b73 2024-08-24T21:26:48.629 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ 2956bb3636914edd11b1898f464c5b73 != \2\9\5\6\b\b\3\6\3\6\9\1\4\e\d\d\1\1\b\1\8\9\8\f\4\6\4\c\5\b\7\3 ]] 2024-08-24T21:26:48.629 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap26 2024-08-24T21:26:48.629 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap26 2024-08-24T21:26:48.629 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap26 2024-08-24T21:26:48.738 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:26:48.750 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:26:48.751 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap26 2024-08-24T21:26:48.751 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:26:48.828 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:26:48.828 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:26:48.828 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:26:48.828 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:26:48.828 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:26:48.828 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap27.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:26:59.364 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 3% complete... Importing image diff: 6% complete... Importing image diff: 9% complete... Importing image diff: 13% complete... Importing image diff: 16% complete... Importing image diff: 19% complete... Importing image diff: 23% complete... Importing image diff: 26% complete... Importing image diff: 29% complete... Importing image diff: 33% complete... Importing image diff: 36% complete... Importing image diff: 39% complete... Importing image diff: 43% complete... Importing image diff: 46% complete... Importing image diff: 49% complete... Importing image diff: 53% complete... Importing image diff: 56% complete... Importing image diff: 59% complete... Importing image diff: 63% complete... Importing image diff: 66% complete... Importing image diff: 69% complete... Importing image diff: 73% complete... Importing image diff: 76% complete... Importing image diff: 79% complete... Importing image diff: 82% complete... Importing image diff: 83% complete... Importing image diff: 86% complete... Importing image diff: 90% complete... Importing image diff: 93% complete... Importing image diff: 96% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2024-08-24T21:26:59.387 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap27 - 2024-08-24T21:26:59.388 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:26:59.388 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:27:01.204 INFO:tasks.mon_thrash:Sending CONT to mon a 2024-08-24T21:27:01.205 INFO:tasks.ceph.mon.a:Sent signal 18 2024-08-24T21:27:01.205 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:27:01.205 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:27:04.514 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:27:04.577 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=080303051bc330515c10aff65384fe24 2024-08-24T21:27:04.578 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap27 - 2024-08-24T21:27:04.578 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:27:04.578 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:27:06.533 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":150,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:27:06.552 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:27:06.552 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:27:06.553 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:27:06.737 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:27:06.737 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:27:06.737 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:27:06.737 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:27:06.737 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 150, 2024-08-24T21:27:06.737 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 147417, 2024-08-24T21:27:06.737 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:27:06.737 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:27:06.737 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:27:06.738 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:27:06.738 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:06.738 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:27:06.738 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:27:06.738 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:27:06.738 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:27:06.738 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:27:06.738 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:27:06.738 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:27:06.738 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:27:06.738 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:27:06.738 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:27:06.739 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:27:06.739 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:27:06.739 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:27:06.739 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:27:06.739 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:27:06.739 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:06.739 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:27:06.739 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:27:06.739 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:27:06.739 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:27:06.739 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:27:06.739 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:27:06.739 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:27:06.740 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:27:06.740 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:27:06.740 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:27:06.740 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:27:06.740 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:27:06.740 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:27:06.740 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:06.740 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:06.740 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:27:06.740 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:27:06.740 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:27:06.740 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:27:06.741 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:27:06.741 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:27:06.741 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:27:06.741 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:27:06.741 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:27:06.741 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:27:06.741 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:27:06.741 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:27:06.741 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:27:06.741 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:27:06.741 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:27:06.741 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:27:06.742 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:27:06.742 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:27:06.742 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:27:06.742 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:27:06.742 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:27:06.742 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:27:06.742 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:27:06.742 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:27:06.742 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:27:06.742 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:27:06.742 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:27:06.742 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:27:06.743 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:06.743 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:27:06.743 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:06.743 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:27:06.743 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:06.743 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:27:06.743 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:27:06.743 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:27:06.743 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:27:06.743 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:06.743 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:27:06.743 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:27:06.743 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:06.744 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:06.744 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:06.744 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:27:06.744 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:27:06.744 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:06.744 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:06.744 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:06.744 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:06.744 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:27:06.744 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:27:06.744 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:27:06.744 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:27:06.744 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:27:06.745 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:06.745 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:06.745 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:27:06.745 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:27:06.745 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:27:06.745 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:27:06.745 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:06.745 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:27:06.745 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:27:06.745 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:06.745 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:06.745 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:06.745 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:27:06.746 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:27:06.746 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:06.746 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:06.746 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:06.746 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:06.746 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:27:06.746 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:27:06.746 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:27:06.746 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:27:06.746 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:27:06.746 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:06.746 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:06.746 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:27:06.747 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:27:06.747 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:27:06.747 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:27:06.747 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:06.747 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:27:06.747 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:27:06.747 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:06.747 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:06.747 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:06.747 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:27:06.747 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:27:06.747 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:06.747 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:06.748 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:06.748 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:06.748 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:27:06.748 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:27:06.748 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:27:06.748 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:27:06.748 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:27:06.748 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:06.748 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:06.748 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:06.748 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:27:06.748 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:27:06.748 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:06.748 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:27:06.749 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:27:06.749 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:27:06.749 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:06.749 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:06.749 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:27:06.749 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:06.749 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:27:06.749 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:27:06.749 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 6 2024-08-24T21:27:06.749 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:06.749 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:06.749 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:27:06.749 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:06.750 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:27:06.750 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:27:06.750 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:27:06.750 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:06.750 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:06.750 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:27:06.750 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:06.750 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:27:06.750 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:27:06.750 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:27:06.750 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:06.750 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:06.750 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:06.751 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:27:06.751 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:27:06.753 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:27:06.753 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:27:06.753 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:27:06.937 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:27:06.938 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:27:06.938 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:27:06.938 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:27:06.938 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 150, 2024-08-24T21:27:06.938 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 201458, 2024-08-24T21:27:06.938 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:27:06.938 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:27:06.938 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:27:06.938 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:27:06.938 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:06.938 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:27:06.938 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:27:06.939 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:27:06.939 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:27:06.939 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:27:06.939 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:27:06.939 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:27:06.939 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:27:06.939 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:27:06.939 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:27:06.939 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:27:06.939 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:27:06.939 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:27:06.939 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:27:06.939 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:27:06.940 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:06.940 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:27:06.940 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:27:06.940 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:27:06.940 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:27:06.940 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:27:06.940 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:27:06.940 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:27:06.940 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:27:06.940 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:27:06.941 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:27:06.941 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:27:06.941 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:27:06.941 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:27:06.941 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:06.941 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:06.941 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:27:06.941 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:27:06.941 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:27:06.941 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:27:06.941 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:27:06.941 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:27:06.941 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:27:06.942 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:27:06.942 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:27:06.942 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:27:06.942 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:27:06.942 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:27:06.942 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:27:06.942 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:27:06.942 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:27:06.942 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:27:06.942 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:27:06.942 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:27:06.942 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:27:06.942 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:27:06.943 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:27:06.943 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:27:06.943 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:27:06.943 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:27:06.943 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:27:06.943 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:27:06.943 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:27:06.943 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:27:06.944 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:06.944 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:27:06.944 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:06.944 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:27:06.944 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:06.944 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:27:06.944 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:27:06.944 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:27:06.944 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:27:06.944 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:06.944 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:27:06.944 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:27:06.944 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:06.945 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:06.945 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:06.945 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:27:06.945 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:27:06.945 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:06.945 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:06.945 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:06.945 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:06.945 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:27:06.945 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:27:06.945 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:27:06.945 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:27:06.945 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:27:06.946 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:06.946 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:06.946 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:27:06.946 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:27:06.946 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:27:06.946 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:27:06.946 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:06.946 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:27:06.946 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:27:06.946 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:06.946 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:06.947 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:06.947 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:27:06.947 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:27:06.947 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:06.947 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:06.947 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:06.947 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:06.947 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:27:06.947 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:27:06.947 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:27:06.947 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:27:06.947 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:27:06.948 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:06.948 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:06.948 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:27:06.948 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:27:06.948 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:27:06.948 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:27:06.948 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:06.948 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:27:06.948 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:27:06.948 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:06.948 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:06.948 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:06.949 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:27:06.949 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:27:06.949 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:06.949 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:06.949 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:06.949 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:06.949 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:27:06.949 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:27:06.949 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:27:06.949 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:27:06.949 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:27:06.949 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:06.949 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:06.950 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:06.950 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:27:06.950 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:27:06.950 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:06.950 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:27:06.950 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:27:06.951 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:27:06.951 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:06.951 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:06.951 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:27:06.952 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:06.952 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:27:06.952 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:27:06.952 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:27:06.952 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:06.952 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:06.952 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:27:06.952 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:06.952 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:27:06.952 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:27:06.952 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:27:06.952 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:06.952 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:06.953 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:27:06.953 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:06.953 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:27:06.953 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:27:06.953 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:27:06.953 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:06.953 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:06.953 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:06.953 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:27:06.953 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:27:06.954 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:27:06.954 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:27:06.955 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:27:07.141 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:27:07.142 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:27:07.142 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:27:07.142 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:27:07.142 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 150, 2024-08-24T21:27:07.142 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 20792, 2024-08-24T21:27:07.142 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:27:07.142 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:27:07.142 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:27:07.142 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:27:07.143 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:07.143 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:27:07.143 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:27:07.143 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:27:07.143 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:27:07.143 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:27:07.143 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:27:07.143 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:27:07.143 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:27:07.143 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:27:07.143 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:27:07.143 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:27:07.144 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:27:07.144 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:27:07.144 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:27:07.144 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:27:07.144 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:07.144 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:27:07.144 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:27:07.144 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:27:07.144 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:27:07.144 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:27:07.144 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:27:07.144 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:27:07.144 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:27:07.145 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:27:07.145 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:27:07.145 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:27:07.145 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:27:07.145 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:27:07.145 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:07.145 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:07.145 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:27:07.145 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:27:07.145 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:27:07.145 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:27:07.145 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:27:07.146 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:27:07.146 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:27:07.146 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:27:07.146 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:27:07.146 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:27:07.146 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:27:07.146 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:27:07.146 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:27:07.146 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:27:07.146 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:27:07.146 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:27:07.146 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:27:07.147 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:27:07.147 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:27:07.147 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:27:07.147 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:27:07.147 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:27:07.147 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:27:07.147 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:27:07.147 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:27:07.147 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:27:07.147 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:27:07.147 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:27:07.147 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:07.148 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:27:07.148 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:07.148 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:27:07.148 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:07.148 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:27:07.148 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:27:07.148 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:27:07.148 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:27:07.149 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:07.149 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:27:07.149 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:27:07.149 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:07.149 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:07.149 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:07.149 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:27:07.150 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:27:07.150 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:07.150 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:07.150 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:07.150 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:07.150 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:27:07.150 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:27:07.151 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:27:07.151 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:27:07.151 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:27:07.151 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:07.151 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:07.151 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:27:07.151 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:27:07.151 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:27:07.151 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:27:07.151 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:07.151 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:27:07.151 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:27:07.151 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:07.152 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:07.152 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:07.152 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:27:07.152 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:27:07.152 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:07.152 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:07.152 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:07.152 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:07.152 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:27:07.152 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:27:07.152 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:27:07.152 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:27:07.152 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:27:07.153 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:07.153 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:07.153 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:27:07.153 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:27:07.153 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:27:07.153 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:27:07.153 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:07.153 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:27:07.153 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:27:07.153 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:07.153 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:07.153 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:07.153 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:27:07.154 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:27:07.154 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:07.154 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:07.154 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:07.154 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:07.154 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:27:07.154 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:27:07.154 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:27:07.154 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:27:07.155 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:27:07.155 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:07.155 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:07.155 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:07.155 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:27:07.155 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:27:07.155 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:07.155 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:27:07.156 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:27:07.156 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:27:07.156 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:07.156 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:07.156 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:27:07.157 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:07.157 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:27:07.157 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:27:07.157 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:27:07.157 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:07.157 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:07.158 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:07.158 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:27:07.158 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:27:07.160 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:27:07.160 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-08-24T21:27:07.160 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-08-24T21:27:07.645 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-08-24T21:27:08.646 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:27:08.646 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:27:09.116 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":150,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:27:09.135 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:27:09.135 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-08-24T21:27:09.135 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:27:09.135 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:27:09.320 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:27:09.320 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:27:09.320 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:27:09.320 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:27:09.320 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 150, 2024-08-24T21:27:09.321 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 150001, 2024-08-24T21:27:09.321 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:27:09.321 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:27:09.321 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:27:09.321 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:27:09.321 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:09.321 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 3, 2024-08-24T21:27:09.321 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:27:09.321 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:27:09.321 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:27:09.321 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:27:09.321 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:27:09.321 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:27:09.322 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:27:09.322 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:27:09.322 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:27:09.322 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:27:09.322 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:27:09.322 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:27:09.322 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:27:09.322 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:27:09.322 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:09.322 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:27:09.322 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:27:09.322 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:27:09.322 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:27:09.323 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:27:09.323 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:27:09.323 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:27:09.323 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:27:09.323 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:27:09.323 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:27:09.323 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:27:09.323 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:27:09.324 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:27:09.324 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:09.324 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:09.324 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:27:09.324 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:27:09.324 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:27:09.324 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:27:09.324 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:27:09.324 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:27:09.324 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:27:09.324 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:27:09.324 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:27:09.325 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:27:09.325 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:27:09.325 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:27:09.325 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:27:09.325 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:27:09.325 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:27:09.325 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:27:09.325 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:27:09.325 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:27:09.325 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:27:09.325 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:27:09.325 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:27:09.325 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:27:09.325 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:27:09.325 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:27:09.326 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:27:09.326 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:27:09.326 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:27:09.326 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:27:09.326 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:09.326 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:27:09.326 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:09.326 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:27:09.326 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:09.326 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:27:09.326 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:27:09.326 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:27:09.326 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:27:09.326 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:09.327 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:27:09.327 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:27:09.327 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:09.327 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:09.327 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:09.327 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:27:09.327 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:27:09.327 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:09.327 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:09.327 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:09.327 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:09.327 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:27:09.328 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:27:09.328 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:27:09.328 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:27:09.328 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:27:09.328 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:09.328 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:09.328 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:27:09.328 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:27:09.328 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:27:09.328 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:27:09.328 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:09.328 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:27:09.328 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:27:09.328 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:09.329 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:09.329 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:09.329 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:27:09.329 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:27:09.329 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:09.329 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:09.329 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:09.329 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:09.329 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:27:09.329 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:27:09.329 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:27:09.329 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:27:09.329 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:27:09.330 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:09.330 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:09.330 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:27:09.330 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:27:09.330 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:27:09.331 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:27:09.331 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:09.331 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:27:09.331 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:27:09.331 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:09.331 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:09.331 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:09.331 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:27:09.331 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:27:09.331 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:09.331 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:09.331 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:09.332 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:09.332 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:27:09.332 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:27:09.332 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:27:09.332 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:27:09.332 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:27:09.332 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:09.332 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:09.332 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:09.332 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:27:09.332 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:27:09.332 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:09.332 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:27:09.333 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:27:09.333 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:27:09.333 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:09.333 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:09.333 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:27:09.333 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:09.333 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:27:09.333 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:27:09.333 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 6 2024-08-24T21:27:09.333 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:09.333 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:09.333 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:27:09.333 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:09.333 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:27:09.333 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:27:09.334 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:27:09.334 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:09.334 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:09.334 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:27:09.334 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:09.334 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:27:09.334 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:27:09.334 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:27:09.334 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:09.334 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:09.334 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:09.334 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:27:09.334 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:27:09.335 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:27:09.336 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:27:09.336 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:27:09.521 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:27:09.522 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:27:09.522 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:27:09.522 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:27:09.522 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 150, 2024-08-24T21:27:09.522 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 204042, 2024-08-24T21:27:09.522 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:27:09.522 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:27:09.522 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:27:09.522 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:27:09.522 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:09.522 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 3, 2024-08-24T21:27:09.523 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:27:09.523 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:27:09.523 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:27:09.523 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:27:09.523 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:27:09.523 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:27:09.523 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:27:09.523 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:27:09.523 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:27:09.523 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:27:09.523 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:27:09.523 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:27:09.524 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:27:09.524 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:27:09.524 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:09.524 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:27:09.524 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:27:09.524 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:27:09.524 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:27:09.524 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:27:09.524 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:27:09.524 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:27:09.524 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:27:09.524 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:27:09.525 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:27:09.525 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:27:09.525 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:27:09.525 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:27:09.525 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:09.525 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:09.525 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:27:09.525 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:27:09.525 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:27:09.525 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:27:09.525 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:27:09.525 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:27:09.525 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:27:09.526 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:27:09.526 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:27:09.526 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:27:09.526 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:27:09.526 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:27:09.526 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:27:09.526 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:27:09.526 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:27:09.526 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:27:09.526 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:27:09.526 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:27:09.526 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:27:09.526 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:27:09.527 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:27:09.527 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:27:09.527 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:27:09.527 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:27:09.527 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:27:09.527 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:27:09.527 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:27:09.527 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:27:09.527 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:09.527 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:27:09.527 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:09.527 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:27:09.527 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:09.528 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:27:09.528 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:27:09.528 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:27:09.528 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:27:09.528 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:09.528 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:27:09.528 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:27:09.528 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:09.528 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:09.528 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:09.529 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:27:09.529 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:27:09.529 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:09.529 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:09.529 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:09.529 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:09.529 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:27:09.529 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:27:09.529 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:27:09.529 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:27:09.530 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:27:09.530 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:09.530 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:09.530 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:27:09.530 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:27:09.530 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:27:09.530 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:27:09.531 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:09.531 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:27:09.531 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:27:09.531 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:09.531 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:09.532 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:09.532 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:27:09.532 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:27:09.532 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:09.532 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:09.532 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:09.532 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:09.532 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:27:09.532 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:27:09.532 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:27:09.532 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:27:09.532 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:27:09.532 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:09.533 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:09.533 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:27:09.533 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:27:09.533 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:27:09.533 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:27:09.533 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:09.533 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:27:09.533 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:27:09.533 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:09.533 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:09.533 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:09.533 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:27:09.533 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:27:09.534 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:09.534 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:09.534 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:09.534 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:09.534 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:27:09.534 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:27:09.534 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:27:09.534 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:27:09.534 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:27:09.534 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:09.534 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:09.534 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:09.534 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:27:09.535 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:27:09.535 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:09.535 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:27:09.535 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:27:09.535 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:27:09.535 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:09.535 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:09.535 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:27:09.535 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:09.535 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:27:09.535 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:27:09.535 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:27:09.535 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:09.536 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:09.536 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:27:09.536 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:09.536 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:27:09.536 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:27:09.536 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-08-24T21:27:09.536 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:09.536 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:09.536 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:27:09.536 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:09.536 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:27:09.536 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:27:09.536 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:27:09.536 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:09.537 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:09.537 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:09.537 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:27:09.537 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:27:09.538 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:27:09.538 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:27:09.538 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:27:09.726 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:27:09.726 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:27:09.726 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:27:09.727 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:27:09.727 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 150, 2024-08-24T21:27:09.727 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 23376, 2024-08-24T21:27:09.727 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:27:09.727 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:27:09.727 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:27:09.727 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:27:09.727 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:09.728 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 3, 2024-08-24T21:27:09.728 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:27:09.728 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:27:09.728 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:27:09.728 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:27:09.728 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:27:09.728 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:27:09.728 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:27:09.728 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:27:09.728 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:27:09.728 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:27:09.728 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:27:09.729 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:27:09.729 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:27:09.729 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:27:09.729 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:09.729 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:27:09.729 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:27:09.729 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:27:09.729 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:27:09.729 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:27:09.729 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:27:09.729 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:27:09.730 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:27:09.730 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:27:09.730 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:27:09.730 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:27:09.730 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:27:09.730 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:27:09.730 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:09.730 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:09.730 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:27:09.730 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:27:09.730 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:27:09.730 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:27:09.731 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:27:09.731 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:27:09.731 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:27:09.731 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:27:09.731 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:27:09.731 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:27:09.731 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:27:09.731 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:27:09.731 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:27:09.731 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:27:09.731 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:27:09.731 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:27:09.732 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:27:09.732 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:27:09.732 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:27:09.732 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:27:09.732 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:27:09.732 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:27:09.732 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:27:09.732 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:27:09.732 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:27:09.732 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:27:09.732 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:27:09.732 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:27:09.733 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:09.733 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:27:09.733 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:09.733 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:27:09.733 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:09.733 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:27:09.733 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:27:09.733 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:27:09.733 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:27:09.733 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:09.733 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:27:09.733 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:27:09.733 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:09.734 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:09.734 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:09.734 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:27:09.734 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:27:09.734 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:09.734 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:09.734 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:09.734 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:09.734 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:27:09.734 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:27:09.734 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:27:09.734 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:27:09.735 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:27:09.735 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:09.735 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:09.735 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:27:09.735 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:27:09.735 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:27:09.735 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:27:09.735 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:09.735 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:27:09.735 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:27:09.735 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:09.735 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:09.735 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:09.736 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:27:09.736 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:27:09.736 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:09.736 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:09.736 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:09.736 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:09.736 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:27:09.736 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:27:09.736 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:27:09.736 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:27:09.736 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:27:09.737 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:09.737 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:09.737 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:27:09.737 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:27:09.737 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:27:09.737 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:27:09.737 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:09.737 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:27:09.737 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:27:09.737 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:09.737 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:09.737 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:09.738 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:27:09.738 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:27:09.738 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:09.738 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:09.738 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:09.738 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:09.738 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:27:09.738 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:27:09.738 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:27:09.738 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:27:09.738 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:27:09.738 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:09.739 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:09.739 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:09.739 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:27:09.739 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:27:09.739 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:09.739 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:27:09.739 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:27:09.739 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:27:09.739 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:09.739 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:09.739 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:27:09.739 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:09.739 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:27:09.739 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:27:09.740 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:27:09.740 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:09.740 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:09.740 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:09.740 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:27:09.740 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:27:09.742 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:27:09.742 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2024-08-24T21:27:09.742 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-08-24T21:27:09.742 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-08-24T21:27:09.742 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-08-24T21:27:09.742 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-08-24T21:27:09.743 INFO:teuthology.orchestra.run:waiting for 300 2024-08-24T21:27:09.762 INFO:tasks.ceph.mon.c:Stopped 2024-08-24T21:27:09.762 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-08-24T21:27:09.763 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:27:10.265 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":150,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:27:11.485 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:27:11.495 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=080303051bc330515c10aff65384fe24 2024-08-24T21:27:11.495 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ 080303051bc330515c10aff65384fe24 != \0\8\0\3\0\3\0\5\1\b\c\3\3\0\5\1\5\c\1\0\a\f\f\6\5\3\8\4\f\e\2\4 ]] 2024-08-24T21:27:11.495 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap27 2024-08-24T21:27:11.495 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap27 2024-08-24T21:27:11.495 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap27 2024-08-24T21:27:11.601 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:27:11.613 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:27:11.614 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap27 2024-08-24T21:27:11.614 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:27:11.696 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:27:11.696 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:27:11.696 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:27:11.696 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:27:11.696 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:27:11.696 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap28.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:27:13.286 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:27:13.965 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":150,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:27:16.983 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:27:17.432 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":150,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:27:20.451 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:27:24.548 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":154,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:27:24.566 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-08-24T21:27:24.566 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-08-24T21:27:24.566 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:27:24.741 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:27:24.742 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:27:24.742 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:27:24.742 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:27:24.742 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 154, 2024-08-24T21:27:24.742 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 165422, 2024-08-24T21:27:24.742 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:27:24.742 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:27:24.742 INFO:teuthology.orchestra.run.smithi060.stdout: 1 2024-08-24T21:27:24.742 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:24.742 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:27:24.743 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:27:24.743 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:27:24.743 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:27:24.743 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:27:24.743 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:27:24.743 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:27:24.743 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:27:24.743 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:27:24.743 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:27:24.743 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:27:24.743 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:27:24.743 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:27:24.743 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:27:24.744 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:27:24.744 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:24.744 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:27:24.744 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:27:24.744 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:27:24.744 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:27:24.744 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:27:24.744 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:27:24.744 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:27:24.744 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:27:24.744 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:27:24.744 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:27:24.744 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:27:24.745 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:27:24.745 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:27:24.745 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:24.745 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:24.745 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:27:24.745 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:27:24.745 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:27:24.745 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:27:24.745 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:27:24.745 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:27:24.745 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:27:24.745 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:27:24.745 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:27:24.746 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:27:24.746 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:27:24.746 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:27:24.746 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:27:24.746 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:27:24.746 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:27:24.746 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:27:24.746 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:27:24.746 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:27:24.746 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:27:24.746 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:27:24.746 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:27:24.747 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:27:24.747 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:27:24.747 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:27:24.747 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:27:24.747 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:27:24.747 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:27:24.747 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:27:24.747 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:24.747 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:27:24.747 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:24.747 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:27:24.747 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:24.748 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:27:24.748 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:27:24.748 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:27:24.748 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:27:24.748 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:24.748 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:27:24.748 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:27:24.748 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:24.748 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:24.748 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:24.748 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:27:24.748 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:27:24.748 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:24.749 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:24.749 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:24.749 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:24.749 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:27:24.749 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:27:24.749 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:27:24.749 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:27:24.749 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:27:24.749 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:24.749 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:24.749 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:27:24.749 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:27:24.749 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:27:24.749 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:27:24.750 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:24.750 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:27:24.750 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:27:24.750 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:24.750 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:24.750 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:24.750 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:27:24.750 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:27:24.750 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:24.750 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:24.750 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:24.750 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:24.750 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:27:24.751 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:27:24.751 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:27:24.751 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:27:24.751 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:27:24.751 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:24.751 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:24.751 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:27:24.751 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:27:24.751 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:27:24.751 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:27:24.751 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:24.751 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:27:24.751 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:27:24.751 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:24.752 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:24.752 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:24.752 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:27:24.752 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:27:24.752 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:24.752 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:24.752 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:24.752 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:24.752 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:27:24.752 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:27:24.752 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:27:24.752 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:27:24.752 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:27:24.753 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:24.753 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:24.753 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:24.753 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:27:24.753 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:27:24.753 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:24.753 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:27:24.753 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:27:24.753 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:27:24.753 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:24.753 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:24.753 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:27:24.753 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:24.753 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:27:24.754 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:27:24.754 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 7 2024-08-24T21:27:24.754 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:24.754 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:24.754 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:27:24.754 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:24.754 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:27:24.754 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:27:24.754 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:27:24.754 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:24.754 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:24.754 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:27:24.754 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:24.754 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:27:24.755 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:27:24.755 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:27:24.755 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:24.755 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:24.755 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:24.755 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:27:24.755 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:27:24.756 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:27:24.757 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-08-24T21:27:24.757 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:27:24.932 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:27:24.932 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:27:24.932 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:27:24.933 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:27:24.933 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 154, 2024-08-24T21:27:24.933 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 38583, 2024-08-24T21:27:24.933 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:27:24.933 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:27:24.933 INFO:teuthology.orchestra.run.smithi060.stdout: 1 2024-08-24T21:27:24.933 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:24.933 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:27:24.933 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:27:24.933 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:27:24.933 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:27:24.933 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:27:24.933 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:27:24.934 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:27:24.934 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:27:24.934 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:27:24.934 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:27:24.934 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:27:24.934 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:27:24.934 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:27:24.934 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:27:24.934 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:27:24.934 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:24.934 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:27:24.934 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:27:24.935 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:27:24.935 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:27:24.935 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:27:24.935 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:27:24.935 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:27:24.935 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:27:24.935 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:27:24.935 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:27:24.935 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:27:24.935 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:27:24.935 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:27:24.935 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:24.935 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:24.936 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:27:24.936 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:27:24.936 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:27:24.936 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:27:24.936 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:27:24.936 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:27:24.936 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:27:24.936 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:27:24.936 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:27:24.936 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:27:24.936 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:27:24.936 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:27:24.936 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:27:24.937 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:27:24.937 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:27:24.937 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:27:24.937 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:27:24.937 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:27:24.937 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:27:24.937 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:27:24.937 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:27:24.937 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:27:24.937 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:27:24.937 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:27:24.937 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:27:24.937 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:27:24.938 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:27:24.938 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:27:24.938 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:24.938 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:27:24.938 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:24.938 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:27:24.938 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:24.938 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:27:24.938 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:27:24.938 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:27:24.938 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:27:24.938 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:24.939 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:27:24.939 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:27:24.939 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:24.939 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:24.939 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:24.939 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:27:24.939 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:27:24.939 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:24.939 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:24.939 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:24.939 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:24.939 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:27:24.940 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:27:24.940 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:27:24.940 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:27:24.940 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:27:24.940 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:24.940 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:24.940 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:27:24.940 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:27:24.940 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:27:24.940 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:27:24.940 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:24.940 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:27:24.940 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:27:24.941 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:24.941 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:24.941 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:24.941 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:27:24.941 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:27:24.941 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:24.941 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:24.941 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:24.941 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:24.941 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:27:24.941 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:27:24.941 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:27:24.941 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:27:24.942 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:27:24.942 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:24.942 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:24.942 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:27:24.942 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:27:24.942 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:27:24.942 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:27:24.942 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:24.942 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:27:24.942 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:27:24.942 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:24.942 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:24.943 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:24.943 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:27:24.943 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:27:24.943 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:24.943 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:24.943 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:24.943 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:24.943 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:27:24.943 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:27:24.943 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:27:24.943 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:27:24.943 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:27:24.943 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:24.944 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:24.944 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:24.944 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:27:24.944 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:27:24.944 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:24.944 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:27:24.944 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:27:24.944 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:27:24.944 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:24.944 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:24.944 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:27:24.944 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:24.944 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:27:24.945 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:27:24.945 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:27:24.945 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:24.945 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:24.945 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:27:24.945 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:24.945 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:27:24.945 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:27:24.945 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:27:24.945 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:24.945 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:24.945 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:27:24.945 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:24.946 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:27:24.946 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:27:24.946 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:27:24.946 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:24.946 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:24.946 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:24.946 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:27:24.946 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:27:24.947 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:27:24.947 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-08-24T21:27:25.276 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 5% complete... Importing image diff: 10% complete... Importing image diff: 16% complete... Importing image diff: 21% complete... Importing image diff: 27% complete... Importing image diff: 32% complete... Importing image diff: 38% complete... Importing image diff: 43% complete... Importing image diff: 44% complete... Importing image diff: 45% complete... Importing image diff: 51% complete... Importing image diff: 56% complete... Importing image diff: 61% complete... Importing image diff: 67% complete... Importing image diff: 72% complete... Importing image diff: 78% complete... Importing image diff: 83% complete... Importing image diff: 89% complete... Importing image diff: 94% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2024-08-24T21:27:25.298 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap28 - 2024-08-24T21:27:25.298 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:27:25.298 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:27:30.435 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:27:30.502 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=c4eed21a86171344492e708c30ad43ab 2024-08-24T21:27:30.503 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap28 - 2024-08-24T21:27:30.504 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:27:30.504 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:27:35.769 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:27:35.780 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=c4eed21a86171344492e708c30ad43ab 2024-08-24T21:27:35.780 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ c4eed21a86171344492e708c30ad43ab != \c\4\e\e\d\2\1\a\8\6\1\7\1\3\4\4\4\9\2\e\7\0\8\c\3\0\a\d\4\3\a\b ]] 2024-08-24T21:27:35.780 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap28 2024-08-24T21:27:35.780 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap28 2024-08-24T21:27:35.780 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap28 2024-08-24T21:27:35.889 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:27:35.901 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:27:35.903 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap28 2024-08-24T21:27:35.903 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:27:35.980 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:27:35.980 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:27:35.980 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:27:35.980 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:27:35.980 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:27:35.980 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap29.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:27:37.301 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 1% complete... Importing image diff: 2% complete... Importing image diff: 3% complete... Importing image diff: 48% complete... Importing image diff: 49% complete... Importing image diff: 50% complete... Importing image diff: 51% complete... Importing image diff: 52% complete... Importing image diff: 53% complete... Importing image diff: 54% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2024-08-24T21:27:37.322 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap29 - 2024-08-24T21:27:37.323 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:27:37.323 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:27:42.444 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:27:42.520 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=74496c437e0ac17356e4c82affc86c64 2024-08-24T21:27:42.521 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap29 - 2024-08-24T21:27:42.521 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:27:42.522 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:27:44.948 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-08-24T21:27:44.948 INFO:tasks.ceph.mon.c:Restarting daemon 2024-08-24T21:27:44.949 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-08-24T21:27:44.953 INFO:tasks.ceph.mon.c:Started 2024-08-24T21:27:44.953 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:27:44.953 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:27:45.417 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":154,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:27:47.845 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:27:47.855 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=74496c437e0ac17356e4c82affc86c64 2024-08-24T21:27:47.855 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ 74496c437e0ac17356e4c82affc86c64 != \7\4\4\9\6\c\4\3\7\e\0\a\c\1\7\3\5\6\e\4\c\8\2\a\f\f\c\8\6\c\6\4 ]] 2024-08-24T21:27:47.855 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap29 2024-08-24T21:27:47.855 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap29 2024-08-24T21:27:47.855 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap29 2024-08-24T21:27:47.963 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:27:47.975 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:27:47.976 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap29 2024-08-24T21:27:47.976 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:27:48.055 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:27:48.055 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:27:48.055 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:27:48.055 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:27:48.055 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:27:48.055 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap30.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:27:48.436 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:27:48.880 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":154,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":24,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:27:49.324 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 50% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2024-08-24T21:27:49.344 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap30 - 2024-08-24T21:27:49.345 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:27:49.345 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:27:51.898 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:27:52.354 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":156,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:27:52.372 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:27:52.372 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:27:52.372 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:27:52.548 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:27:52.548 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:27:52.548 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:27:52.548 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:27:52.548 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 156, 2024-08-24T21:27:52.549 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 193229, 2024-08-24T21:27:52.549 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:27:52.549 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:27:52.549 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:27:52.549 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:27:52.549 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:52.549 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 1, 2024-08-24T21:27:52.549 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:27:52.549 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:27:52.549 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:27:52.550 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:27:52.550 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:27:52.550 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:27:52.550 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:27:52.550 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:27:52.550 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:27:52.550 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:27:52.550 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:27:52.550 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:27:52.550 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:27:52.551 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:27:52.551 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:52.551 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:27:52.551 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:27:52.551 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:27:52.551 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:27:52.551 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:27:52.551 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:27:52.551 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:27:52.551 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:27:52.551 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:27:52.552 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:27:52.552 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:27:52.552 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:27:52.552 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:27:52.552 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:52.552 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:52.552 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:27:52.552 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:27:52.552 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:27:52.552 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:27:52.552 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:27:52.553 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:27:52.553 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:27:52.553 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:27:52.553 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:27:52.553 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:27:52.553 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:27:52.553 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:27:52.553 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:27:52.553 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:27:52.553 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:27:52.553 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:27:52.554 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:27:52.554 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:27:52.554 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:27:52.554 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:27:52.554 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:27:52.554 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:27:52.554 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:27:52.554 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:27:52.554 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:27:52.554 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:27:52.554 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:27:52.555 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:27:52.555 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:52.555 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:27:52.555 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:52.555 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:27:52.555 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:52.555 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:27:52.555 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:27:52.555 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:27:52.555 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:27:52.555 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:52.556 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:27:52.556 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:27:52.556 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:52.556 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:52.556 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:52.556 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:27:52.556 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:27:52.556 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:52.556 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:52.556 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:52.556 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:52.557 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:27:52.557 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:27:52.557 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:27:52.557 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:27:52.557 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:27:52.557 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:52.557 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:52.557 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:27:52.557 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:27:52.557 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:27:52.557 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:27:52.558 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:52.558 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:27:52.558 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:27:52.558 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:52.558 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:52.558 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:52.558 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:27:52.558 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:27:52.558 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:52.558 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:52.558 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:52.559 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:52.559 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:27:52.559 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:27:52.559 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:27:52.559 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:27:52.559 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:27:52.559 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:52.559 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:52.559 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:27:52.559 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:27:52.559 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:27:52.560 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:27:52.560 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:52.560 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:27:52.560 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:27:52.560 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:52.560 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:52.560 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:52.560 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:27:52.560 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:27:52.560 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:52.560 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:52.561 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:52.561 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:52.561 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:27:52.561 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:27:52.561 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:27:52.561 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:27:52.561 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:27:52.561 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:52.561 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:52.561 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:52.561 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:27:52.562 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:27:52.562 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:52.562 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:27:52.562 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:27:52.562 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:27:52.562 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:52.562 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:52.562 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:27:52.562 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:52.562 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:27:52.562 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:27:52.562 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 7 2024-08-24T21:27:52.563 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:52.563 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:52.563 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:27:52.563 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:52.563 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:27:52.563 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:27:52.563 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 6 2024-08-24T21:27:52.563 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:52.563 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:52.563 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:27:52.564 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:52.564 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:27:52.564 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:27:52.564 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:27:52.564 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:52.564 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:52.564 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:52.564 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:27:52.564 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:27:52.565 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:27:52.565 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:27:52.566 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:27:54.495 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:27:54.562 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=66fe4410e94e289c95bd48bfbeadf21a 2024-08-24T21:27:54.563 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap30 - 2024-08-24T21:27:54.563 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:27:54.563 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:27:55.778 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:27:55.778 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:27:55.778 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:27:55.778 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:27:55.778 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 156, 2024-08-24T21:27:55.778 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 10669, 2024-08-24T21:27:55.778 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:27:55.778 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:27:55.779 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:27:55.779 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:27:55.779 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:55.779 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 5, 2024-08-24T21:27:55.779 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:27:55.779 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:27:55.779 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:27:55.779 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:27:55.779 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:27:55.779 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:27:55.779 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:27:55.779 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:27:55.780 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:27:55.780 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:27:55.780 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:27:55.780 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:27:55.780 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:27:55.780 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:27:55.780 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:55.780 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:27:55.780 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:27:55.780 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:27:55.780 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:27:55.780 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:27:55.781 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:27:55.781 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:27:55.781 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:27:55.781 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:27:55.781 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:27:55.781 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:27:55.781 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:27:55.781 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:27:55.781 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:55.781 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:55.781 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:27:55.781 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:27:55.781 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:27:55.782 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:27:55.782 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:27:55.782 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:27:55.782 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:27:55.782 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:27:55.782 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:27:55.782 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:27:55.782 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:27:55.782 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:27:55.782 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:27:55.782 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:27:55.782 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:27:55.783 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:27:55.783 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:27:55.783 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:27:55.783 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:27:55.783 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:27:55.783 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:27:55.783 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:27:55.783 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:27:55.783 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:27:55.783 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:27:55.783 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:27:55.783 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:27:55.783 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:27:55.784 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:55.784 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:27:55.784 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:55.784 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:27:55.784 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:55.784 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:27:55.784 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:27:55.784 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:27:55.784 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:27:55.784 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:55.784 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:27:55.784 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:27:55.784 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:55.785 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:55.785 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:55.785 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:27:55.785 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:27:55.785 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:55.785 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:55.785 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:55.785 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:55.785 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:27:55.785 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:27:55.785 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:27:55.785 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:27:55.785 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:27:55.785 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:55.786 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:55.786 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:27:55.786 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:27:55.786 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:27:55.786 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:27:55.786 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:55.786 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:27:55.786 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:27:55.786 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:55.786 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:55.786 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:55.786 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:27:55.787 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:27:55.787 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:55.787 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:55.787 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:55.787 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:55.787 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:27:55.787 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:27:55.787 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:27:55.787 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:27:55.787 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:27:55.787 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:55.787 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:55.788 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:27:55.788 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:27:55.788 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:27:55.788 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:27:55.788 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:55.788 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:27:55.788 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:27:55.788 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:55.788 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:55.788 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:55.788 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:27:55.788 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:27:55.788 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:55.789 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:55.789 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:55.789 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:55.789 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:27:55.789 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:27:55.789 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:27:55.789 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:27:55.789 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:27:55.789 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:55.789 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:55.789 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:55.789 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:27:55.789 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:27:55.789 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:55.790 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:27:55.790 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:27:55.790 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:27:55.790 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:55.790 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:55.790 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:27:55.790 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:55.790 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:27:55.790 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:27:55.790 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:27:55.790 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:55.790 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:55.791 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:55.791 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:27:55.791 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:27:55.792 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:27:55.792 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:27:55.792 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:27:55.979 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:27:55.979 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:27:55.979 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:27:55.979 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:27:55.979 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 156, 2024-08-24T21:27:55.979 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 69629, 2024-08-24T21:27:55.979 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:27:55.979 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:27:55.980 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:27:55.980 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:27:55.980 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:55.980 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 5, 2024-08-24T21:27:55.980 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:27:55.980 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:27:55.980 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:27:55.980 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:27:55.980 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:27:55.980 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:27:55.980 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:27:55.980 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:27:55.980 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:27:55.981 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:27:55.981 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:27:55.981 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:27:55.981 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:27:55.981 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:27:55.981 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:55.981 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:27:55.981 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:27:55.981 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:27:55.981 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:27:55.981 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:27:55.981 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:27:55.981 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:27:55.982 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:27:55.982 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:27:55.982 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:27:55.982 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:27:55.982 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:27:55.982 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:27:55.982 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:55.982 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:55.982 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:27:55.982 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:27:55.982 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:27:55.983 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:27:55.983 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:27:55.983 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:27:55.983 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:27:55.983 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:27:55.983 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:27:55.983 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:27:55.985 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:27:55.986 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:27:55.986 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:27:55.986 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:27:55.986 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:27:55.986 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:27:55.986 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:27:55.986 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:27:55.986 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:27:55.986 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:27:55.986 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:27:55.986 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:27:55.986 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:27:55.987 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:27:55.987 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:27:55.987 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:27:55.987 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:27:55.987 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:27:55.987 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:55.987 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:27:55.987 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:55.987 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:27:55.987 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:55.987 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:27:55.988 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:27:55.988 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:27:55.988 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:27:55.988 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:55.988 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:27:55.988 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:27:55.988 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:55.988 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:55.988 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:55.988 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:27:55.988 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:27:55.988 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:55.988 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:55.989 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:55.989 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:55.989 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:27:55.989 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:27:55.989 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:27:55.989 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:27:55.989 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:27:55.989 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:55.989 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:55.989 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:27:55.989 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:27:55.989 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:27:55.989 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:27:55.990 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:55.990 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:27:55.990 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:27:55.990 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:55.990 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:55.990 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:55.990 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:27:55.990 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:27:55.990 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:55.990 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:55.990 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:55.990 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:55.990 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:27:55.991 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:27:55.991 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:27:55.991 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:27:55.991 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:27:55.991 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:55.991 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:55.991 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:27:55.991 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:27:55.991 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:27:55.991 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:27:55.991 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:55.991 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:27:55.991 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:27:55.992 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:55.992 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:55.992 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:55.992 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:27:55.992 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:27:55.992 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:55.992 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:55.992 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:55.992 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:55.992 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:27:55.992 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:27:55.993 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:27:55.993 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:27:55.993 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:27:55.993 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:55.993 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:55.993 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:55.993 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:27:55.993 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:27:55.993 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:55.993 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:27:55.993 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:27:55.993 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:27:55.993 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:55.994 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:55.994 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:27:55.994 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:55.994 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:27:55.994 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:27:55.994 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:27:55.994 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:55.994 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:55.994 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:27:55.994 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:55.994 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:27:55.994 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:27:55.994 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:27:55.995 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:55.995 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:55.995 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:27:55.995 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:55.995 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:27:55.995 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:27:55.995 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:27:55.995 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:55.995 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:55.995 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:55.995 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:27:55.995 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:27:55.997 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:27:55.997 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-08-24T21:27:55.997 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-08-24T21:27:56.491 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-08-24T21:27:57.492 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:27:57.493 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:27:57.951 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":156,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:27:57.970 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:27:57.970 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-08-24T21:27:57.970 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:27:57.970 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:27:58.156 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:27:58.156 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:27:58.156 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:27:58.156 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:27:58.156 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 156, 2024-08-24T21:27:58.156 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 198836, 2024-08-24T21:27:58.156 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:27:58.156 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:27:58.156 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:27:58.156 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:27:58.157 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:58.157 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 7, 2024-08-24T21:27:58.157 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:27:58.157 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:27:58.157 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:27:58.157 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:27:58.157 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:27:58.157 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:27:58.157 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:27:58.157 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:27:58.157 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:27:58.157 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:27:58.158 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:27:58.158 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:27:58.158 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:27:58.158 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:27:58.158 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:58.158 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:27:58.158 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:27:58.158 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:27:58.158 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:27:58.158 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:27:58.158 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:27:58.158 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:27:58.159 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:27:58.159 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:27:58.159 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:27:58.159 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:27:58.159 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:27:58.159 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:27:58.159 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:58.159 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:58.159 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:27:58.159 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:27:58.159 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:27:58.159 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:27:58.159 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:27:58.160 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:27:58.160 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:27:58.160 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:27:58.160 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:27:58.160 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:27:58.160 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:27:58.160 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:27:58.160 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:27:58.160 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:27:58.160 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:27:58.160 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:27:58.160 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:27:58.161 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:27:58.161 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:27:58.161 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:27:58.161 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:27:58.161 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:27:58.161 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:27:58.161 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:27:58.161 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:27:58.161 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:27:58.161 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:27:58.161 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:27:58.161 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:58.161 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:27:58.162 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:58.162 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:27:58.162 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:58.162 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:27:58.162 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:27:58.162 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:27:58.162 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:27:58.162 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:58.162 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:27:58.162 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:27:58.162 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:58.162 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:58.163 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:58.163 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:27:58.163 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:27:58.163 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:58.163 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:58.163 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:58.163 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:58.163 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:27:58.163 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:27:58.163 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:27:58.163 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:27:58.163 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:27:58.163 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:58.164 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:58.164 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:27:58.164 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:27:58.164 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:27:58.164 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:27:58.164 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:58.164 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:27:58.164 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:27:58.164 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:58.164 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:58.164 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:58.164 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:27:58.164 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:27:58.165 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:58.165 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:58.165 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:58.165 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:58.165 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:27:58.165 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:27:58.165 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:27:58.165 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:27:58.165 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:27:58.165 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:58.165 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:58.165 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:27:58.166 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:27:58.166 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:27:58.166 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:27:58.166 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:58.166 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:27:58.166 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:27:58.166 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:58.166 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:58.166 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:58.166 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:27:58.166 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:27:58.166 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:58.166 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:58.167 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:58.167 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:58.167 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:27:58.167 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:27:58.167 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:27:58.167 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:27:58.167 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:27:58.167 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:58.167 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:58.167 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:58.167 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:27:58.167 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:27:58.167 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:58.168 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:27:58.168 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:27:58.168 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:27:58.168 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:58.168 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:58.168 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:27:58.168 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:58.168 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:27:58.168 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:27:58.169 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 7 2024-08-24T21:27:58.169 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:58.169 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:58.169 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:27:58.169 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:58.169 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:27:58.169 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:27:58.169 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:27:58.169 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:58.169 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:58.169 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:27:58.169 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:58.169 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:27:58.169 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:27:58.170 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:27:58.170 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:58.170 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:58.170 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:58.170 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:27:58.170 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:27:58.171 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:27:58.172 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:27:58.172 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:27:58.361 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:27:58.361 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:27:58.362 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:27:58.362 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:27:58.362 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 156, 2024-08-24T21:27:58.362 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 13254, 2024-08-24T21:27:58.362 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:27:58.362 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:27:58.362 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:27:58.362 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:27:58.362 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:58.362 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 7, 2024-08-24T21:27:58.362 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:27:58.363 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:27:58.363 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:27:58.363 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:27:58.363 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:27:58.363 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:27:58.363 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:27:58.363 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:27:58.363 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:27:58.363 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:27:58.363 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:27:58.363 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:27:58.363 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:27:58.363 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:27:58.364 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:58.364 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:27:58.364 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:27:58.364 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:27:58.364 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:27:58.364 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:27:58.364 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:27:58.364 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:27:58.364 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:27:58.364 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:27:58.364 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:27:58.364 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:27:58.365 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:27:58.365 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:27:58.365 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:58.365 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:58.365 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:27:58.365 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:27:58.365 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:27:58.365 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:27:58.365 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:27:58.365 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:27:58.365 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:27:58.365 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:27:58.365 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:27:58.366 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:27:58.366 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:27:58.366 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:27:58.366 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:27:58.366 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:27:58.366 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:27:58.366 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:27:58.366 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:27:58.366 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:27:58.366 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:27:58.366 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:27:58.367 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:27:58.367 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:27:58.367 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:27:58.367 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:27:58.367 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:27:58.367 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:27:58.367 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:27:58.367 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:27:58.368 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:58.368 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:27:58.368 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:58.368 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:27:58.368 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:58.368 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:27:58.368 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:27:58.368 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:27:58.368 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:27:58.369 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:58.369 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:27:58.369 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:27:58.369 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:58.369 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:58.369 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:58.369 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:27:58.369 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:27:58.369 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:58.369 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:58.369 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:58.369 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:58.370 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:27:58.370 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:27:58.370 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:27:58.370 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:27:58.370 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:27:58.370 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:58.370 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:58.370 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:27:58.370 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:27:58.370 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:27:58.370 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:27:58.370 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:58.370 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:27:58.371 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:27:58.371 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:58.371 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:58.371 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:58.371 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:27:58.371 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:27:58.371 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:58.371 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:58.371 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:58.371 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:58.371 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:27:58.371 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:27:58.372 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:27:58.372 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:27:58.372 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:27:58.372 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:58.372 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:58.372 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:27:58.372 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:27:58.372 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:27:58.372 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:27:58.372 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:58.372 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:27:58.372 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:27:58.372 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:58.373 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:58.373 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:58.373 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:27:58.373 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:27:58.373 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:58.373 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:58.373 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:58.373 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:58.373 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:27:58.373 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:27:58.373 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:27:58.373 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:27:58.373 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:27:58.373 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:58.374 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:58.374 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:58.374 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:27:58.374 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:27:58.374 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:58.374 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:27:58.374 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:27:58.374 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:27:58.374 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:58.374 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:58.374 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:27:58.374 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:58.374 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:27:58.375 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:27:58.375 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:27:58.375 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:58.375 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:58.375 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:58.375 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:27:58.375 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:27:58.377 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:27:58.377 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:27:58.377 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:27:58.564 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:27:58.564 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:27:58.564 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:27:58.564 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:27:58.564 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 156, 2024-08-24T21:27:58.564 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 72214, 2024-08-24T21:27:58.564 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:27:58.564 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:27:58.564 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:27:58.565 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:27:58.565 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:58.565 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 7, 2024-08-24T21:27:58.565 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:27:58.565 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:27:58.565 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:27:58.565 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:27:58.565 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:27:58.565 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:27:58.565 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:27:58.565 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:27:58.565 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:27:58.565 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:27:58.566 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:27:58.566 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:27:58.566 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:27:58.566 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:27:58.566 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:58.566 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:27:58.566 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:27:58.566 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:27:58.566 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:27:58.566 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:27:58.566 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:27:58.566 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:27:58.566 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:27:58.567 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:27:58.567 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:27:58.567 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:27:58.567 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:27:58.567 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:27:58.567 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:58.567 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:58.567 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:27:58.567 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:27:58.567 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:27:58.567 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:27:58.567 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:27:58.567 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:27:58.568 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:27:58.568 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:27:58.568 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:27:58.568 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:27:58.568 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:27:58.568 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:27:58.568 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:27:58.568 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:27:58.568 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:27:58.568 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:27:58.568 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:27:58.568 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:27:58.569 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:27:58.569 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:27:58.569 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:27:58.569 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:27:58.569 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:27:58.569 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:27:58.569 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:27:58.569 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:27:58.569 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:27:58.569 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:27:58.569 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:58.569 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:27:58.569 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:58.570 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:27:58.570 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:58.570 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:27:58.570 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:27:58.570 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:27:58.570 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:27:58.570 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:58.570 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:27:58.570 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:27:58.570 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:58.570 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:58.570 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:58.570 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:27:58.571 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:27:58.571 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:58.571 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:58.571 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:58.571 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:58.571 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:27:58.571 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:27:58.571 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:27:58.571 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:27:58.571 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:27:58.571 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:58.571 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:58.571 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:27:58.572 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:27:58.572 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:27:58.572 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:27:58.572 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:58.572 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:27:58.572 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:27:58.572 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:58.572 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:58.572 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:58.572 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:27:58.572 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:27:58.572 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:58.572 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:58.573 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:58.573 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:58.573 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:27:58.573 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:27:58.573 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:27:58.573 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:27:58.573 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:27:58.573 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:58.573 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:58.573 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:27:58.573 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:27:58.573 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:27:58.573 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:27:58.574 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:58.574 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:27:58.574 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:27:58.574 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:58.574 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:58.574 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:58.574 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:27:58.574 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:27:58.574 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:27:58.574 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:58.574 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:58.574 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:58.574 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:27:58.575 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:27:58.575 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:27:58.575 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:27:58.575 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:27:58.575 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:58.575 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:58.575 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:58.575 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:27:58.575 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:27:58.575 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:58.575 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:27:58.575 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:27:58.575 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:27:58.575 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:58.576 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:58.576 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:27:58.576 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:58.576 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:27:58.576 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:27:58.576 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:27:58.576 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:58.576 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:58.576 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:27:58.576 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:58.576 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:27:58.576 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:27:58.576 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:27:58.577 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:58.577 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:27:58.577 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:27:58.577 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:27:58.577 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:27:58.577 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:27:58.577 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:27:58.577 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:27:58.577 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:27:58.577 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:27:58.577 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:27:58.577 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:27:58.580 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:27:58.580 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2024-08-24T21:27:58.580 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['b'] 2024-08-24T21:27:58.580 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-08-24T21:27:58.580 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-08-24T21:27:58.581 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-08-24T21:27:58.581 INFO:teuthology.orchestra.run:waiting for 300 2024-08-24T21:27:58.597 INFO:tasks.ceph.mon.c:Stopped 2024-08-24T21:27:58.597 INFO:tasks.mon_thrash:Sending STOP to mon b 2024-08-24T21:27:58.598 INFO:tasks.ceph.mon.b:Sent signal 19 2024-08-24T21:27:58.598 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-08-24T21:27:59.854 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:27:59.867 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=66fe4410e94e289c95bd48bfbeadf21a 2024-08-24T21:27:59.867 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ 66fe4410e94e289c95bd48bfbeadf21a != \6\6\f\e\4\4\1\0\e\9\4\e\2\8\9\c\9\5\b\d\4\8\b\f\b\e\a\d\f\2\1\a ]] 2024-08-24T21:27:59.867 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap30 2024-08-24T21:27:59.867 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap30 2024-08-24T21:27:59.867 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap30 2024-08-24T21:27:59.976 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:27:59.988 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:27:59.989 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap30 2024-08-24T21:27:59.989 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:28:00.068 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:28:00.068 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:28:00.069 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:28:00.069 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:28:00.069 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:28:00.069 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap31.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:28:13.599 INFO:tasks.mon_thrash:Sending CONT to mon b 2024-08-24T21:28:13.600 INFO:tasks.ceph.mon.b:Sent signal 18 2024-08-24T21:28:13.600 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-08-24T21:28:13.601 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:28:18.917 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":158,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:28:18.936 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-08-24T21:28:18.936 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-08-24T21:28:18.936 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:28:19.112 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:28:19.112 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:28:19.112 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:28:19.112 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:28:19.112 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 158, 2024-08-24T21:28:19.112 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 219792, 2024-08-24T21:28:19.112 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:28:19.112 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:28:19.113 INFO:teuthology.orchestra.run.smithi060.stdout: 1 2024-08-24T21:28:19.113 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:28:19.113 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:28:19.113 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:28:19.113 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:28:19.113 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:28:19.113 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:28:19.113 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:28:19.113 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:28:19.113 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:28:19.113 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:28:19.114 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:28:19.114 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:28:19.114 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:28:19.114 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:28:19.114 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:28:19.114 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:28:19.114 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:28:19.114 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:28:19.114 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:28:19.114 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:28:19.114 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:28:19.114 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:28:19.115 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:28:19.115 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:28:19.115 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:28:19.115 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:28:19.115 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:28:19.115 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:28:19.115 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:28:19.115 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:28:19.115 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:28:19.115 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:19.115 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:28:19.115 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:28:19.115 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:28:19.116 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:28:19.116 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:28:19.116 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:28:19.116 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:28:19.116 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:28:19.116 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:28:19.116 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:28:19.116 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:28:19.116 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:28:19.116 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:28:19.116 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:28:19.116 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:28:19.116 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:28:19.117 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:28:19.117 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:28:19.117 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:28:19.117 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:28:19.117 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:28:19.117 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:28:19.117 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:28:19.117 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:28:19.117 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:28:19.117 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:28:19.117 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:28:19.117 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:28:19.117 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:28:19.118 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:28:19.118 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:19.118 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:28:19.118 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:19.118 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:28:19.118 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:28:19.118 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:28:19.118 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:28:19.118 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:19.118 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:28:19.118 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:28:19.118 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:28:19.118 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:19.119 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:19.119 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:28:19.119 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:28:19.119 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:28:19.119 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:28:19.119 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:28:19.119 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:19.119 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:28:19.119 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:28:19.119 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:28:19.119 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:28:19.119 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:28:19.120 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:19.120 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:19.120 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:28:19.120 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:28:19.120 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:28:19.120 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:28:19.120 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:19.120 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:28:19.120 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:28:19.120 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:28:19.120 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:19.120 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:19.120 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:28:19.120 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:28:19.121 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:28:19.121 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:28:19.121 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:28:19.121 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:19.121 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:28:19.121 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:28:19.121 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:28:19.121 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:28:19.121 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:28:19.121 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:19.121 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:19.121 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:28:19.121 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:28:19.121 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:28:19.122 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:28:19.122 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:19.122 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:28:19.122 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:28:19.122 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:28:19.122 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:19.122 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:19.122 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:28:19.122 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:28:19.122 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:28:19.122 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:28:19.122 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:28:19.123 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:19.123 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:28:19.123 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:28:19.123 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:28:19.123 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:28:19.123 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:28:19.123 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:28:19.123 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:28:19.123 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:19.123 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:28:19.123 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:28:19.123 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:19.123 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:28:19.124 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:28:19.124 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:28:19.124 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:28:19.124 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:28:19.124 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:28:19.124 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:19.124 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:28:19.124 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:28:19.124 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 7 2024-08-24T21:28:19.124 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:28:19.124 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:28:19.124 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:28:19.124 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:19.125 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:28:19.125 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:28:19.125 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 6 2024-08-24T21:28:19.125 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:28:19.125 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:28:19.125 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:28:19.125 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:19.125 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:28:19.125 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:28:19.125 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:28:19.125 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:28:19.125 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:28:19.125 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:19.126 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:28:19.126 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:28:19.127 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:28:19.127 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-08-24T21:28:19.127 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:28:19.304 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:28:19.305 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:28:19.305 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:28:19.305 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:28:19.305 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 158, 2024-08-24T21:28:19.305 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 92955, 2024-08-24T21:28:19.305 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:28:19.305 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:28:19.305 INFO:teuthology.orchestra.run.smithi060.stdout: 1 2024-08-24T21:28:19.305 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:28:19.305 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:28:19.306 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:28:19.306 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:28:19.306 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:28:19.306 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:28:19.306 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:28:19.306 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:28:19.306 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:28:19.306 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:28:19.306 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:28:19.306 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:28:19.306 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:28:19.306 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:28:19.307 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:28:19.307 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:28:19.307 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:28:19.307 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:28:19.307 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:28:19.307 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:28:19.307 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:28:19.307 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:28:19.307 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:28:19.307 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:28:19.307 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:28:19.307 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:28:19.307 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:28:19.307 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:28:19.308 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:28:19.308 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:28:19.308 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:28:19.308 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:19.308 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:28:19.308 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:28:19.308 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:28:19.308 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:28:19.308 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:28:19.308 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:28:19.308 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:28:19.308 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:28:19.309 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:28:19.309 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:28:19.309 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:28:19.309 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:28:19.309 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:28:19.309 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:28:19.309 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:28:19.309 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:28:19.309 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:28:19.309 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:28:19.309 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:28:19.309 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:28:19.309 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:28:19.310 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:28:19.310 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:28:19.310 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:28:19.310 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:28:19.310 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:28:19.310 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:28:19.310 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:28:19.310 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:28:19.310 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:28:19.310 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:19.310 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:28:19.310 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:19.310 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:28:19.311 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:28:19.311 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:28:19.311 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:28:19.311 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:19.311 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:28:19.311 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:28:19.311 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:28:19.311 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:19.311 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:19.311 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:28:19.311 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:28:19.311 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:28:19.311 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:28:19.312 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:28:19.312 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:19.312 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:28:19.312 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:28:19.312 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:28:19.312 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:28:19.312 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:28:19.312 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:19.312 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:19.313 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:28:19.313 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:28:19.313 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:28:19.313 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:28:19.313 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:19.313 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:28:19.313 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:28:19.313 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:28:19.313 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:19.313 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:19.313 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:28:19.313 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:28:19.313 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:28:19.314 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:28:19.314 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:28:19.314 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:19.314 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:28:19.314 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:28:19.314 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:28:19.314 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:28:19.314 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:28:19.314 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:19.314 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:19.314 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:28:19.314 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:28:19.315 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:28:19.315 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:28:19.315 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:19.315 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:28:19.315 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:28:19.315 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:28:19.315 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:19.315 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:19.315 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:28:19.315 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:28:19.315 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:28:19.315 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:28:19.315 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:28:19.316 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:19.316 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:28:19.316 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:28:19.316 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:28:19.316 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:28:19.316 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:28:19.316 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:28:19.316 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:28:19.316 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:19.316 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:28:19.316 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:28:19.316 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:19.316 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:28:19.317 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:28:19.317 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:28:19.317 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:28:19.317 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:28:19.317 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:28:19.317 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:19.317 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:28:19.317 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:28:19.317 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:28:19.317 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:28:19.317 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:28:19.317 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:28:19.317 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:19.318 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:28:19.318 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:28:19.318 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:28:19.318 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:28:19.318 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:28:19.318 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:28:19.318 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:19.318 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:28:19.318 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:28:19.318 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:28:19.318 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:28:19.318 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:28:19.318 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:19.319 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:28:19.319 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:28:19.320 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:28:19.320 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-08-24T21:28:19.628 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 1% complete... Importing image diff: 3% complete... Importing image diff: 4% complete... Importing image diff: 6% complete... Importing image diff: 7% complete... Importing image diff: 9% complete... Importing image diff: 10% complete... Importing image diff: 12% complete... Importing image diff: 14% complete... Importing image diff: 15% complete... Importing image diff: 17% complete... Importing image diff: 18% complete... Importing image diff: 20% complete... Importing image diff: 21% complete... Importing image diff: 23% complete... Importing image diff: 25% complete... Importing image diff: 26% complete... Importing image diff: 28% complete... Importing image diff: 29% complete... Importing image diff: 31% complete... Importing image diff: 32% complete... Importing image diff: 34% complete... Importing image diff: 35% complete... Importing image diff: 37% complete... Importing image diff: 39% complete... Importing image diff: 40% complete... Importing image diff: 42% complete... Importing image diff: 43% complete... Importing image diff: 45% complete... Importing image diff: 46% complete... Importing image diff: 48% complete... Importing image diff: 50% complete... Importing image diff: 51% complete... Importing image diff: 53% complete... Importing image diff: 54% complete... Importing image diff: 56% complete... Importing image diff: 57% complete... Importing image diff: 59% complete... Importing image diff: 60% complete... Importing image diff: 62% complete... Importing image diff: 64% complete... Importing image diff: 65% complete... Importing image diff: 67% complete... Importing image diff: 68% complete... Importing image diff: 70% complete... Importing image diff: 71% complete... Importing image diff: 73% complete... Importing image diff: 75% complete... Importing image diff: 76% complete... Importing image diff: 78% complete... Importing image diff: 79% complete... Importing image diff: 81% complete... Importing image diff: 82% complete... Importing image diff: 84% complete... Importing image diff: 85% complete... Importing image diff: 87% complete... Importing image diff: 89% complete... Importing image diff: 90% complete... Importing image diff: 92% complete... Importing image diff: 93% complete... Importing image diff: 95% complete... Importing image diff: 96% complete... Importing image diff: 98% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2024-08-24T21:28:19.651 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap31 - 2024-08-24T21:28:19.651 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:28:19.651 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:28:24.806 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:28:24.890 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=5b58f29e4e62e1a208503860a8a23196 2024-08-24T21:28:24.892 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap31 - 2024-08-24T21:28:24.892 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:28:24.893 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:28:30.171 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:28:30.181 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=5b58f29e4e62e1a208503860a8a23196 2024-08-24T21:28:30.182 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ 5b58f29e4e62e1a208503860a8a23196 != \5\b\5\8\f\2\9\e\4\e\6\2\e\1\a\2\0\8\5\0\3\8\6\0\a\8\a\2\3\1\9\6 ]] 2024-08-24T21:28:30.182 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap31 2024-08-24T21:28:30.182 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap31 2024-08-24T21:28:30.182 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap31 2024-08-24T21:28:30.290 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:28:30.303 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:28:30.304 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap31 2024-08-24T21:28:30.304 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:28:30.383 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:28:30.383 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:28:30.383 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:28:30.383 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:28:30.383 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:28:30.383 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap32.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:28:32.656 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 5% complete... Importing image diff: 10% complete... Importing image diff: 16% complete... Importing image diff: 21% complete... Importing image diff: 27% complete... Importing image diff: 32% complete... Importing image diff: 38% complete... Importing image diff: 43% complete... Importing image diff: 48% complete... Importing image diff: 49% complete... Importing image diff: 55% complete... Importing image diff: 60% complete... Importing image diff: 65% complete... Importing image diff: 66% complete... Importing image diff: 72% complete... Importing image diff: 77% complete... Importing image diff: 82% complete... Importing image diff: 83% complete... Importing image diff: 89% complete... Importing image diff: 94% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2024-08-24T21:28:32.674 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap32 - 2024-08-24T21:28:32.674 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:28:32.674 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:28:37.886 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:28:37.972 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=34c525e85940a3bd21192dd4a4c65f60 2024-08-24T21:28:37.973 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap32 - 2024-08-24T21:28:37.973 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:28:37.973 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:28:39.321 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-08-24T21:28:39.321 INFO:tasks.ceph.mon.c:Restarting daemon 2024-08-24T21:28:39.321 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-08-24T21:28:39.326 INFO:tasks.ceph.mon.c:Started 2024-08-24T21:28:39.326 INFO:tasks.mon_thrash:Sending STOP to mon b 2024-08-24T21:28:39.326 INFO:tasks.ceph.mon.b:Sent signal 19 2024-08-24T21:28:39.326 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-08-24T21:28:43.212 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:28:43.222 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=34c525e85940a3bd21192dd4a4c65f60 2024-08-24T21:28:43.222 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ 34c525e85940a3bd21192dd4a4c65f60 != \3\4\c\5\2\5\e\8\5\9\4\0\a\3\b\d\2\1\1\9\2\d\d\4\a\4\c\6\5\f\6\0 ]] 2024-08-24T21:28:43.223 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap32 2024-08-24T21:28:43.223 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap32 2024-08-24T21:28:43.223 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap32 2024-08-24T21:28:43.332 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:28:43.345 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:28:43.346 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap32 2024-08-24T21:28:43.346 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:28:43.423 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:28:43.423 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:28:43.423 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:28:43.423 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:28:43.423 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:28:43.423 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap33.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:28:54.327 INFO:tasks.mon_thrash:Sending CONT to mon b 2024-08-24T21:28:54.328 INFO:tasks.ceph.mon.b:Sent signal 18 2024-08-24T21:28:54.328 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:28:54.328 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:28:54.785 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":160,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:28:54.804 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:28:54.804 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:28:54.804 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:28:54.980 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:28:54.980 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:28:54.980 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:28:54.980 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:28:54.980 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 160, 2024-08-24T21:28:54.980 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 255660, 2024-08-24T21:28:54.980 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:28:54.980 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:28:54.980 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:28:54.980 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:28:54.981 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:28:54.981 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:28:54.981 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:28:54.981 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:28:54.981 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:28:54.981 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:28:54.981 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:28:54.981 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:28:54.981 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:28:54.981 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:28:54.981 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:28:54.981 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:28:54.981 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:28:54.982 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:28:54.982 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:28:54.982 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:28:54.982 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:28:54.982 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:28:54.982 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:28:54.982 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:28:54.982 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:28:54.982 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:28:54.982 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:28:54.982 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:28:54.982 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:28:54.982 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:28:54.983 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:28:54.983 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:28:54.983 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:28:54.983 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:28:54.983 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:28:54.983 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:54.983 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:28:54.983 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:28:54.983 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:28:54.983 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:28:54.983 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:28:54.983 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:28:54.983 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:28:54.984 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:28:54.984 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:28:54.984 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:28:54.984 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:28:54.984 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:28:54.984 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:28:54.984 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:28:54.984 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:28:54.984 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:28:54.984 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:28:54.984 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:28:54.984 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:28:54.985 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:28:54.985 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:28:54.985 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:28:54.985 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:28:54.985 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:28:54.985 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:28:54.985 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:28:54.985 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:28:54.985 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:28:54.985 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:28:54.985 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:28:54.985 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:54.985 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:28:54.986 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:54.986 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:28:54.986 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:28:54.986 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:28:54.986 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:28:54.986 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:54.986 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:28:54.986 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:28:54.986 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:28:54.986 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:54.986 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:54.986 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:28:54.986 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:28:54.987 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:28:54.987 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:28:54.987 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:28:54.987 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:54.987 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:28:54.987 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:28:54.987 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:28:54.987 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:28:54.987 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:28:54.987 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:54.987 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:54.987 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:28:54.987 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:28:54.988 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:28:54.988 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:28:54.988 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:54.988 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:28:54.988 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:28:54.988 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:28:54.988 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:54.988 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:54.988 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:28:54.988 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:28:54.988 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:28:54.988 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:28:54.988 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:28:54.989 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:54.989 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:28:54.989 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:28:54.989 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:28:54.989 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:28:54.989 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:28:54.989 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:54.989 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:54.989 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:28:54.989 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:28:54.989 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:28:54.989 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:28:54.989 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:54.990 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:28:54.990 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:28:54.990 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:28:54.990 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:54.990 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:54.990 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:28:54.990 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:28:54.990 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:28:54.990 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:28:54.990 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:28:54.990 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:54.990 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:28:54.991 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:28:54.991 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:28:54.991 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:28:54.991 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:28:54.991 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:28:54.991 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:28:54.991 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:54.991 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:28:54.991 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:28:54.991 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:54.991 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:28:54.991 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:28:54.992 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:28:54.992 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:28:54.992 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:28:54.992 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:28:54.992 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:54.992 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:28:54.992 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:28:54.992 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 7 2024-08-24T21:28:54.992 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:28:54.992 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:28:54.992 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:28:54.992 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:54.992 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:28:54.992 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:28:54.993 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 6 2024-08-24T21:28:54.993 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:28:54.993 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:28:54.993 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:28:54.993 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:54.993 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:28:54.993 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:28:54.993 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:28:54.993 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:28:54.993 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:28:54.993 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:54.993 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:28:54.993 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:28:54.995 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:28:54.995 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:28:54.995 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:28:55.170 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:28:55.170 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:28:55.170 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:28:55.171 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:28:55.171 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 160, 2024-08-24T21:28:55.171 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 15699, 2024-08-24T21:28:55.171 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:28:55.171 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:28:55.171 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:28:55.171 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:28:55.171 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:28:55.171 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:28:55.171 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:28:55.171 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:28:55.171 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:28:55.172 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:28:55.172 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:28:55.172 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:28:55.172 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:28:55.172 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:28:55.172 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:28:55.172 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:28:55.172 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:28:55.172 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:28:55.172 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:28:55.172 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:28:55.172 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:28:55.172 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:28:55.172 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:28:55.173 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:28:55.173 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:28:55.173 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:28:55.173 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:28:55.173 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:28:55.173 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:28:55.173 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:28:55.173 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:28:55.173 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:28:55.173 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:28:55.173 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:28:55.173 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:28:55.173 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:55.174 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:28:55.174 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:28:55.174 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:28:55.174 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:28:55.174 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:28:55.174 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:28:55.174 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:28:55.174 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:28:55.174 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:28:55.174 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:28:55.174 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:28:55.174 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:28:55.174 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:28:55.175 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:28:55.175 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:28:55.175 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:28:55.175 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:28:55.175 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:28:55.175 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:28:55.175 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:28:55.175 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:28:55.175 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:28:55.175 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:28:55.175 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:28:55.175 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:28:55.176 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:28:55.176 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:28:55.176 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:28:55.176 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:28:55.176 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:28:55.176 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:55.176 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:28:55.176 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:55.176 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:28:55.176 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:28:55.176 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:28:55.176 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:28:55.176 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:55.177 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:28:55.177 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:28:55.177 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:28:55.177 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:55.177 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:55.177 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:28:55.177 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:28:55.177 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:28:55.177 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:28:55.177 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:28:55.177 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:55.177 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:28:55.177 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:28:55.178 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:28:55.178 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:28:55.178 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:28:55.178 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:55.178 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:55.178 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:28:55.178 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:28:55.178 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:28:55.178 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:28:55.178 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:55.178 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:28:55.178 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:28:55.178 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:28:55.179 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:55.179 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:55.179 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:28:55.179 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:28:55.179 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:28:55.179 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:28:55.179 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:28:55.179 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:55.179 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:28:55.179 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:28:55.179 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:28:55.179 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:28:55.179 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:28:55.179 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:55.180 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:55.180 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:28:55.180 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:28:55.180 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:28:55.180 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:28:55.180 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:55.180 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:28:55.180 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:28:55.180 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:28:55.180 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:55.180 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:55.180 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:28:55.180 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:28:55.181 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:28:55.181 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:28:55.181 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:28:55.181 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:55.181 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:28:55.181 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:28:55.181 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:28:55.181 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:28:55.181 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:28:55.181 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:28:55.181 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:28:55.181 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:55.181 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:28:55.181 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:28:55.182 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:55.182 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:28:55.182 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:28:55.182 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:28:55.182 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:28:55.182 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:28:55.182 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:28:55.182 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:55.182 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:28:55.182 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:28:55.182 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:28:55.182 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:28:55.182 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:28:55.183 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:55.183 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:28:55.183 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:28:55.185 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:28:55.185 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:28:55.185 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:28:55.359 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 2% complete... Importing image diff: 5% complete... Importing image diff: 8% complete... Importing image diff: 11% complete... Importing image diff: 14% complete... Importing image diff: 17% complete... Importing image diff: 20% complete... Importing image diff: 22% complete... Importing image diff: 25% complete... Importing image diff: 28% complete... Importing image diff: 31% complete... Importing image diff: 34% complete... Importing image diff: 37% complete... Importing image diff: 40% complete... Importing image diff: 42% complete... Importing image diff: 45% complete... Importing image diff: 48% complete... Importing image diff: 51% complete... Importing image diff: 54% complete... Importing image diff: 57% complete... Importing image diff: 60% complete... Importing image diff: 62% complete... Importing image diff: 65% complete... Importing image diff: 68% complete... Importing image diff: 71% complete... Importing image diff: 74% complete... Importing image diff: 77% complete... Importing image diff: 80% complete... Importing image diff: 82% complete... Importing image diff: 85% complete... Importing image diff: 88% complete... Importing image diff: 91% complete... Importing image diff: 94% complete... Importing image diff: 97% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2024-08-24T21:28:55.364 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:28:55.364 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:28:55.364 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:28:55.364 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:28:55.364 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 160, 2024-08-24T21:28:55.364 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 129014, 2024-08-24T21:28:55.364 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:28:55.364 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:28:55.364 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:28:55.364 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:28:55.365 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:28:55.365 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 1, 2024-08-24T21:28:55.365 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:28:55.365 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:28:55.365 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:28:55.365 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:28:55.365 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:28:55.365 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:28:55.365 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:28:55.365 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:28:55.365 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:28:55.365 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:28:55.365 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:28:55.365 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:28:55.366 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:28:55.366 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:28:55.366 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:28:55.366 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:28:55.366 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:28:55.366 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:28:55.366 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:28:55.366 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:28:55.366 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:28:55.366 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:28:55.367 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:28:55.367 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:28:55.367 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:28:55.367 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:28:55.367 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:28:55.367 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:28:55.367 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:28:55.367 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:55.367 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:28:55.367 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:28:55.367 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:28:55.368 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:28:55.368 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:28:55.368 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:28:55.368 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:28:55.368 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:28:55.368 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:28:55.368 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:28:55.368 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:28:55.368 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:28:55.368 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:28:55.369 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:28:55.369 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:28:55.369 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:28:55.369 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:28:55.369 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:28:55.369 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:28:55.369 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:28:55.369 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:28:55.369 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:28:55.369 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:28:55.370 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:28:55.370 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:28:55.370 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:28:55.370 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:28:55.370 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:28:55.370 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:28:55.370 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:28:55.370 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:55.370 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:28:55.370 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:55.371 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:28:55.371 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:28:55.371 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:28:55.371 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:28:55.371 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:55.371 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:28:55.371 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:28:55.371 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:28:55.371 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:55.372 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:55.372 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:28:55.372 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:28:55.372 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:28:55.372 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:28:55.372 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:28:55.372 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:55.372 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:28:55.372 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:28:55.372 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:28:55.373 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:28:55.373 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:28:55.373 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:55.373 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:55.373 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:28:55.373 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:28:55.373 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:28:55.373 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:28:55.374 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:55.374 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:28:55.374 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:28:55.374 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:28:55.374 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:55.374 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:55.374 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:28:55.374 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:28:55.374 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:28:55.374 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:28:55.374 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:28:55.374 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:55.375 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:28:55.375 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:28:55.375 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:28:55.375 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:28:55.375 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:28:55.375 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:55.375 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:55.375 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:28:55.375 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:28:55.375 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:28:55.376 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:28:55.376 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:55.376 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:28:55.376 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:28:55.376 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:28:55.376 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:55.376 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:55.376 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:28:55.376 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:28:55.376 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:28:55.376 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:28:55.376 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:28:55.376 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:55.377 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:28:55.377 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:28:55.377 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:28:55.377 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:28:55.377 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:28:55.377 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:28:55.377 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:28:55.377 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:55.377 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:28:55.377 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:28:55.377 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:55.377 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:28:55.377 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:28:55.378 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:28:55.378 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:28:55.378 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:28:55.378 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:28:55.378 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:55.378 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:28:55.378 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:28:55.378 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:28:55.378 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:28:55.378 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:28:55.378 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:28:55.378 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:55.378 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:28:55.379 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:28:55.379 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:28:55.379 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:28:55.379 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:28:55.379 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:28:55.379 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:55.379 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:28:55.379 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:28:55.379 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:28:55.379 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:28:55.379 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:28:55.379 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:55.379 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:28:55.379 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:28:55.381 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:28:55.381 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-08-24T21:28:55.381 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-08-24T21:28:55.382 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap33 - 2024-08-24T21:28:55.382 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:28:55.382 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:28:55.870 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-08-24T21:28:56.871 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:28:56.872 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:28:57.344 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":160,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:28:57.363 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:28:57.363 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-08-24T21:28:57.363 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:28:57.363 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:28:57.539 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:28:57.539 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:28:57.539 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:28:57.539 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:28:57.539 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 160, 2024-08-24T21:28:57.539 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 258220, 2024-08-24T21:28:57.540 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:28:57.540 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:28:57.540 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:28:57.540 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:28:57.540 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:28:57.540 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 3, 2024-08-24T21:28:57.540 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:28:57.540 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:28:57.540 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:28:57.540 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:28:57.540 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:28:57.540 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:28:57.541 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:28:57.541 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:28:57.541 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:28:57.541 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:28:57.541 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:28:57.541 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:28:57.541 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:28:57.541 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:28:57.541 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:28:57.541 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:28:57.541 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:28:57.541 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:28:57.541 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:28:57.542 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:28:57.542 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:28:57.542 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:28:57.542 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:28:57.542 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:28:57.542 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:28:57.542 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:28:57.542 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:28:57.542 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:28:57.542 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:28:57.542 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:57.542 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:28:57.543 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:28:57.543 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:28:57.543 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:28:57.543 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:28:57.543 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:28:57.543 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:28:57.543 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:28:57.543 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:28:57.543 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:28:57.543 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:28:57.543 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:28:57.543 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:28:57.544 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:28:57.544 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:28:57.544 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:28:57.544 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:28:57.544 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:28:57.544 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:28:57.544 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:28:57.544 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:28:57.544 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:28:57.544 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:28:57.544 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:28:57.544 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:28:57.544 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:28:57.545 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:28:57.545 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:28:57.545 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:28:57.545 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:28:57.545 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:57.545 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:28:57.545 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:57.545 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:28:57.545 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:28:57.545 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:28:57.545 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:28:57.545 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:57.545 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:28:57.546 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:28:57.546 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:28:57.546 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:57.546 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:57.546 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:28:57.546 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:28:57.546 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:28:57.546 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:28:57.546 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:28:57.546 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:57.546 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:28:57.546 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:28:57.547 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:28:57.547 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:28:57.547 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:28:57.547 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:57.547 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:57.547 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:28:57.547 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:28:57.547 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:28:57.547 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:28:57.547 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:57.547 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:28:57.547 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:28:57.547 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:28:57.548 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:57.548 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:57.548 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:28:57.548 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:28:57.548 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:28:57.548 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:28:57.548 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:28:57.548 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:57.548 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:28:57.548 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:28:57.548 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:28:57.548 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:28:57.548 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:28:57.549 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:57.549 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:57.549 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:28:57.549 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:28:57.549 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:28:57.549 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:28:57.549 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:57.549 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:28:57.549 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:28:57.549 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:28:57.549 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:57.549 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:57.549 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:28:57.550 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:28:57.550 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:28:57.550 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:28:57.550 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:28:57.550 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:57.550 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:28:57.550 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:28:57.550 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:28:57.550 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:28:57.550 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:28:57.550 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:28:57.550 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:28:57.550 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:57.551 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:28:57.551 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:28:57.551 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:57.551 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:28:57.551 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:28:57.551 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:28:57.551 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:28:57.551 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:28:57.551 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:28:57.551 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:57.551 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:28:57.551 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:28:57.552 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 7 2024-08-24T21:28:57.552 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:28:57.552 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:28:57.552 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:28:57.552 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:57.552 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:28:57.552 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:28:57.552 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:28:57.552 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:28:57.552 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:28:57.552 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:28:57.552 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:57.552 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:28:57.553 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:28:57.553 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:28:57.553 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:28:57.553 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:28:57.553 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:57.553 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:28:57.553 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:28:57.554 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:28:57.554 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:28:57.554 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:28:57.731 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:28:57.731 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:28:57.731 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:28:57.731 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:28:57.731 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 160, 2024-08-24T21:28:57.731 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 18259, 2024-08-24T21:28:57.731 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:28:57.731 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:28:57.731 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:28:57.731 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:28:57.731 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:28:57.732 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 3, 2024-08-24T21:28:57.732 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:28:57.732 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:28:57.732 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:28:57.732 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:28:57.732 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:28:57.732 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:28:57.732 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:28:57.732 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:28:57.732 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:28:57.732 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:28:57.732 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:28:57.732 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:28:57.733 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:28:57.733 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:28:57.733 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:28:57.733 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:28:57.733 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:28:57.733 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:28:57.733 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:28:57.733 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:28:57.733 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:28:57.733 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:28:57.733 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:28:57.733 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:28:57.733 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:28:57.734 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:28:57.734 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:28:57.734 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:28:57.734 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:28:57.734 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:57.734 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:28:57.734 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:28:57.734 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:28:57.734 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:28:57.734 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:28:57.734 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:28:57.734 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:28:57.735 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:28:57.735 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:28:57.735 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:28:57.735 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:28:57.735 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:28:57.735 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:28:57.735 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:28:57.735 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:28:57.735 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:28:57.735 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:28:57.735 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:28:57.735 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:28:57.735 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:28:57.735 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:28:57.736 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:28:57.736 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:28:57.736 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:28:57.736 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:28:57.736 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:28:57.736 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:28:57.736 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:28:57.736 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:28:57.736 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:28:57.736 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:57.736 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:28:57.736 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:57.736 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:28:57.737 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:28:57.737 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:28:57.737 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:28:57.737 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:57.737 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:28:57.737 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:28:57.737 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:28:57.737 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:57.737 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:57.737 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:28:57.737 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:28:57.737 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:28:57.737 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:28:57.737 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:28:57.738 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:57.738 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:28:57.738 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:28:57.738 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:28:57.738 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:28:57.738 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:28:57.738 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:57.738 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:57.738 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:28:57.738 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:28:57.738 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:28:57.738 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:28:57.739 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:57.739 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:28:57.739 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:28:57.739 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:28:57.739 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:57.739 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:57.739 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:28:57.739 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:28:57.739 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:28:57.739 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:28:57.739 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:28:57.739 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:57.739 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:28:57.739 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:28:57.740 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:28:57.740 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:28:57.740 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:28:57.740 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:57.740 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:57.740 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:28:57.740 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:28:57.740 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:28:57.740 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:28:57.740 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:57.740 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:28:57.740 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:28:57.740 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:28:57.741 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:57.741 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:57.741 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:28:57.741 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:28:57.741 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:28:57.741 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:28:57.741 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:28:57.741 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:57.741 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:28:57.741 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:28:57.741 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:28:57.741 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:28:57.741 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:28:57.742 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:28:57.742 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:28:57.742 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:57.742 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:28:57.742 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:28:57.742 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:57.742 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:28:57.742 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:28:57.742 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:28:57.742 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:28:57.742 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:28:57.742 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:28:57.742 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:57.743 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:28:57.743 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:28:57.743 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:28:57.743 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:28:57.743 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:28:57.743 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:57.743 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:28:57.743 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:28:57.746 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:28:57.746 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:28:57.746 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:28:57.950 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:28:57.950 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:28:57.950 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:28:57.950 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:28:57.950 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 160, 2024-08-24T21:28:57.950 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 131600, 2024-08-24T21:28:57.950 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:28:57.951 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:28:57.951 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:28:57.951 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:28:57.951 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:28:57.951 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 3, 2024-08-24T21:28:57.951 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:28:57.951 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:28:57.951 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:28:57.951 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:28:57.951 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:28:57.951 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:28:57.951 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:28:57.952 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:28:57.952 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:28:57.952 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:28:57.952 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:28:57.952 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:28:57.952 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:28:57.952 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:28:57.952 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:28:57.952 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:28:57.952 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:28:57.952 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:28:57.952 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:28:57.953 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:28:57.953 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:28:57.953 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:28:57.953 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:28:57.953 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:28:57.953 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:28:57.953 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:28:57.953 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:28:57.953 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:28:57.953 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:28:57.953 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:57.953 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:28:57.953 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:28:57.953 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:28:57.954 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:28:57.954 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:28:57.954 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:28:57.954 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:28:57.954 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:28:57.954 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:28:57.954 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:28:57.954 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:28:57.954 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:28:57.954 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:28:57.954 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:28:57.954 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:28:57.955 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:28:57.955 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:28:57.955 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:28:57.955 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:28:57.955 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:28:57.955 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:28:57.955 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:28:57.955 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:28:57.955 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:28:57.955 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:28:57.955 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:28:57.955 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:28:57.956 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:28:57.956 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:28:57.956 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:28:57.956 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:57.956 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:28:57.956 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:57.956 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:28:57.956 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:28:57.956 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:28:57.956 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:28:57.956 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:57.956 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:28:57.956 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:28:57.956 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:28:57.956 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:57.957 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:57.957 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:28:57.957 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:28:57.957 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:28:57.957 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:28:57.957 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:28:57.957 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:57.957 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:28:57.957 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:28:57.957 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:28:57.957 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:28:57.957 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:28:57.957 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:57.957 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:57.958 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:28:57.958 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:28:57.958 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:28:57.958 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:28:57.958 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:57.958 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:28:57.958 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:28:57.958 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:28:57.958 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:57.958 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:57.958 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:28:57.958 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:28:57.959 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:28:57.959 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:28:57.959 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:28:57.959 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:57.959 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:28:57.959 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:28:57.959 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:28:57.959 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:28:57.959 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:28:57.959 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:57.959 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:57.959 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:28:57.959 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:28:57.960 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:28:57.960 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:28:57.960 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:57.960 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:28:57.960 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:28:57.960 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:28:57.960 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:57.960 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:57.960 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:28:57.960 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:28:57.960 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:28:57.960 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:28:57.960 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:28:57.961 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:57.961 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:28:57.961 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:28:57.961 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:28:57.961 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:28:57.961 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:28:57.961 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:28:57.961 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:28:57.961 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:57.961 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:28:57.961 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:28:57.961 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:57.961 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:28:57.961 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:28:57.962 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:28:57.962 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:28:57.962 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:28:57.962 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:28:57.962 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:57.962 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:28:57.962 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:28:57.962 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:28:57.962 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:28:57.962 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:28:57.962 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:28:57.962 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:57.962 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:28:57.963 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:28:57.963 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:28:57.963 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:28:57.963 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:28:57.963 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:28:57.963 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:28:57.963 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:28:57.963 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:28:57.963 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:28:57.963 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:28:57.963 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:28:57.963 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:28:57.963 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:28:57.964 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:28:57.967 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:28:57.967 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-08-24T21:28:57.967 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-08-24T21:28:57.967 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-08-24T21:28:57.967 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-08-24T21:28:57.967 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-08-24T21:28:57.968 INFO:teuthology.orchestra.run:waiting for 300 2024-08-24T21:28:57.996 INFO:tasks.ceph.mon.a:Stopped 2024-08-24T21:28:57.996 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-08-24T21:28:57.996 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:28:58.479 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":160,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:29:00.578 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:29:00.642 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=c30835a6bf38bdc2fcaf859e5ff15a3f 2024-08-24T21:29:00.643 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap33 - 2024-08-24T21:29:00.644 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:29:00.644 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:29:01.497 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:29:01.963 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":160,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:29:04.984 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:29:05.443 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":160,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:29:06.002 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:29:06.012 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=c30835a6bf38bdc2fcaf859e5ff15a3f 2024-08-24T21:29:06.013 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ c30835a6bf38bdc2fcaf859e5ff15a3f != \c\3\0\8\3\5\a\6\b\f\3\8\b\d\c\2\f\c\a\f\8\5\9\e\5\f\f\1\5\a\3\f ]] 2024-08-24T21:29:06.013 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap33 2024-08-24T21:29:06.013 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap33 2024-08-24T21:29:06.013 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap33 2024-08-24T21:29:06.119 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:29:06.131 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:29:06.133 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap33 2024-08-24T21:29:06.133 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:29:06.208 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:29:06.208 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:29:06.208 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:29:06.208 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:29:06.208 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:29:06.208 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap34.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:29:08.464 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:29:12.436 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 50% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2024-08-24T21:29:12.457 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap34 - 2024-08-24T21:29:12.457 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:29:12.458 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:29:12.672 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":162,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:29:12.692 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-08-24T21:29:12.692 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-08-24T21:29:12.692 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:29:12.873 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:29:12.873 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:29:12.873 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:29:12.873 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:29:12.873 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 162, 2024-08-24T21:29:12.873 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 33401, 2024-08-24T21:29:12.873 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:29:12.873 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:29:12.873 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:29:12.873 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:29:12.874 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:29:12.874 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:29:12.874 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:29:12.874 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:29:12.874 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:29:12.874 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:29:12.874 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:29:12.874 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:29:12.874 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:29:12.874 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:29:12.874 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:29:12.874 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:29:12.875 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:29:12.875 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:29:12.875 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:29:12.875 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:29:12.875 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:29:12.875 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:29:12.875 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:29:12.875 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:29:12.875 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:29:12.875 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:29:12.875 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:29:12.875 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:29:12.875 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:29:12.876 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:29:12.876 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:29:12.876 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:29:12.876 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:29:12.876 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:29:12.876 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:12.876 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:29:12.876 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:29:12.876 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:29:12.876 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:29:12.876 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:29:12.876 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:29:12.877 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:29:12.877 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:29:12.877 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:29:12.877 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:29:12.877 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:29:12.877 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:29:12.877 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:29:12.877 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:29:12.878 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:29:12.878 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:29:12.878 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:29:12.878 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:29:12.878 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:29:12.878 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:29:12.878 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:29:12.878 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:29:12.878 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:29:12.878 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:29:12.878 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:29:12.878 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:29:12.879 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:29:12.879 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:29:12.879 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:29:12.879 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:29:12.879 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:12.879 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:29:12.879 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:12.879 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:29:12.879 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:29:12.879 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:29:12.880 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:29:12.880 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:12.880 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:29:12.880 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:29:12.880 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:29:12.880 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:12.880 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:12.880 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:29:12.880 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:29:12.880 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:29:12.880 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:29:12.880 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:29:12.880 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:12.881 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:29:12.881 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:29:12.881 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:29:12.881 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:29:12.881 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:29:12.881 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:12.882 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:12.882 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:29:12.882 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:29:12.882 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:29:12.882 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:29:12.882 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:12.882 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:29:12.882 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:29:12.882 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:29:12.882 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:12.882 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:12.882 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:29:12.882 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:29:12.883 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:29:12.883 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:29:12.883 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:29:12.883 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:12.883 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:29:12.883 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:29:12.883 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:29:12.883 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:29:12.883 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:29:12.883 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:12.883 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:12.883 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:29:12.883 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:29:12.884 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:29:12.884 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:29:12.884 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:12.884 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:29:12.884 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:29:12.884 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:29:12.884 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:12.884 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:12.884 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:29:12.884 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:29:12.884 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:29:12.885 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:29:12.885 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:29:12.885 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:12.885 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:29:12.885 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:29:12.885 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:29:12.885 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:29:12.885 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:29:12.885 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:29:12.885 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:29:12.885 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:12.885 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:29:12.886 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:29:12.886 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:12.886 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:29:12.886 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:29:12.887 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:29:12.887 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:29:12.887 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:29:12.887 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:29:12.888 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:12.888 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:29:12.888 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:29:12.888 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:29:12.888 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:29:12.888 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:29:12.888 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:29:12.888 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:12.888 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:29:12.888 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:29:12.888 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:29:12.889 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:29:12.889 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:29:12.889 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:29:12.889 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:12.889 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:29:12.889 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:29:12.889 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:29:12.889 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:29:12.889 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:29:12.889 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:12.889 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:29:12.889 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:29:12.891 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:29:12.891 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-08-24T21:29:12.891 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:29:13.068 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:29:13.069 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:29:13.069 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:29:13.069 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:29:13.069 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 162, 2024-08-24T21:29:13.069 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 146719, 2024-08-24T21:29:13.069 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:29:13.069 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:29:13.069 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:29:13.069 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:29:13.069 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:29:13.069 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:29:13.070 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:29:13.070 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:29:13.070 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:29:13.070 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:29:13.070 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:29:13.070 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:29:13.070 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:29:13.070 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:29:13.070 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:29:13.070 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:29:13.070 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:29:13.070 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:29:13.071 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:29:13.071 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:29:13.071 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:29:13.071 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:29:13.071 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:29:13.071 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:29:13.071 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:29:13.071 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:29:13.071 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:29:13.071 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:29:13.071 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:29:13.071 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:29:13.072 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:29:13.072 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:29:13.072 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:29:13.072 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:29:13.072 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:13.072 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:29:13.072 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:29:13.072 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:29:13.072 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:29:13.072 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:29:13.072 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:29:13.072 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:29:13.073 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:29:13.073 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:29:13.073 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:29:13.073 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:29:13.073 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:29:13.073 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:29:13.073 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:29:13.073 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:29:13.073 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:29:13.073 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:29:13.073 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:29:13.073 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:29:13.073 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:29:13.074 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:29:13.074 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:29:13.074 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:29:13.074 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:29:13.074 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:29:13.074 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:29:13.074 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:29:13.074 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:29:13.074 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:29:13.074 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:29:13.074 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:13.074 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:29:13.075 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:13.075 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:29:13.075 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:29:13.075 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:29:13.075 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:29:13.075 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:13.075 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:29:13.075 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:29:13.075 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:29:13.075 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:13.075 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:13.075 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:29:13.076 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:29:13.076 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:29:13.076 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:29:13.076 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:29:13.076 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:13.076 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:29:13.076 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:29:13.076 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:29:13.076 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:29:13.076 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:29:13.076 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:13.076 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:13.076 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:29:13.077 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:29:13.077 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:29:13.077 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:29:13.077 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:13.077 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:29:13.077 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:29:13.077 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:29:13.077 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:13.077 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:13.078 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:29:13.078 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:29:13.078 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:29:13.078 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:29:13.078 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:29:13.078 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:13.078 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:29:13.078 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:29:13.079 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:29:13.079 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:29:13.079 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:29:13.079 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:13.079 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:13.079 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:29:13.079 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:29:13.079 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:29:13.079 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:29:13.079 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:13.080 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:29:13.080 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:29:13.080 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:29:13.080 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:13.080 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:13.080 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:29:13.080 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:29:13.080 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:29:13.080 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:29:13.080 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:29:13.080 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:13.080 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:29:13.080 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:29:13.081 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:29:13.081 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:29:13.081 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:29:13.081 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:29:13.081 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:29:13.081 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:13.081 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:29:13.081 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:29:13.081 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:13.081 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:29:13.081 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:29:13.081 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:29:13.081 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:29:13.082 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:29:13.082 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:29:13.082 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:13.082 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:29:13.082 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:29:13.082 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:29:13.082 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:29:13.082 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:29:13.082 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:29:13.082 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:13.082 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:29:13.082 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:29:13.083 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:29:13.083 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:29:13.083 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:29:13.083 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:29:13.083 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:13.083 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:29:13.083 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:29:13.083 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:29:13.083 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:29:13.083 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:29:13.083 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:13.083 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:29:13.084 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:29:13.085 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:29:13.085 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-08-24T21:29:17.628 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:29:17.694 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=5f87bd885c5d98bb94b9fb5475d2f767 2024-08-24T21:29:17.695 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap34 - 2024-08-24T21:29:17.695 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:29:17.695 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:29:23.152 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:29:23.162 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=5f87bd885c5d98bb94b9fb5475d2f767 2024-08-24T21:29:23.162 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ 5f87bd885c5d98bb94b9fb5475d2f767 != \5\f\8\7\b\d\8\8\5\c\5\d\9\8\b\b\9\4\b\9\f\b\5\4\7\5\d\2\f\7\6\7 ]] 2024-08-24T21:29:23.162 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap34 2024-08-24T21:29:23.163 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap34 2024-08-24T21:29:23.163 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap34 2024-08-24T21:29:23.270 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:29:23.282 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:29:23.283 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap34 2024-08-24T21:29:23.284 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:29:23.364 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:29:23.364 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:29:23.364 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:29:23.364 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:29:23.364 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:29:23.365 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap35.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:29:24.462 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 46% complete... Importing image diff: 47% complete... Importing image diff: 48% complete... Importing image diff: 94% complete... Importing image diff: 95% complete... Importing image diff: 96% complete... Importing image diff: 97% complete... Importing image diff: 98% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2024-08-24T21:29:24.481 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap35 - 2024-08-24T21:29:24.481 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:29:24.482 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:29:29.622 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:29:29.696 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=15636e2087b068ac01ba00eaab21c84a 2024-08-24T21:29:29.697 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap35 - 2024-08-24T21:29:29.698 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:29:29.698 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:29:33.085 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-08-24T21:29:33.086 INFO:tasks.ceph.mon.a:Restarting daemon 2024-08-24T21:29:33.086 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-08-24T21:29:33.090 INFO:tasks.ceph.mon.a:Started 2024-08-24T21:29:33.090 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:29:33.091 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:29:33.558 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":162,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":21,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:29:35.204 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:29:35.215 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=15636e2087b068ac01ba00eaab21c84a 2024-08-24T21:29:35.215 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ 15636e2087b068ac01ba00eaab21c84a != \1\5\6\3\6\e\2\0\8\7\b\0\6\8\a\c\0\1\b\a\0\0\e\a\a\b\2\1\c\8\4\a ]] 2024-08-24T21:29:35.215 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap35 2024-08-24T21:29:35.215 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap35 2024-08-24T21:29:35.215 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap35 2024-08-24T21:29:35.324 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:29:35.335 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:29:35.337 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap35 2024-08-24T21:29:35.337 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:29:35.422 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:29:35.423 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:29:35.423 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:29:35.423 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:29:35.423 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:29:35.423 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap36.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:29:36.578 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:29:37.460 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":162,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":25,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:29:38.505 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 6% complete... Importing image diff: 12% complete... Importing image diff: 18% complete... Importing image diff: 24% complete... Importing image diff: 30% complete... Importing image diff: 36% complete... Importing image diff: 42% complete... Importing image diff: 48% complete... Importing image diff: 54% complete... Importing image diff: 60% complete... Importing image diff: 66% complete... Importing image diff: 72% complete... Importing image diff: 78% complete... Importing image diff: 84% complete... Importing image diff: 90% complete... Importing image diff: 91% complete... Importing image diff: 92% complete... Importing image diff: 93% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2024-08-24T21:29:38.527 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap36 - 2024-08-24T21:29:38.527 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:29:38.527 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:29:40.492 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:29:43.751 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:29:43.838 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=de76d122c80f093c4f9963f3e2d6682a 2024-08-24T21:29:43.839 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap36 - 2024-08-24T21:29:43.840 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:29:43.840 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:29:44.779 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":166,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:29:47.799 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:29:48.265 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":170,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:29:48.285 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:29:48.285 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:29:48.285 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:29:48.472 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:29:48.473 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:29:48.473 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:29:48.473 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:29:48.473 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 170, 2024-08-24T21:29:48.474 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 15236, 2024-08-24T21:29:48.474 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:29:48.474 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:29:48.474 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:29:48.474 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:29:48.474 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:29:48.474 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 2, 2024-08-24T21:29:48.474 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:29:48.474 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:29:48.475 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:29:48.475 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:29:48.475 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:29:48.475 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:29:48.475 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:29:48.475 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:29:48.475 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:29:48.475 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:29:48.475 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:29:48.475 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:29:48.475 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:29:48.475 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:29:48.475 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:29:48.476 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:29:48.476 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:29:48.476 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:29:48.476 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:29:48.476 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:29:48.476 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:29:48.476 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:29:48.476 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:29:48.476 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:29:48.476 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:29:48.476 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:29:48.476 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:29:48.476 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:29:48.476 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:29:48.477 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:48.477 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:29:48.477 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:29:48.477 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:29:48.477 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:29:48.477 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:29:48.477 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:29:48.477 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:29:48.477 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:29:48.477 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:29:48.477 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:29:48.477 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:29:48.478 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:29:48.478 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:29:48.478 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:29:48.478 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:29:48.478 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:29:48.478 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:29:48.478 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:29:48.478 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:29:48.478 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:29:48.479 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:29:48.479 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:29:48.479 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:29:48.479 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:29:48.479 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:29:48.479 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:29:48.479 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:29:48.479 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:29:48.479 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:29:48.479 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:29:48.479 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:48.480 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:29:48.480 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:48.480 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:29:48.480 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:29:48.480 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:29:48.480 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:29:48.480 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:48.480 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:29:48.480 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:29:48.480 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:29:48.480 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:48.481 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:48.481 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:29:48.481 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:29:48.481 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:29:48.481 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:29:48.481 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:29:48.481 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:48.481 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:29:48.481 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:29:48.481 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:29:48.482 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:29:48.482 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:29:48.482 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:48.482 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:48.482 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:29:48.482 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:29:48.482 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:29:48.482 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:29:48.482 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:48.482 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:29:48.482 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:29:48.482 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:29:48.482 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:48.483 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:48.483 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:29:48.483 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:29:48.483 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:29:48.483 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:29:48.483 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:29:48.483 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:48.483 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:29:48.483 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:29:48.483 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:29:48.483 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:29:48.484 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:29:48.484 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:48.484 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:48.484 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:29:48.484 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:29:48.484 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:29:48.484 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:29:48.484 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:48.484 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:29:48.484 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:29:48.484 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:29:48.484 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:48.484 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:48.485 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:29:48.485 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:29:48.485 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:29:48.485 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:29:48.485 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:29:48.485 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:48.485 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:29:48.485 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:29:48.485 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:29:48.485 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:29:48.485 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:29:48.485 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:29:48.486 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:29:48.486 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:48.486 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:29:48.486 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:29:48.486 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:48.486 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:29:48.486 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:29:48.486 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:29:48.486 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:29:48.486 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:29:48.486 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:29:48.487 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:48.487 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:29:48.487 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:29:48.487 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:29:48.487 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:29:48.487 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:29:48.487 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:48.487 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:29:48.487 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:29:48.488 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:29:48.488 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:29:48.489 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:29:48.675 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:29:48.675 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:29:48.675 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:29:48.675 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:29:48.675 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 170, 2024-08-24T21:29:48.676 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 69203, 2024-08-24T21:29:48.676 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:29:48.676 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:29:48.676 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:29:48.676 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:29:48.676 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:29:48.676 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 2, 2024-08-24T21:29:48.676 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:29:48.676 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:29:48.676 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:29:48.676 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:29:48.676 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:29:48.677 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:29:48.677 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:29:48.677 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:29:48.677 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:29:48.677 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:29:48.677 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:29:48.677 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:29:48.677 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:29:48.677 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:29:48.677 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:29:48.677 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:29:48.677 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:29:48.678 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:29:48.678 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:29:48.678 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:29:48.678 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:29:48.678 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:29:48.678 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:29:48.678 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:29:48.678 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:29:48.678 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:29:48.678 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:29:48.678 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:29:48.678 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:29:48.679 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:48.679 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:29:48.679 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:29:48.679 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:29:48.679 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:29:48.679 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:29:48.679 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:29:48.679 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:29:48.679 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:29:48.679 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:29:48.679 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:29:48.680 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:29:48.680 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:29:48.680 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:29:48.680 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:29:48.680 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:29:48.680 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:29:48.680 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:29:48.680 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:29:48.680 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:29:48.680 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:29:48.680 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:29:48.680 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:29:48.681 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:29:48.681 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:29:48.681 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:29:48.681 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:29:48.681 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:29:48.681 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:29:48.681 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:29:48.681 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:29:48.681 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:48.681 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:29:48.681 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:48.681 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:29:48.682 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:29:48.682 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:29:48.682 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:29:48.682 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:48.682 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:29:48.682 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:29:48.682 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:29:48.682 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:48.682 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:48.682 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:29:48.683 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:29:48.683 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:29:48.683 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:29:48.683 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:29:48.683 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:48.683 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:29:48.683 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:29:48.683 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:29:48.683 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:29:48.684 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:29:48.684 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:48.684 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:48.684 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:29:48.684 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:29:48.684 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:29:48.684 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:29:48.684 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:48.684 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:29:48.684 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:29:48.684 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:29:48.685 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:48.685 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:48.685 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:29:48.685 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:29:48.685 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:29:48.685 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:29:48.685 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:29:48.685 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:48.685 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:29:48.685 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:29:48.686 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:29:48.686 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:29:48.686 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:29:48.686 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:48.686 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:48.686 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:29:48.686 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:29:48.686 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:29:48.686 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:29:48.687 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:48.687 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:29:48.687 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:29:48.687 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:29:48.687 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:48.687 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:48.687 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:29:48.687 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:29:48.687 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:29:48.687 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:29:48.688 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:29:48.688 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:48.688 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:29:48.688 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:29:48.688 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:29:48.688 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:29:48.688 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:29:48.688 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:29:48.688 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:29:48.689 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:48.689 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:29:48.689 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:29:48.689 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:48.689 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:29:48.689 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:29:48.689 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:29:48.689 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:29:48.689 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:29:48.690 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:29:48.690 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:48.690 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:29:48.690 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:29:48.690 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:29:48.690 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:29:48.690 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:29:48.690 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:29:48.691 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:48.691 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:29:48.691 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:29:48.691 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:29:48.691 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:29:48.691 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:29:48.691 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:29:48.691 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:48.691 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:29:48.691 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:29:48.691 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:29:48.692 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:29:48.692 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:29:48.692 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:48.692 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:29:48.692 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:29:48.693 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:29:48.694 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:29:48.694 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:29:48.878 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:29:48.878 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:29:48.878 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:29:48.879 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:29:48.879 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 170, 2024-08-24T21:29:48.879 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 182529, 2024-08-24T21:29:48.879 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:29:48.879 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:29:48.879 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:29:48.879 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:29:48.879 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:29:48.879 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 3, 2024-08-24T21:29:48.879 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:29:48.879 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:29:48.879 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:29:48.880 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:29:48.880 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:29:48.880 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:29:48.880 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:29:48.880 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:29:48.880 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:29:48.880 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:29:48.880 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:29:48.880 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:29:48.880 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:29:48.880 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:29:48.880 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:29:48.881 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:29:48.881 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:29:48.881 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:29:48.881 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:29:48.881 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:29:48.881 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:29:48.881 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:29:48.881 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:29:48.881 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:29:48.881 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:29:48.881 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:29:48.881 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:29:48.881 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:29:48.882 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:29:48.882 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:48.882 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:29:48.882 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:29:48.882 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:29:48.882 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:29:48.882 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:29:48.882 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:29:48.882 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:29:48.882 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:29:48.882 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:29:48.882 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:29:48.883 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:29:48.883 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:29:48.883 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:29:48.883 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:29:48.883 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:29:48.883 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:29:48.883 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:29:48.883 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:29:48.883 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:29:48.883 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:29:48.883 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:29:48.883 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:29:48.883 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:29:48.884 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:29:48.884 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:29:48.884 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:29:48.884 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:29:48.884 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:29:48.884 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:29:48.884 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:29:48.884 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:48.884 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:29:48.884 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:48.884 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:29:48.884 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:29:48.885 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:29:48.885 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:29:48.885 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:48.885 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:29:48.885 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:29:48.885 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:29:48.885 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:48.885 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:48.885 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:29:48.886 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:29:48.886 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:29:48.886 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:29:48.886 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:29:48.886 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:48.886 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:29:48.886 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:29:48.886 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:29:48.886 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:29:48.886 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:29:48.886 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:48.886 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:48.887 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:29:48.887 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:29:48.887 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:29:48.887 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:29:48.887 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:48.887 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:29:48.887 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:29:48.887 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:29:48.887 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:48.888 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:48.888 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:29:48.888 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:29:48.888 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:29:48.888 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:29:48.888 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:29:48.888 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:48.888 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:29:48.888 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:29:48.888 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:29:48.888 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:29:48.888 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:29:48.888 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:48.889 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:48.889 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:29:48.889 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:29:48.889 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:29:48.889 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:29:48.889 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:48.889 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:29:48.889 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:29:48.890 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:29:48.890 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:48.890 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:48.890 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:29:48.890 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:29:48.890 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:29:48.890 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:29:48.890 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:29:48.890 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:48.890 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:29:48.890 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:29:48.891 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:29:48.891 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:29:48.891 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:29:48.891 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:29:48.891 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:29:48.891 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:48.891 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:29:48.891 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:29:48.891 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:48.892 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:29:48.892 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:29:48.892 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:29:48.892 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:29:48.892 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:29:48.892 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:29:48.892 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:48.892 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:29:48.892 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:29:48.892 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:29:48.892 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:29:48.893 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:29:48.893 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:29:48.893 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:48.893 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:29:48.893 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:29:48.893 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 6 2024-08-24T21:29:48.893 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:29:48.893 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:29:48.893 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:29:48.893 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:48.893 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:29:48.894 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:29:48.894 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:29:48.894 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:29:48.894 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:29:48.894 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:48.894 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:29:48.894 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:29:48.895 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:29:48.895 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-08-24T21:29:48.895 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-08-24T21:29:49.393 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-08-24T21:29:49.887 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:29:49.899 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=de76d122c80f093c4f9963f3e2d6682a 2024-08-24T21:29:49.899 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ de76d122c80f093c4f9963f3e2d6682a != \d\e\7\6\d\1\2\2\c\8\0\f\0\9\3\c\4\f\9\9\6\3\f\3\e\2\d\6\6\8\2\a ]] 2024-08-24T21:29:49.899 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap36 2024-08-24T21:29:49.899 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap36 2024-08-24T21:29:49.899 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap36 2024-08-24T21:29:50.016 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:29:50.028 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:29:50.029 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap36 2024-08-24T21:29:50.029 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:29:50.107 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:29:50.107 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:29:50.107 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:29:50.107 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:29:50.107 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:29:50.107 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap37.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:29:50.394 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:29:50.395 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:29:50.948 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 23% complete... Importing image diff: 47% complete... Importing image diff: 48% complete... Importing image diff: 49% complete... Importing image diff: 50% complete... Importing image diff: 73% complete... Importing image diff: 74% complete... Importing image diff: 75% complete... Importing image diff: 76% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2024-08-24T21:29:50.966 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap37 - 2024-08-24T21:29:50.967 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:29:50.967 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:29:51.017 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":170,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:29:51.036 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:29:51.036 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-08-24T21:29:51.036 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:29:51.036 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:29:51.232 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:29:51.232 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:29:51.233 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:29:51.233 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:29:51.233 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 170, 2024-08-24T21:29:51.233 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 17996, 2024-08-24T21:29:51.233 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:29:51.233 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:29:51.233 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:29:51.233 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:29:51.233 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:29:51.233 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 5, 2024-08-24T21:29:51.233 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:29:51.233 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:29:51.234 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:29:51.234 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:29:51.234 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:29:51.234 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:29:51.234 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:29:51.234 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:29:51.234 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:29:51.234 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:29:51.234 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:29:51.234 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:29:51.234 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:29:51.234 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:29:51.235 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:29:51.235 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:29:51.235 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:29:51.235 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:29:51.235 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:29:51.235 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:29:51.235 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:29:51.235 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:29:51.235 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:29:51.235 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:29:51.235 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:29:51.236 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:29:51.236 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:29:51.236 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:29:51.236 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:29:51.236 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:51.236 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:29:51.236 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:29:51.236 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:29:51.236 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:29:51.236 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:29:51.236 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:29:51.236 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:29:51.237 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:29:51.237 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:29:51.237 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:29:51.237 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:29:51.237 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:29:51.237 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:29:51.237 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:29:51.237 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:29:51.237 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:29:51.237 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:29:51.237 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:29:51.237 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:29:51.238 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:29:51.238 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:29:51.238 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:29:51.238 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:29:51.238 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:29:51.238 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:29:51.238 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:29:51.238 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:29:51.238 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:29:51.238 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:29:51.238 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:29:51.238 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:51.238 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:29:51.239 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:51.239 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:29:51.239 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:29:51.239 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:29:51.239 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:29:51.239 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:51.239 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:29:51.239 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:29:51.239 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:29:51.239 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:51.239 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:51.239 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:29:51.239 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:29:51.240 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:29:51.240 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:29:51.240 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:29:51.240 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:51.240 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:29:51.240 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:29:51.240 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:29:51.240 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:29:51.240 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:29:51.240 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:51.240 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:51.240 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:29:51.240 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:29:51.241 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:29:51.241 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:29:51.241 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:51.241 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:29:51.241 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:29:51.241 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:29:51.241 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:51.241 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:51.241 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:29:51.241 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:29:51.241 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:29:51.241 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:29:51.242 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:29:51.242 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:51.242 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:29:51.242 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:29:51.242 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:29:51.242 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:29:51.242 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:29:51.242 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:51.242 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:51.242 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:29:51.242 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:29:51.242 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:29:51.242 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:29:51.243 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:51.243 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:29:51.243 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:29:51.243 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:29:51.243 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:51.243 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:51.243 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:29:51.243 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:29:51.243 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:29:51.243 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:29:51.243 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:29:51.243 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:51.244 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:29:51.244 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:29:51.244 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:29:51.244 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:29:51.244 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:29:51.244 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:29:51.244 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:29:51.244 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:51.244 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:29:51.244 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:29:51.244 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:51.244 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:29:51.245 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:29:51.245 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:29:51.245 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:29:51.245 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:29:51.245 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:29:51.245 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:51.245 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:29:51.245 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:29:51.245 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:29:51.245 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:29:51.245 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:29:51.245 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:51.245 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:29:51.246 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:29:51.247 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:29:51.247 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:29:51.247 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:29:51.423 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:29:51.423 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:29:51.423 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:29:51.423 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:29:51.423 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 170, 2024-08-24T21:29:51.423 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 71951, 2024-08-24T21:29:51.423 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:29:51.423 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:29:51.423 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:29:51.423 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:29:51.424 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:29:51.424 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 5, 2024-08-24T21:29:51.424 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:29:51.424 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:29:51.424 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:29:51.424 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:29:51.424 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:29:51.424 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:29:51.424 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:29:51.424 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:29:51.424 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:29:51.424 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:29:51.425 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:29:51.425 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:29:51.425 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:29:51.425 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:29:51.425 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:29:51.425 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:29:51.425 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:29:51.425 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:29:51.425 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:29:51.425 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:29:51.425 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:29:51.425 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:29:51.425 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:29:51.425 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:29:51.426 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:29:51.426 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:29:51.426 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:29:51.426 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:29:51.426 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:29:51.426 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:51.426 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:29:51.426 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:29:51.426 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:29:51.426 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:29:51.426 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:29:51.427 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:29:51.427 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:29:51.427 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:29:51.427 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:29:51.427 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:29:51.427 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:29:51.427 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:29:51.427 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:29:51.427 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:29:51.427 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:29:51.428 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:29:51.428 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:29:51.428 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:29:51.428 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:29:51.428 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:29:51.428 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:29:51.428 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:29:51.428 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:29:51.428 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:29:51.428 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:29:51.428 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:29:51.429 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:29:51.429 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:29:51.429 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:29:51.429 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:29:51.429 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:51.429 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:29:51.429 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:51.429 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:29:51.429 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:29:51.429 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:29:51.429 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:29:51.429 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:51.429 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:29:51.429 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:29:51.430 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:29:51.430 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:51.430 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:51.430 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:29:51.430 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:29:51.430 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:29:51.430 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:29:51.430 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:29:51.430 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:51.430 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:29:51.430 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:29:51.430 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:29:51.431 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:29:51.431 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:29:51.431 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:51.431 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:51.431 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:29:51.431 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:29:51.431 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:29:51.431 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:29:51.431 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:51.431 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:29:51.431 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:29:51.431 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:29:51.431 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:51.432 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:51.432 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:29:51.432 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:29:51.432 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:29:51.432 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:29:51.432 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:29:51.432 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:51.432 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:29:51.432 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:29:51.433 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:29:51.433 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:29:51.433 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:29:51.433 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:51.433 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:51.433 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:29:51.433 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:29:51.433 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:29:51.433 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:29:51.433 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:51.433 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:29:51.433 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:29:51.433 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:29:51.434 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:51.434 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:51.434 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:29:51.434 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:29:51.434 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:29:51.434 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:29:51.434 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:29:51.434 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:51.434 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:29:51.434 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:29:51.434 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:29:51.434 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:29:51.434 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:29:51.435 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:29:51.435 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:29:51.435 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:51.435 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:29:51.435 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:29:51.435 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:51.435 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:29:51.435 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:29:51.435 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:29:51.435 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:29:51.435 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:29:51.435 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:29:51.435 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:51.436 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:29:51.436 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:29:51.436 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:29:51.436 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:29:51.436 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:29:51.436 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:29:51.436 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:51.436 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:29:51.436 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:29:51.436 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:29:51.436 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:29:51.436 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:29:51.436 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:29:51.437 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:51.437 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:29:51.437 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:29:51.437 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:29:51.437 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:29:51.437 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:29:51.437 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:51.437 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:29:51.437 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:29:51.438 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:29:51.438 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:29:51.438 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:29:51.616 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:29:51.616 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:29:51.616 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:29:51.617 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:29:51.617 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 170, 2024-08-24T21:29:51.617 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 185266, 2024-08-24T21:29:51.617 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:29:51.617 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:29:51.617 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:29:51.617 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:29:51.617 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:29:51.617 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 5, 2024-08-24T21:29:51.617 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:29:51.617 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:29:51.617 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:29:51.617 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:29:51.618 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:29:51.618 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:29:51.618 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:29:51.618 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:29:51.618 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:29:51.618 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:29:51.618 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:29:51.618 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:29:51.618 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:29:51.618 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:29:51.618 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:29:51.618 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:29:51.619 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:29:51.619 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:29:51.619 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:29:51.619 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:29:51.619 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:29:51.619 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:29:51.619 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:29:51.619 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:29:51.619 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:29:51.619 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:29:51.619 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:29:51.619 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:29:51.619 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:29:51.620 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:51.620 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:29:51.620 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:29:51.620 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:29:51.620 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:29:51.620 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:29:51.620 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:29:51.620 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:29:51.620 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:29:51.620 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:29:51.620 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:29:51.620 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:29:51.620 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:29:51.621 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:29:51.621 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:29:51.621 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:29:51.621 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:29:51.621 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:29:51.621 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:29:51.621 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:29:51.621 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:29:51.621 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:29:51.621 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:29:51.621 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:29:51.621 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:29:51.622 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:29:51.622 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:29:51.622 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:29:51.622 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:29:51.622 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:29:51.622 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:29:51.622 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:51.622 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:29:51.622 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:51.622 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:29:51.622 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:29:51.622 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:29:51.622 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:29:51.623 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:51.623 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:29:51.623 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:29:51.623 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:29:51.623 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:51.623 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:51.623 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:29:51.623 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:29:51.623 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:29:51.623 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:29:51.623 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:29:51.623 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:51.624 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:29:51.624 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:29:51.624 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:29:51.624 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:29:51.624 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:29:51.624 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:51.624 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:51.624 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:29:51.624 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:29:51.624 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:29:51.624 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:29:51.624 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:51.624 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:29:51.625 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:29:51.625 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:29:51.625 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:51.625 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:51.625 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:29:51.625 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:29:51.625 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:29:51.625 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:29:51.625 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:29:51.625 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:51.625 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:29:51.625 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:29:51.625 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:29:51.626 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:29:51.626 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:29:51.626 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:51.626 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:51.626 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:29:51.626 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:29:51.626 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:29:51.626 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:29:51.626 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:51.626 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:29:51.626 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:29:51.626 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:29:51.627 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:51.627 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:51.627 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:29:51.627 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:29:51.627 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:29:51.627 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:29:51.627 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:29:51.627 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:51.627 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:29:51.627 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:29:51.627 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:29:51.627 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:29:51.627 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:29:51.628 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:29:51.628 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:29:51.628 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:51.628 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:29:51.628 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:29:51.628 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:51.628 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:29:51.628 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:29:51.628 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:29:51.628 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:29:51.628 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:29:51.628 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:29:51.628 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:51.629 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:29:51.629 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:29:51.629 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:29:51.629 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:29:51.629 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:29:51.629 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:29:51.629 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:51.629 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:29:51.629 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:29:51.629 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:29:51.629 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:29:51.629 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:29:51.629 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:29:51.630 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:29:51.630 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:29:51.630 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:29:51.630 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:29:51.630 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:29:51.630 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:29:51.630 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:29:51.630 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:29:51.630 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:29:51.631 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:29:51.631 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-08-24T21:29:51.632 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-08-24T21:29:51.632 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-08-24T21:29:51.632 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-08-24T21:29:51.632 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-08-24T21:29:51.632 INFO:teuthology.orchestra.run:waiting for 300 2024-08-24T21:29:51.649 INFO:tasks.ceph.mon.a:Stopped 2024-08-24T21:29:51.649 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-08-24T21:29:51.649 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:29:52.164 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":170,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":6,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:29:55.183 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:29:55.642 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":170,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":9,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:29:56.303 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:29:56.378 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=9331b7d5fcf2bb8389d041f893d172e5 2024-08-24T21:29:56.379 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap37 - 2024-08-24T21:29:56.379 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:29:56.379 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:29:58.661 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:30:01.771 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:30:01.782 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=9331b7d5fcf2bb8389d041f893d172e5 2024-08-24T21:30:01.782 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ 9331b7d5fcf2bb8389d041f893d172e5 != \9\3\3\1\b\7\d\5\f\c\f\2\b\b\8\3\8\9\d\0\4\1\f\8\9\3\d\1\7\2\e\5 ]] 2024-08-24T21:30:01.782 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap37 2024-08-24T21:30:01.782 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap37 2024-08-24T21:30:01.782 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap37 2024-08-24T21:30:06.241 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":172,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:30:06.262 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-08-24T21:30:06.263 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-08-24T21:30:06.263 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:30:06.306 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:30:06.319 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:30:06.320 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap37 2024-08-24T21:30:06.320 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:30:06.401 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:30:06.401 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:30:06.401 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:30:06.401 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:30:06.402 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:30:06.402 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap38.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:30:06.452 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:30:06.452 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:30:06.452 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:30:06.452 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:30:06.453 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 172, 2024-08-24T21:30:06.453 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 86982, 2024-08-24T21:30:06.453 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:30:06.453 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:30:06.453 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:30:06.453 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:30:06.453 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:30:06.453 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:30:06.453 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:30:06.453 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:30:06.453 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:30:06.453 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:30:06.454 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:30:06.454 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:30:06.454 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:30:06.454 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:30:06.454 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:30:06.454 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:30:06.454 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:30:06.454 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:30:06.454 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:30:06.454 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:30:06.454 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:30:06.454 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:30:06.455 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:30:06.455 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:30:06.455 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:30:06.455 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:30:06.455 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:30:06.455 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:30:06.455 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:30:06.455 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:30:06.455 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:30:06.455 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:30:06.455 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:30:06.455 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:30:06.456 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:06.456 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:30:06.456 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:30:06.456 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:30:06.456 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:30:06.456 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:30:06.456 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:30:06.456 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:30:06.456 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:30:06.456 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:30:06.456 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:30:06.456 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:30:06.456 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:30:06.457 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:30:06.457 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:30:06.457 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:30:06.457 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:30:06.457 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:30:06.457 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:30:06.457 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:30:06.457 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:30:06.457 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:30:06.457 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:30:06.457 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:30:06.457 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:30:06.458 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:30:06.458 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:30:06.458 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:30:06.458 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:30:06.458 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:30:06.458 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:30:06.458 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:06.458 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:30:06.458 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:06.458 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:30:06.458 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:30:06.458 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:30:06.458 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:30:06.459 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:06.459 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:30:06.459 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:30:06.459 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:30:06.459 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:06.459 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:06.459 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:30:06.459 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:30:06.459 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:30:06.459 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:06.459 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:30:06.459 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:06.459 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:30:06.460 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:30:06.460 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:30:06.460 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:30:06.460 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:30:06.460 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:06.460 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:06.460 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:30:06.460 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:30:06.460 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:30:06.460 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:30:06.460 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:06.460 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:30:06.460 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:30:06.461 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:30:06.461 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:06.461 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:06.461 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:30:06.461 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:30:06.461 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:30:06.461 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:06.461 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:30:06.461 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:06.461 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:30:06.461 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:30:06.461 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:30:06.461 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:30:06.462 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:30:06.462 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:06.462 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:06.462 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:30:06.462 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:30:06.462 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:30:06.462 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:30:06.462 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:06.462 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:30:06.462 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:30:06.462 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:30:06.462 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:06.463 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:06.463 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:30:06.463 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:30:06.463 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:30:06.463 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:06.463 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:30:06.463 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:06.463 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:30:06.463 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:30:06.463 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:30:06.463 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:30:06.463 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:30:06.463 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:06.464 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:30:06.464 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:06.464 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:30:06.464 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:30:06.464 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:06.464 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:30:06.464 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:30:06.464 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:30:06.464 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:06.464 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:30:06.464 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:30:06.464 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:06.464 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:30:06.464 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:30:06.465 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:30:06.465 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:06.465 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:30:06.465 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:30:06.465 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:06.465 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:30:06.465 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:30:06.465 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:30:06.465 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:06.465 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:30:06.465 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:30:06.465 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:06.465 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:30:06.466 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:30:06.466 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:30:06.466 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:06.466 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:30:06.466 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:06.466 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:30:06.466 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:30:06.467 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:30:06.467 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-08-24T21:30:06.467 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:30:06.643 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:30:06.643 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:30:06.643 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:30:06.643 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:30:06.643 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 172, 2024-08-24T21:30:06.644 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 200293, 2024-08-24T21:30:06.644 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:30:06.644 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:30:06.644 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:30:06.644 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:30:06.644 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:30:06.644 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:30:06.644 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:30:06.644 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:30:06.644 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:30:06.645 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:30:06.645 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:30:06.645 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:30:06.645 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:30:06.645 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:30:06.645 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:30:06.645 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:30:06.645 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:30:06.645 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:30:06.646 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:30:06.646 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:30:06.646 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:30:06.646 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:30:06.646 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:30:06.646 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:30:06.646 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:30:06.646 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:30:06.646 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:30:06.647 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:30:06.647 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:30:06.647 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:30:06.647 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:30:06.647 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:30:06.647 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:30:06.647 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:30:06.647 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:06.647 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:30:06.647 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:30:06.647 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:30:06.648 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:30:06.648 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:30:06.648 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:30:06.648 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:30:06.648 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:30:06.648 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:30:06.648 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:30:06.648 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:30:06.648 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:30:06.648 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:30:06.648 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:30:06.649 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:30:06.649 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:30:06.649 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:30:06.649 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:30:06.649 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:30:06.649 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:30:06.649 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:30:06.649 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:30:06.649 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:30:06.649 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:30:06.649 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:30:06.650 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:30:06.650 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:30:06.650 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:30:06.650 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:30:06.650 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:30:06.650 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:06.650 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:30:06.650 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:06.650 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:30:06.650 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:30:06.650 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:30:06.650 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:30:06.651 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:06.651 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:30:06.651 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:30:06.651 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:30:06.651 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:06.651 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:06.651 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:30:06.651 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:30:06.651 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:30:06.651 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:06.651 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:30:06.652 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:06.652 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:30:06.652 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:30:06.652 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:30:06.652 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:30:06.652 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:30:06.652 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:06.652 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:06.652 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:30:06.652 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:30:06.652 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:30:06.652 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:30:06.653 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:06.653 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:30:06.653 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:30:06.653 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:30:06.653 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:06.653 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:06.653 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:30:06.653 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:30:06.653 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:30:06.653 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:06.653 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:30:06.653 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:06.653 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:30:06.654 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:30:06.654 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:30:06.654 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:30:06.654 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:30:06.654 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:06.654 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:06.654 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:30:06.654 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:30:06.654 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:30:06.654 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:30:06.654 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:06.654 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:30:06.654 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:30:06.654 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:30:06.655 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:06.655 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:06.655 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:30:06.655 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:30:06.655 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:30:06.655 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:06.655 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:30:06.655 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:06.655 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:30:06.655 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:30:06.655 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:30:06.655 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:30:06.656 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:30:06.656 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:06.656 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:30:06.656 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:06.656 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:30:06.656 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:30:06.656 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:06.656 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:30:06.656 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:30:06.656 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:30:06.656 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:06.656 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:30:06.656 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:30:06.656 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:06.657 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:30:06.657 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:30:06.657 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:30:06.657 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:06.657 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:30:06.657 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:30:06.657 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:06.657 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:30:06.657 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:30:06.657 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:30:06.657 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:06.657 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:30:06.657 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:30:06.657 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:06.658 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:30:06.658 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:30:06.658 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:30:06.658 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:06.658 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:30:06.658 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:06.658 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:30:06.658 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:30:06.659 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:30:06.659 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-08-24T21:30:07.036 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 52% complete... Importing image diff: 77% complete... Importing image diff: 97% complete... Importing image diff: 100% complete...done. 2024-08-24T21:30:07.057 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap38 - 2024-08-24T21:30:07.058 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:30:07.058 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:30:12.219 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:30:12.287 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=9331b7d5fcf2bb8389d041f893d172e5 2024-08-24T21:30:12.288 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap38 - 2024-08-24T21:30:12.289 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:30:12.289 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:30:17.691 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:30:17.703 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=9331b7d5fcf2bb8389d041f893d172e5 2024-08-24T21:30:17.703 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ 9331b7d5fcf2bb8389d041f893d172e5 != \9\3\3\1\b\7\d\5\f\c\f\2\b\b\8\3\8\9\d\0\4\1\f\8\9\3\d\1\7\2\e\5 ]] 2024-08-24T21:30:17.703 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap38 2024-08-24T21:30:17.704 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap38 2024-08-24T21:30:17.704 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap38 2024-08-24T21:30:17.816 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:30:17.828 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:30:17.830 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap38 2024-08-24T21:30:17.830 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:30:17.907 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:30:17.907 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:30:17.907 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:30:17.907 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:30:17.907 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:30:17.908 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap39.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:30:19.058 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 50% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2024-08-24T21:30:19.077 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap39 - 2024-08-24T21:30:19.077 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:30:19.078 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:30:24.312 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:30:24.375 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=d0b7fdfbeea0ea7909057a138790cf03 2024-08-24T21:30:24.376 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap39 - 2024-08-24T21:30:24.376 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:30:24.377 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:30:26.660 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-08-24T21:30:26.660 INFO:tasks.ceph.mon.a:Restarting daemon 2024-08-24T21:30:26.660 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-08-24T21:30:26.664 INFO:tasks.ceph.mon.a:Started 2024-08-24T21:30:26.665 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:30:26.665 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:30:27.136 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":172,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":21,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:30:29.717 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:30:29.727 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=d0b7fdfbeea0ea7909057a138790cf03 2024-08-24T21:30:29.727 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ d0b7fdfbeea0ea7909057a138790cf03 != \d\0\b\7\f\d\f\b\e\e\a\0\e\a\7\9\0\9\0\5\7\a\1\3\8\7\9\0\c\f\0\3 ]] 2024-08-24T21:30:29.727 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap39 2024-08-24T21:30:29.728 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap39 2024-08-24T21:30:29.728 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap39 2024-08-24T21:30:29.834 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:30:29.846 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:30:29.847 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap39 2024-08-24T21:30:29.847 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:30:29.924 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:30:29.925 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:30:29.925 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:30:29.925 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:30:29.925 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:30:29.925 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap40.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:30:30.156 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:30:30.593 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":172,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":24,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:30:31.081 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 1% complete... Importing image diff: 3% complete... Importing image diff: 4% complete... Importing image diff: 6% complete... Importing image diff: 7% complete... Importing image diff: 9% complete... Importing image diff: 10% complete... Importing image diff: 12% complete... Importing image diff: 14% complete... Importing image diff: 15% complete... Importing image diff: 17% complete... Importing image diff: 18% complete... Importing image diff: 20% complete... Importing image diff: 21% complete... Importing image diff: 23% complete... Importing image diff: 25% complete... Importing image diff: 26% complete... Importing image diff: 28% complete... Importing image diff: 29% complete... Importing image diff: 31% complete... Importing image diff: 32% complete... Importing image diff: 34% complete... Importing image diff: 35% complete... Importing image diff: 37% complete... Importing image diff: 39% complete... Importing image diff: 40% complete... Importing image diff: 42% complete... Importing image diff: 43% complete... Importing image diff: 45% complete... Importing image diff: 46% complete... Importing image diff: 48% complete... Importing image diff: 50% complete... Importing image diff: 51% complete... Importing image diff: 53% complete... Importing image diff: 54% complete... Importing image diff: 56% complete... Importing image diff: 57% complete... Importing image diff: 59% complete... Importing image diff: 60% complete... Importing image diff: 62% complete... Importing image diff: 64% complete... Importing image diff: 65% complete... Importing image diff: 67% complete... Importing image diff: 68% complete... Importing image diff: 70% complete... Importing image diff: 71% complete... Importing image diff: 73% complete... Importing image diff: 75% complete... Importing image diff: 76% complete... Importing image diff: 78% complete... Importing image diff: 79% complete... Importing image diff: 81% complete... Importing image diff: 82% complete... Importing image diff: 84% complete... Importing image diff: 85% complete... Importing image diff: 87% complete... Importing image diff: 89% complete... Importing image diff: 90% complete... Importing image diff: 92% complete... Importing image diff: 93% complete... Importing image diff: 95% complete... Importing image diff: 96% complete... Importing image diff: 98% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2024-08-24T21:30:31.103 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap40 - 2024-08-24T21:30:31.103 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:30:31.104 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:30:33.611 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:30:34.097 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":172,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":28,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:30:36.288 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:30:36.365 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=9c00a8fd5813541b3965b7142ed43fcd 2024-08-24T21:30:36.367 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap40 - 2024-08-24T21:30:36.367 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:30:36.367 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:30:37.117 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:30:37.582 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":172,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":31,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:30:40.601 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:30:41.057 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":176,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:30:41.075 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:30:41.075 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:30:41.075 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:30:41.266 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:30:41.266 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:30:41.266 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:30:41.266 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:30:41.266 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 176, 2024-08-24T21:30:41.266 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 14450, 2024-08-24T21:30:41.266 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:30:41.266 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:30:41.266 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:30:41.267 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:30:41.267 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:30:41.267 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 1, 2024-08-24T21:30:41.267 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:30:41.267 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:30:41.267 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:30:41.267 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:30:41.267 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:30:41.267 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:30:41.267 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:30:41.267 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:30:41.267 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:30:41.267 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:30:41.268 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:30:41.268 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:30:41.268 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:30:41.268 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:30:41.268 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:30:41.268 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:30:41.268 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:30:41.268 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:30:41.268 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:30:41.268 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:30:41.268 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:30:41.268 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:30:41.269 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:30:41.269 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:30:41.269 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:30:41.269 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:30:41.269 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:30:41.269 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:30:41.269 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:30:41.269 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:41.269 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:30:41.269 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:30:41.269 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:30:41.269 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:30:41.270 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:30:41.270 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:30:41.270 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:30:41.270 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:30:41.270 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:30:41.270 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:30:41.270 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:30:41.270 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:30:41.270 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:30:41.270 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:30:41.270 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:30:41.270 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:30:41.271 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:30:41.271 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:30:41.271 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:30:41.271 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:30:41.271 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:30:41.271 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:30:41.271 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:30:41.271 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:30:41.272 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:30:41.272 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:30:41.272 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:30:41.272 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:30:41.272 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:30:41.272 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:30:41.272 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:41.272 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:30:41.272 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:41.272 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:30:41.272 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:30:41.272 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:30:41.273 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:30:41.273 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:41.273 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:30:41.273 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:30:41.273 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:30:41.273 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:41.273 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:41.273 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:30:41.273 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:30:41.273 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:30:41.273 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:41.273 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:30:41.273 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:41.274 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:30:41.274 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:30:41.274 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:30:41.274 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:30:41.274 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:30:41.274 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:41.274 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:41.274 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:30:41.274 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:30:41.274 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:30:41.274 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:30:41.274 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:41.274 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:30:41.275 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:30:41.275 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:30:41.275 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:41.275 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:41.275 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:30:41.275 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:30:41.275 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:30:41.275 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:41.275 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:30:41.275 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:41.275 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:30:41.275 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:30:41.275 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:30:41.275 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:30:41.276 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:30:41.276 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:41.276 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:41.276 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:30:41.276 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:30:41.276 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:30:41.276 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:30:41.276 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:41.276 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:30:41.276 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:30:41.276 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:30:41.276 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:41.276 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:41.277 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:30:41.277 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:30:41.277 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:30:41.277 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:41.277 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:30:41.277 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:41.277 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:30:41.277 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:30:41.277 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:30:41.277 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:30:41.277 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:30:41.277 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:41.277 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:30:41.277 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:41.278 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:30:41.278 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:30:41.278 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:41.278 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:30:41.278 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:30:41.278 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:30:41.278 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:41.278 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:30:41.278 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:30:41.278 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:41.278 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:30:41.278 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:30:41.278 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:30:41.279 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:41.279 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:30:41.279 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:41.279 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:30:41.279 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:30:41.281 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:30:41.281 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:30:41.281 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:30:41.466 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:30:41.466 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:30:41.467 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:30:41.467 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:30:41.467 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 176, 2024-08-24T21:30:41.467 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 121995, 2024-08-24T21:30:41.467 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:30:41.467 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:30:41.467 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:30:41.467 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:30:41.467 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:30:41.467 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 2, 2024-08-24T21:30:41.467 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:30:41.467 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:30:41.468 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:30:41.468 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:30:41.468 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:30:41.468 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:30:41.468 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:30:41.468 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:30:41.468 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:30:41.468 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:30:41.468 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:30:41.468 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:30:41.469 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:30:41.470 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:30:41.470 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:30:41.470 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:30:41.470 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:30:41.470 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:30:41.470 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:30:41.470 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:30:41.470 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:30:41.470 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:30:41.470 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:30:41.471 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:30:41.471 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:30:41.471 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:30:41.471 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:30:41.471 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:30:41.471 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:30:41.471 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:41.471 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:30:41.471 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:30:41.471 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:30:41.471 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:30:41.471 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:30:41.472 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:30:41.472 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:30:41.472 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:30:41.472 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:30:41.472 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:30:41.472 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:30:41.472 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:30:41.473 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:30:41.473 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:30:41.473 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:30:41.473 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:30:41.473 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:30:41.473 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:30:41.473 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:30:41.473 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:30:41.473 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:30:41.473 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:30:41.473 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:30:41.474 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:30:41.474 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:30:41.474 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:30:41.474 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:30:41.474 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:30:41.474 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:30:41.474 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:30:41.474 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:41.474 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:30:41.475 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:41.475 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:30:41.475 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:30:41.475 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:30:41.475 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:30:41.475 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:41.475 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:30:41.475 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:30:41.475 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:30:41.475 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:41.476 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:41.476 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:30:41.476 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:30:41.476 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:30:41.476 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:41.476 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:30:41.476 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:41.476 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:30:41.476 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:30:41.477 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:30:41.477 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:30:41.477 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:30:41.477 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:41.477 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:41.477 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:30:41.477 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:30:41.477 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:30:41.477 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:30:41.478 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:41.478 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:30:41.478 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:30:41.478 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:30:41.478 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:41.478 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:41.478 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:30:41.478 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:30:41.478 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:30:41.479 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:41.479 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:30:41.479 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:41.479 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:30:41.479 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:30:41.479 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:30:41.479 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:30:41.479 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:30:41.479 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:41.479 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:41.479 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:30:41.479 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:30:41.479 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:30:41.480 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:30:41.480 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:41.480 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:30:41.480 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:30:41.480 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:30:41.480 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:41.480 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:41.480 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:30:41.480 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:30:41.480 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:30:41.480 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:41.480 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:30:41.480 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:41.481 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:30:41.481 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:30:41.481 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:30:41.481 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:30:41.481 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:30:41.481 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:41.481 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:30:41.481 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:41.481 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:30:41.481 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:30:41.481 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:41.482 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:30:41.482 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:30:41.482 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:30:41.482 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:41.482 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:30:41.482 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:30:41.482 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:41.482 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:30:41.482 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:30:41.482 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:30:41.482 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:41.482 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:30:41.482 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:30:41.483 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:41.483 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:30:41.483 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:30:41.483 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:30:41.483 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:41.483 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:30:41.483 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:30:41.483 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:41.483 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:30:41.483 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:30:41.483 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:30:41.483 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:41.483 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:30:41.484 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:41.484 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:30:41.484 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:30:41.485 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:30:41.485 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:30:41.485 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:30:41.671 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:30:41.671 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:30:41.671 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:30:41.671 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:30:41.671 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 176, 2024-08-24T21:30:41.672 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 235321, 2024-08-24T21:30:41.672 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:30:41.672 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:30:41.672 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:30:41.672 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:30:41.672 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:30:41.672 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 2, 2024-08-24T21:30:41.672 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:30:41.672 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:30:41.672 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:30:41.672 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:30:41.672 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:30:41.673 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:30:41.673 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:30:41.673 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:30:41.673 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:30:41.673 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:30:41.673 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:30:41.673 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:30:41.673 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:30:41.673 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:30:41.674 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:30:41.674 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:30:41.674 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:30:41.674 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:30:41.674 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:30:41.674 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:30:41.674 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:30:41.674 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:30:41.674 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:30:41.675 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:30:41.675 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:30:41.675 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:30:41.675 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:30:41.675 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:30:41.675 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:30:41.675 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:41.675 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:30:41.675 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:30:41.675 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:30:41.675 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:30:41.675 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:30:41.676 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:30:41.676 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:30:41.676 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:30:41.676 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:30:41.676 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:30:41.677 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:30:41.678 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:30:41.678 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:30:41.678 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:30:41.678 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:30:41.678 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:30:41.678 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:30:41.678 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:30:41.678 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:30:41.678 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:30:41.678 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:30:41.678 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:30:41.678 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:30:41.679 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:30:41.679 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:30:41.679 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:30:41.679 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:30:41.679 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:30:41.679 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:30:41.679 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:30:41.679 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:41.679 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:30:41.680 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:41.680 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:30:41.680 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:30:41.680 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:30:41.680 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:30:41.680 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:41.680 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:30:41.680 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:30:41.680 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:30:41.680 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:41.681 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:41.681 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:30:41.681 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:30:41.681 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:30:41.681 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:41.681 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:30:41.681 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:41.681 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:30:41.682 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:30:41.682 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:30:41.682 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:30:41.682 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:30:41.682 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:41.682 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:41.682 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:30:41.682 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:30:41.682 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:30:41.682 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:30:41.683 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:41.683 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:30:41.683 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:30:41.683 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:30:41.683 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:41.683 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:41.683 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:30:41.683 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:30:41.683 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:30:41.684 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:41.684 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:30:41.684 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:41.684 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:30:41.684 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:30:41.684 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:30:41.684 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:30:41.684 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:30:41.684 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:41.685 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:41.685 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:30:41.685 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:30:41.685 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:30:41.685 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:30:41.685 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:41.685 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:30:41.685 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:30:41.686 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:30:41.686 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:41.686 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:41.686 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:30:41.686 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:30:41.686 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:30:41.686 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:41.686 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:30:41.687 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:41.687 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:30:41.687 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:30:41.687 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:30:41.687 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:30:41.687 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:30:41.687 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:41.687 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:30:41.687 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:41.687 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:30:41.687 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:30:41.687 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:41.688 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:30:41.688 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:30:41.688 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:30:41.688 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:41.688 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:30:41.688 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:30:41.688 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:41.688 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:30:41.688 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:30:41.688 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:30:41.688 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:41.688 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:30:41.688 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:30:41.689 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:41.689 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:30:41.689 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:30:41.689 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 6 2024-08-24T21:30:41.689 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:41.689 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:30:41.689 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:30:41.689 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:41.689 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:30:41.689 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:30:41.690 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:30:41.690 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:41.690 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:30:41.690 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:41.690 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:30:41.690 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:30:41.691 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:30:41.691 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-08-24T21:30:41.692 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-08-24T21:30:41.929 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:30:41.940 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=9c00a8fd5813541b3965b7142ed43fcd 2024-08-24T21:30:41.941 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ 9c00a8fd5813541b3965b7142ed43fcd != \9\c\0\0\a\8\f\d\5\8\1\3\5\4\1\b\3\9\6\5\b\7\1\4\2\e\d\4\3\f\c\d ]] 2024-08-24T21:30:41.941 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap40 2024-08-24T21:30:41.941 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap40 2024-08-24T21:30:41.941 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap40 2024-08-24T21:30:42.047 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:30:42.058 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:30:42.060 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap40 2024-08-24T21:30:42.060 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:30:42.142 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:30:42.142 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:30:42.142 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:30:42.143 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:30:42.143 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:30:42.143 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap41.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:30:42.185 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-08-24T21:30:42.540 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 52% complete... Importing image diff: 77% complete... Importing image diff: 97% complete... Importing image diff: 100% complete...done. 2024-08-24T21:30:42.557 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap41 - 2024-08-24T21:30:42.558 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:30:42.558 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:30:43.186 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:30:43.186 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:30:43.670 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":176,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:30:43.688 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:30:43.688 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-08-24T21:30:43.688 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:30:43.688 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:30:43.865 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:30:43.866 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:30:43.866 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:30:43.866 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:30:43.866 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 176, 2024-08-24T21:30:43.866 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 17050, 2024-08-24T21:30:43.866 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:30:43.866 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:30:43.866 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:30:43.866 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:30:43.866 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:30:43.866 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 4, 2024-08-24T21:30:43.866 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:30:43.867 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:30:43.867 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:30:43.867 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:30:43.867 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:30:43.867 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:30:43.867 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:30:43.867 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:30:43.867 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:30:43.867 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:30:43.867 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:30:43.867 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:30:43.867 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:30:43.867 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:30:43.868 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:30:43.868 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:30:43.868 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:30:43.868 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:30:43.868 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:30:43.868 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:30:43.868 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:30:43.868 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:30:43.868 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:30:43.868 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:30:43.868 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:30:43.868 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:30:43.869 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:30:43.869 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:30:43.869 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:30:43.869 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:43.869 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:30:43.869 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:30:43.869 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:30:43.869 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:30:43.869 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:30:43.869 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:30:43.869 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:30:43.869 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:30:43.869 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:30:43.869 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:30:43.870 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:30:43.870 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:30:43.870 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:30:43.870 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:30:43.870 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:30:43.870 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:30:43.870 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:30:43.870 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:30:43.870 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:30:43.870 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:30:43.870 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:30:43.870 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:30:43.871 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:30:43.871 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:30:43.871 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:30:43.871 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:30:43.871 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:30:43.871 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:30:43.871 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:30:43.871 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:30:43.871 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:43.871 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:30:43.871 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:43.871 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:30:43.871 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:30:43.872 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:30:43.872 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:30:43.872 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:43.872 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:30:43.872 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:30:43.872 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:30:43.872 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:43.872 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:43.872 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:30:43.872 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:30:43.872 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:30:43.872 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:43.872 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:30:43.872 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:43.873 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:30:43.873 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:30:43.873 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:30:43.873 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:30:43.873 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:30:43.873 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:43.873 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:43.873 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:30:43.873 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:30:43.873 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:30:43.873 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:30:43.873 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:43.873 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:30:43.874 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:30:43.874 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:30:43.874 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:43.874 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:43.874 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:30:43.874 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:30:43.874 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:30:43.874 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:43.874 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:30:43.874 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:43.874 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:30:43.874 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:30:43.875 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:30:43.875 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:30:43.875 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:30:43.875 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:43.875 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:43.875 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:30:43.875 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:30:43.875 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:30:43.875 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:30:43.875 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:43.875 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:30:43.875 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:30:43.875 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:30:43.876 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:43.876 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:43.876 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:30:43.876 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:30:43.876 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:30:43.876 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:43.876 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:30:43.876 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:43.876 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:30:43.876 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:30:43.876 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:30:43.876 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:30:43.877 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:30:43.877 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:43.877 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:30:43.877 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:43.877 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:30:43.877 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:30:43.877 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:43.877 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:30:43.877 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:30:43.877 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:30:43.877 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:43.877 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:30:43.877 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:30:43.877 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:43.878 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:30:43.878 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:30:43.878 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:30:43.878 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:43.878 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:30:43.878 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:43.878 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:30:43.878 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:30:43.880 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:30:43.880 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:30:43.881 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:30:44.057 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:30:44.057 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:30:44.057 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:30:44.057 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:30:44.057 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 176, 2024-08-24T21:30:44.058 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 124585, 2024-08-24T21:30:44.058 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:30:44.058 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:30:44.058 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:30:44.058 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:30:44.058 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:30:44.058 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 4, 2024-08-24T21:30:44.058 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:30:44.058 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:30:44.058 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:30:44.058 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:30:44.059 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:30:44.059 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:30:44.059 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:30:44.059 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:30:44.059 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:30:44.059 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:30:44.059 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:30:44.059 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:30:44.059 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:30:44.059 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:30:44.059 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:30:44.060 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:30:44.060 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:30:44.060 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:30:44.060 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:30:44.060 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:30:44.060 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:30:44.060 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:30:44.060 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:30:44.060 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:30:44.060 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:30:44.060 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:30:44.061 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:30:44.061 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:30:44.061 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:30:44.061 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:44.061 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:30:44.061 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:30:44.061 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:30:44.061 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:30:44.061 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:30:44.061 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:30:44.062 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:30:44.062 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:30:44.062 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:30:44.062 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:30:44.062 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:30:44.062 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:30:44.062 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:30:44.062 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:30:44.062 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:30:44.062 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:30:44.062 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:30:44.063 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:30:44.063 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:30:44.063 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:30:44.063 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:30:44.063 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:30:44.063 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:30:44.063 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:30:44.063 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:30:44.063 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:30:44.063 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:30:44.063 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:30:44.063 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:30:44.064 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:30:44.064 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:44.064 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:30:44.064 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:44.064 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:30:44.064 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:30:44.064 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:30:44.064 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:30:44.064 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:44.064 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:30:44.064 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:30:44.065 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:30:44.065 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:44.065 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:44.065 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:30:44.065 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:30:44.065 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:30:44.065 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:44.065 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:30:44.065 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:44.065 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:30:44.065 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:30:44.066 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:30:44.066 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:30:44.066 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:30:44.066 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:44.066 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:44.066 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:30:44.066 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:30:44.066 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:30:44.066 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:30:44.066 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:44.067 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:30:44.067 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:30:44.067 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:30:44.067 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:44.067 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:44.067 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:30:44.067 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:30:44.067 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:30:44.067 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:44.067 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:30:44.067 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:44.067 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:30:44.068 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:30:44.068 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:30:44.068 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:30:44.068 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:30:44.068 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:44.068 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:44.068 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:30:44.068 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:30:44.068 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:30:44.068 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:30:44.068 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:44.069 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:30:44.069 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:30:44.069 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:30:44.069 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:44.069 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:44.069 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:30:44.069 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:30:44.069 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:30:44.069 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:44.069 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:30:44.069 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:44.069 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:30:44.070 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:30:44.070 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:30:44.070 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:30:44.070 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:30:44.070 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:44.070 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:30:44.070 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:44.070 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:30:44.070 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:30:44.070 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:44.070 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:30:44.071 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:30:44.071 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:30:44.071 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:44.071 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:30:44.071 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:30:44.071 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:44.071 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:30:44.071 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:30:44.071 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:30:44.071 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:44.071 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:30:44.071 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:30:44.072 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:44.072 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:30:44.072 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:30:44.072 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:30:44.072 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:44.072 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:30:44.072 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:30:44.072 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:44.072 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:30:44.072 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:30:44.072 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:30:44.073 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:44.073 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:30:44.073 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:44.073 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:30:44.073 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:30:44.074 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:30:44.074 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:30:44.074 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:30:44.266 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:30:44.266 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:30:44.266 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:30:44.266 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:30:44.266 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 176, 2024-08-24T21:30:44.266 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 237916, 2024-08-24T21:30:44.266 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:30:44.266 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:30:44.267 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:30:44.267 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:30:44.267 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:30:44.267 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 4, 2024-08-24T21:30:44.267 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:30:44.267 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:30:44.267 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:30:44.267 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:30:44.267 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:30:44.267 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:30:44.268 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:30:44.268 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:30:44.268 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:30:44.268 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:30:44.268 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:30:44.268 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:30:44.268 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:30:44.268 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:30:44.268 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:30:44.268 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:30:44.268 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:30:44.268 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:30:44.269 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:30:44.269 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:30:44.269 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:30:44.269 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:30:44.269 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:30:44.269 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:30:44.269 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:30:44.269 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:30:44.269 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:30:44.269 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:30:44.270 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:30:44.270 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:44.270 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:30:44.270 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:30:44.270 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:30:44.270 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:30:44.270 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:30:44.270 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:30:44.270 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:30:44.270 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:30:44.271 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:30:44.271 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:30:44.271 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:30:44.271 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:30:44.271 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:30:44.271 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:30:44.271 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:30:44.271 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:30:44.271 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:30:44.271 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:30:44.271 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:30:44.272 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:30:44.272 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:30:44.272 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:30:44.272 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:30:44.272 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:30:44.272 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:30:44.272 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:30:44.272 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:30:44.272 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:30:44.272 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:30:44.272 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:30:44.273 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:44.273 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:30:44.273 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:44.273 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:30:44.273 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:30:44.273 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:30:44.273 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:30:44.273 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:44.273 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:30:44.273 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:30:44.273 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:30:44.274 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:44.274 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:44.274 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:30:44.274 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:30:44.274 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:30:44.274 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:44.274 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:30:44.274 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:44.274 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:30:44.274 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:30:44.275 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:30:44.275 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:30:44.275 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:30:44.275 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:44.275 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:44.275 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:30:44.275 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:30:44.275 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:30:44.275 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:30:44.275 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:44.275 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:30:44.276 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:30:44.276 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:30:44.276 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:44.276 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:44.276 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:30:44.276 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:30:44.276 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:30:44.276 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:44.276 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:30:44.276 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:44.276 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:30:44.277 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:30:44.277 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:30:44.277 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:30:44.277 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:30:44.277 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:44.277 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:44.277 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:30:44.277 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:30:44.277 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:30:44.277 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:30:44.277 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:44.277 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:30:44.278 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:30:44.278 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:30:44.278 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:44.278 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:44.278 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:30:44.278 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:30:44.278 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:30:44.278 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:44.278 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:30:44.278 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:44.279 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:30:44.279 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:30:44.279 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:30:44.279 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:30:44.279 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:30:44.279 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:44.279 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:30:44.279 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:44.279 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:30:44.279 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:30:44.279 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:44.280 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:30:44.280 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:30:44.280 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:30:44.280 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:44.280 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:30:44.280 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:30:44.280 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:44.280 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:30:44.280 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:30:44.280 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:30:44.280 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:44.281 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:30:44.281 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:30:44.281 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:44.281 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:30:44.281 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:30:44.281 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 6 2024-08-24T21:30:44.281 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:44.281 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:30:44.281 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:30:44.281 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:44.281 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:30:44.281 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:30:44.282 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:30:44.282 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:44.282 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:30:44.282 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:44.282 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:30:44.282 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:30:44.286 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:30:44.286 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2024-08-24T21:30:44.286 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-08-24T21:30:44.286 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-08-24T21:30:44.286 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-08-24T21:30:44.287 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-08-24T21:30:44.287 INFO:teuthology.orchestra.run:waiting for 300 2024-08-24T21:30:44.315 INFO:tasks.ceph.mon.b:Stopped 2024-08-24T21:30:44.315 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-08-24T21:30:44.315 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:30:44.516 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-08-24T21:30:44.763 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":176,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:30:47.680 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:30:47.771 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=9c00a8fd5813541b3965b7142ed43fcd 2024-08-24T21:30:47.772 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap41 - 2024-08-24T21:30:47.772 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:30:47.773 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:30:47.781 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:30:48.249 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":176,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":8,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:30:50.723 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-08-24T21:30:51.268 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:30:51.732 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":176,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:30:53.100 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:30:53.110 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=9c00a8fd5813541b3965b7142ed43fcd 2024-08-24T21:30:53.111 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ 9c00a8fd5813541b3965b7142ed43fcd != \9\c\0\0\a\8\f\d\5\8\1\3\5\4\1\b\3\9\6\5\b\7\1\4\2\e\d\4\3\f\c\d ]] 2024-08-24T21:30:53.111 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap41 2024-08-24T21:30:53.111 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap41 2024-08-24T21:30:53.111 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap41 2024-08-24T21:30:53.218 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:30:53.231 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:30:53.232 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap41 2024-08-24T21:30:53.233 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:30:53.311 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:30:53.311 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:30:53.311 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:30:53.311 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:30:53.311 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:30:53.311 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap42.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:30:54.753 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:30:58.838 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":180,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:30:58.856 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-08-24T21:30:58.856 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-08-24T21:30:58.856 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:30:59.032 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:30:59.033 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:30:59.033 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:30:59.033 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:30:59.033 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 180, 2024-08-24T21:30:59.033 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 32217, 2024-08-24T21:30:59.033 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:30:59.033 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:30:59.033 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:30:59.033 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:30:59.033 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:30:59.034 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:30:59.034 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:30:59.034 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:30:59.034 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:30:59.034 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:30:59.034 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:30:59.034 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:30:59.034 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:30:59.034 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:30:59.034 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:30:59.034 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:30:59.034 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:30:59.035 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:30:59.035 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:30:59.035 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:30:59.035 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:30:59.035 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:30:59.035 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:30:59.035 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:30:59.035 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:30:59.035 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:30:59.035 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:30:59.035 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:30:59.035 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:30:59.036 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:30:59.036 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:30:59.036 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:30:59.036 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:30:59.036 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:30:59.036 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:59.036 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:30:59.036 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:30:59.036 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:30:59.036 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:30:59.036 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:30:59.036 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:30:59.036 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:30:59.037 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:30:59.037 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:30:59.037 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:30:59.037 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:30:59.037 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:30:59.037 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:30:59.037 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:30:59.038 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:30:59.038 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:30:59.038 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:30:59.038 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:30:59.038 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:30:59.038 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:30:59.038 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:30:59.039 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:30:59.039 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:30:59.039 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:30:59.039 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:30:59.039 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:30:59.039 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:30:59.039 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:30:59.040 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:30:59.040 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:30:59.040 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:59.040 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:30:59.040 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:59.040 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:30:59.040 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:30:59.040 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:30:59.040 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:30:59.040 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:59.040 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:30:59.040 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:30:59.040 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:30:59.041 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:59.041 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:59.041 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:30:59.041 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:30:59.041 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:30:59.041 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:59.041 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:30:59.041 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:59.041 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:30:59.041 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:30:59.041 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:30:59.041 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:30:59.042 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:30:59.042 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:59.042 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:59.042 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:30:59.042 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:30:59.042 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:30:59.042 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:30:59.042 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:59.042 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:30:59.042 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:30:59.042 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:30:59.042 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:59.043 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:59.043 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:30:59.043 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:30:59.043 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:30:59.043 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:59.043 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:30:59.043 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:59.043 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:30:59.043 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:30:59.043 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:30:59.044 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:30:59.044 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:30:59.044 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:59.044 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:59.044 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:30:59.044 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:30:59.044 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:30:59.044 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:30:59.044 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:59.044 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:30:59.044 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:30:59.044 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:30:59.044 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:59.044 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:59.045 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:30:59.045 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:30:59.045 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:30:59.045 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:59.045 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:30:59.045 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:59.045 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:30:59.045 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:30:59.045 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:30:59.045 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:30:59.045 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:30:59.045 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:59.045 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:30:59.046 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:59.046 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:30:59.046 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:30:59.046 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:59.046 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:30:59.046 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:30:59.046 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:30:59.046 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:59.046 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:30:59.046 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:30:59.046 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:59.046 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:30:59.046 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:30:59.047 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:30:59.047 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:59.047 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:30:59.047 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:30:59.047 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:59.047 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:30:59.047 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:30:59.047 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-08-24T21:30:59.047 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:59.047 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:30:59.047 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:59.047 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:30:59.048 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:30:59.049 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:30:59.049 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-08-24T21:30:59.049 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:30:59.225 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:30:59.225 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:30:59.225 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:30:59.225 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:30:59.226 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 180, 2024-08-24T21:30:59.226 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 139754, 2024-08-24T21:30:59.226 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:30:59.226 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:30:59.226 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:30:59.226 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:30:59.226 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:30:59.226 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:30:59.226 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:30:59.226 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:30:59.226 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:30:59.226 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:30:59.226 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:30:59.227 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:30:59.227 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:30:59.227 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:30:59.227 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:30:59.227 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:30:59.227 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:30:59.227 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:30:59.227 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:30:59.227 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:30:59.227 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:30:59.227 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:30:59.227 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:30:59.227 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:30:59.228 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:30:59.228 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:30:59.228 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:30:59.228 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:30:59.228 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:30:59.228 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:30:59.228 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:30:59.228 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:30:59.228 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:30:59.228 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:30:59.228 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:59.228 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:30:59.228 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:30:59.229 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:30:59.229 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:30:59.229 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:30:59.229 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:30:59.229 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:30:59.229 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:30:59.229 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:30:59.229 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:30:59.229 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:30:59.229 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:30:59.229 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:30:59.229 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:30:59.230 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:30:59.230 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:30:59.230 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:30:59.230 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:30:59.230 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:30:59.230 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:30:59.230 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:30:59.230 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:30:59.230 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:30:59.230 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:30:59.230 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:30:59.230 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:30:59.230 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:30:59.231 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:30:59.231 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:30:59.231 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:30:59.231 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:59.231 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:30:59.231 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:59.231 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:30:59.231 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:30:59.231 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:30:59.231 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:30:59.231 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:59.231 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:30:59.231 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:30:59.232 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:30:59.232 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:59.232 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:59.232 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:30:59.232 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:30:59.232 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:30:59.232 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:59.232 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:30:59.232 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:59.232 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:30:59.232 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:30:59.232 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:30:59.232 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:30:59.233 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:30:59.233 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:59.233 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:59.233 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:30:59.233 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:30:59.233 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:30:59.233 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:30:59.233 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:59.233 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:30:59.233 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:30:59.233 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:30:59.233 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:59.233 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:59.234 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:30:59.234 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:30:59.234 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:30:59.234 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:59.234 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:30:59.234 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:59.234 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:30:59.234 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:30:59.234 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:30:59.234 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:30:59.234 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:30:59.234 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:59.234 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:59.235 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:30:59.235 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:30:59.235 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:30:59.235 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:30:59.235 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:59.235 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:30:59.235 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:30:59.235 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:30:59.235 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:59.235 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:59.235 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:30:59.235 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:30:59.236 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:30:59.236 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:59.236 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:30:59.236 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:59.236 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:30:59.236 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:30:59.236 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:30:59.236 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:30:59.236 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:30:59.236 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:59.236 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:30:59.236 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:59.236 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:30:59.236 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:30:59.237 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:59.237 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:30:59.237 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:30:59.237 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:30:59.237 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:59.237 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:30:59.237 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:30:59.237 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:59.237 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:30:59.237 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:30:59.237 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:30:59.237 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:59.237 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:30:59.237 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:30:59.238 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:59.238 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:30:59.238 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:30:59.238 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-08-24T21:30:59.238 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:59.238 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:30:59.238 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:30:59.238 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:30:59.238 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:30:59.238 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:30:59.238 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:30:59.238 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:30:59.238 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:30:59.239 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:30:59.239 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:30:59.239 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:30:59.240 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:30:59.240 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-08-24T21:30:59.564 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 1% complete... Importing image diff: 3% complete... Importing image diff: 4% complete... Importing image diff: 6% complete... Importing image diff: 7% complete... Importing image diff: 9% complete... Importing image diff: 10% complete... Importing image diff: 12% complete... Importing image diff: 14% complete... Importing image diff: 15% complete... Importing image diff: 17% complete... Importing image diff: 18% complete... Importing image diff: 20% complete... Importing image diff: 21% complete... Importing image diff: 23% complete... Importing image diff: 25% complete... Importing image diff: 26% complete... Importing image diff: 28% complete... Importing image diff: 29% complete... Importing image diff: 31% complete... Importing image diff: 32% complete... Importing image diff: 34% complete... Importing image diff: 35% complete... Importing image diff: 37% complete... Importing image diff: 39% complete... Importing image diff: 40% complete... Importing image diff: 42% complete... Importing image diff: 43% complete... Importing image diff: 45% complete... Importing image diff: 46% complete... Importing image diff: 48% complete... Importing image diff: 50% complete... Importing image diff: 51% complete... Importing image diff: 53% complete... Importing image diff: 54% complete... Importing image diff: 56% complete... Importing image diff: 57% complete... Importing image diff: 59% complete... Importing image diff: 60% complete... Importing image diff: 62% complete... Importing image diff: 64% complete... Importing image diff: 65% complete... Importing image diff: 67% complete... Importing image diff: 68% complete... Importing image diff: 70% complete... Importing image diff: 71% complete... Importing image diff: 73% complete... Importing image diff: 75% complete... Importing image diff: 76% complete... Importing image diff: 78% complete... Importing image diff: 79% complete... Importing image diff: 81% complete... Importing image diff: 82% complete... Importing image diff: 84% complete... Importing image diff: 85% complete... Importing image diff: 87% complete... Importing image diff: 89% complete... Importing image diff: 90% complete... Importing image diff: 92% complete... Importing image diff: 93% complete... Importing image diff: 95% complete... Importing image diff: 96% complete... Importing image diff: 98% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2024-08-24T21:30:59.586 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap42 - 2024-08-24T21:30:59.586 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:30:59.587 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:31:04.787 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:31:04.858 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=49fc2e33b9daba56fd52f0bd12d634f8 2024-08-24T21:31:04.859 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap42 - 2024-08-24T21:31:04.860 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:31:04.860 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:31:10.151 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:31:10.162 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=49fc2e33b9daba56fd52f0bd12d634f8 2024-08-24T21:31:10.162 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ 49fc2e33b9daba56fd52f0bd12d634f8 != \4\9\f\c\2\e\3\3\b\9\d\a\b\a\5\6\f\d\5\2\f\0\b\d\1\2\d\6\3\4\f\8 ]] 2024-08-24T21:31:10.162 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap42 2024-08-24T21:31:10.162 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap42 2024-08-24T21:31:10.162 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap42 2024-08-24T21:31:10.270 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:31:10.282 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:31:10.284 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap42 2024-08-24T21:31:10.284 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:31:10.364 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:31:10.364 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:31:10.364 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:31:10.364 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:31:10.364 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:31:10.364 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap43.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:31:10.578 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 52% complete... Importing image diff: 77% complete... Importing image diff: 97% complete... Importing image diff: 100% complete...done. 2024-08-24T21:31:10.596 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap43 - 2024-08-24T21:31:10.596 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:31:10.596 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:31:15.769 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:31:15.859 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=49fc2e33b9daba56fd52f0bd12d634f8 2024-08-24T21:31:15.860 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap43 - 2024-08-24T21:31:15.860 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:31:15.860 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:31:19.241 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-08-24T21:31:19.241 INFO:tasks.ceph.mon.b:Restarting daemon 2024-08-24T21:31:19.241 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-08-24T21:31:19.246 INFO:tasks.ceph.mon.b:Started 2024-08-24T21:31:19.246 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:31:19.246 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:31:19.707 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":180,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:31:21.241 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:31:21.252 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=49fc2e33b9daba56fd52f0bd12d634f8 2024-08-24T21:31:21.252 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ 49fc2e33b9daba56fd52f0bd12d634f8 != \4\9\f\c\2\e\3\3\b\9\d\a\b\a\5\6\f\d\5\2\f\0\b\d\1\2\d\6\3\4\f\8 ]] 2024-08-24T21:31:21.252 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap43 2024-08-24T21:31:21.252 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap43 2024-08-24T21:31:21.252 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap43 2024-08-24T21:31:21.368 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:31:21.380 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:31:21.381 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap43 2024-08-24T21:31:21.382 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:31:21.459 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:31:21.459 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:31:21.459 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:31:21.459 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:31:21.459 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:31:21.459 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap44.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:31:22.603 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 16% complete... Importing image diff: 32% complete... Importing image diff: 33% complete... Importing image diff: 34% complete... Importing image diff: 35% complete... Importing image diff: 36% complete... Importing image diff: 37% complete... Importing image diff: 38% complete... Importing image diff: 55% complete... Importing image diff: 71% complete... Importing image diff: 72% complete... Importing image diff: 73% complete... Importing image diff: 74% complete... Importing image diff: 75% complete... Importing image diff: 76% complete... Importing image diff: 77% complete... Importing image diff: 78% complete... Importing image diff: 79% complete... Importing image diff: 80% complete... Importing image diff: 81% complete... Importing image diff: 82% complete... Importing image diff: 83% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2024-08-24T21:31:22.624 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap44 - 2024-08-24T21:31:22.624 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:31:22.624 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:31:22.727 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:31:23.183 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":180,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":24,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:31:26.202 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:31:26.644 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":182,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:31:26.662 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:31:26.662 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:31:26.663 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:31:26.857 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:31:26.857 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:31:26.858 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:31:26.858 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:31:26.858 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 182, 2024-08-24T21:31:26.858 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 60042, 2024-08-24T21:31:26.858 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:31:26.858 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:31:26.858 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:31:26.858 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:31:26.858 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:31:26.858 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 1, 2024-08-24T21:31:26.858 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:31:26.858 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:31:26.859 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:31:26.859 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:31:26.859 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:31:26.859 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:31:26.859 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:31:26.859 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:31:26.859 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:31:26.859 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:31:26.859 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:31:26.859 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:31:26.859 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:31:26.859 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:31:26.859 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:31:26.860 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:31:26.860 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:31:26.860 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:31:26.860 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:31:26.860 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:31:26.860 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:31:26.860 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:31:26.860 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:31:26.860 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:31:26.860 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:31:26.860 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:31:26.860 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:31:26.860 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:31:26.861 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:31:26.861 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:26.861 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:31:26.861 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:31:26.861 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:31:26.861 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:31:26.861 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:31:26.861 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:31:26.861 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:31:26.861 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:31:26.861 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:31:26.861 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:31:26.862 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:31:26.862 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:31:26.862 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:31:26.862 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:31:26.862 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:31:26.862 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:31:26.862 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:31:26.862 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:31:26.862 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:31:26.862 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:31:26.862 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:31:26.862 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:31:26.862 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:31:26.863 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:31:26.863 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:31:26.863 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:31:26.863 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:31:26.863 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:31:26.863 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:31:26.863 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:31:26.863 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:26.863 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:31:26.863 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:26.863 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:31:26.863 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:31:26.864 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:31:26.864 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:31:26.864 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:26.864 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:31:26.864 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:31:26.864 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:31:26.864 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:26.864 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:26.864 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:31:26.864 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:31:26.864 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:31:26.864 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:31:26.865 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:31:26.865 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:26.865 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:31:26.865 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:31:26.865 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:31:26.865 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:31:26.865 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:31:26.865 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:26.865 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:26.865 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:31:26.865 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:31:26.865 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:31:26.865 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:31:26.866 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:26.866 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:31:26.866 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:31:26.866 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:31:26.866 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:26.866 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:26.866 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:31:26.866 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:31:26.866 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:31:26.866 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:31:26.866 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:31:26.866 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:26.866 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:31:26.867 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:31:26.867 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:31:26.867 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:31:26.867 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:31:26.867 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:26.867 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:26.867 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:31:26.867 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:31:26.867 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:31:26.867 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:31:26.867 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:26.867 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:31:26.868 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:31:26.868 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:31:26.868 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:26.868 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:26.868 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:31:26.868 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:31:26.868 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:31:26.868 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:31:26.868 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:31:26.868 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:26.868 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:31:26.868 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:31:26.868 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:31:26.869 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:31:26.869 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:31:26.869 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:31:26.869 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:31:26.869 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:26.869 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:31:26.869 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:31:26.869 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:26.869 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:31:26.869 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:31:26.869 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:31:26.870 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:31:26.870 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:31:26.870 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:31:26.870 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:26.870 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:31:26.870 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:31:26.870 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:31:26.870 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:31:26.870 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:31:26.870 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:31:26.870 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:26.870 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:31:26.870 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:31:26.871 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:31:26.871 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:31:26.871 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:31:26.871 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:26.871 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:31:26.871 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:31:26.873 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:31:26.873 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:31:26.873 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:31:27.061 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:31:27.062 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:31:27.062 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:31:27.062 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:31:27.062 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 182, 2024-08-24T21:31:27.062 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 167590, 2024-08-24T21:31:27.062 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:31:27.062 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:31:27.062 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:31:27.062 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:31:27.062 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:31:27.062 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 2, 2024-08-24T21:31:27.062 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:31:27.063 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:31:27.063 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:31:27.063 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:31:27.063 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:31:27.063 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:31:27.063 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:31:27.063 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:31:27.063 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:31:27.063 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:31:27.063 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:31:27.063 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:31:27.063 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:31:27.064 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:31:27.064 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:31:27.064 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:31:27.064 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:31:27.064 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:31:27.064 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:31:27.064 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:31:27.064 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:31:27.064 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:31:27.064 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:31:27.064 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:31:27.064 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:31:27.064 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:31:27.065 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:31:27.065 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:31:27.065 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:31:27.065 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:27.065 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:31:27.065 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:31:27.065 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:31:27.065 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:31:27.065 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:31:27.065 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:31:27.065 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:31:27.065 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:31:27.065 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:31:27.066 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:31:27.066 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:31:27.066 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:31:27.066 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:31:27.066 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:31:27.066 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:31:27.066 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:31:27.066 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:31:27.066 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:31:27.066 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:31:27.066 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:31:27.066 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:31:27.066 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:31:27.067 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:31:27.067 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:31:27.067 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:31:27.067 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:31:27.067 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:31:27.067 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:31:27.067 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:31:27.067 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:31:27.067 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:27.068 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:31:27.068 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:27.068 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:31:27.068 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:31:27.068 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:31:27.068 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:31:27.068 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:27.068 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:31:27.068 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:31:27.068 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:31:27.068 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:27.069 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:27.069 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:31:27.069 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:31:27.069 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:31:27.069 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:31:27.069 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:31:27.069 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:27.069 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:31:27.069 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:31:27.069 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:31:27.069 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:31:27.069 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:31:27.069 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:27.070 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:27.070 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:31:27.070 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:31:27.070 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:31:27.070 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:31:27.070 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:27.070 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:31:27.070 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:31:27.070 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:31:27.070 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:27.070 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:27.070 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:31:27.071 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:31:27.071 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:31:27.071 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:31:27.071 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:31:27.071 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:27.071 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:31:27.071 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:31:27.071 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:31:27.071 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:31:27.071 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:31:27.071 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:27.071 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:27.071 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:31:27.072 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:31:27.072 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:31:27.072 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:31:27.072 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:27.072 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:31:27.072 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:31:27.072 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:31:27.072 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:27.072 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:27.072 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:31:27.072 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:31:27.072 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:31:27.073 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:31:27.073 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:31:27.073 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:27.073 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:31:27.073 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:31:27.073 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:31:27.073 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:31:27.073 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:31:27.073 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:31:27.073 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:31:27.073 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:27.073 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:31:27.073 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:31:27.074 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:27.074 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:31:27.074 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:31:27.074 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:31:27.074 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:31:27.074 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:31:27.074 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:31:27.074 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:27.074 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:31:27.074 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:31:27.074 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:31:27.075 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:31:27.075 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:31:27.075 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:31:27.075 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:27.075 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:31:27.075 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:31:27.075 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:31:27.075 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:31:27.075 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:31:27.075 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:31:27.075 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:27.075 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:31:27.075 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:31:27.076 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:31:27.076 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:31:27.076 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:31:27.076 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:27.076 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:31:27.076 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:31:27.077 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:31:27.077 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:31:27.077 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:31:27.856 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:31:27.931 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=405e161a2b6159c5a52e6f4ca14a9f43 2024-08-24T21:31:27.932 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap44 - 2024-08-24T21:31:27.933 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:31:27.933 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:31:28.659 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:31:28.659 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:31:28.659 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:31:28.659 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:31:28.659 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 182, 2024-08-24T21:31:28.659 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 9257, 2024-08-24T21:31:28.659 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:31:28.659 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:31:28.659 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:31:28.659 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:31:28.659 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:31:28.660 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 3, 2024-08-24T21:31:28.660 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:31:28.660 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:31:28.660 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:31:28.660 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:31:28.660 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:31:28.660 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:31:28.660 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:31:28.660 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:31:28.660 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:31:28.660 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:31:28.660 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:31:28.660 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:31:28.661 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:31:28.661 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:31:28.661 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:31:28.661 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:31:28.661 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:31:28.661 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:31:28.661 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:31:28.661 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:31:28.661 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:31:28.661 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:31:28.661 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:31:28.661 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:31:28.661 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:31:28.662 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:31:28.662 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:31:28.662 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:31:28.662 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:31:28.662 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:28.662 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:31:28.662 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:31:28.662 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:31:28.662 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:31:28.662 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:31:28.662 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:31:28.662 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:31:28.663 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:31:28.663 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:31:28.663 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:31:28.663 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:31:28.663 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:31:28.663 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:31:28.663 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:31:28.663 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:31:28.663 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:31:28.663 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:31:28.663 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:31:28.663 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:31:28.663 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:31:28.664 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:31:28.664 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:31:28.664 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:31:28.664 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:31:28.664 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:31:28.664 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:31:28.664 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:31:28.664 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:31:28.664 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:31:28.664 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:31:28.664 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:28.664 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:31:28.664 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:28.665 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:31:28.665 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:31:28.665 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:31:28.665 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:31:28.665 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:28.665 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:31:28.665 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:31:28.665 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:31:28.665 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:28.665 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:28.665 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:31:28.665 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:31:28.665 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:31:28.666 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:31:28.666 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:31:28.666 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:28.666 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:31:28.666 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:31:28.666 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:31:28.666 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:31:28.666 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:31:28.666 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:28.666 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:28.666 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:31:28.666 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:31:28.666 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:31:28.667 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:31:28.667 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:28.667 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:31:28.667 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:31:28.667 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:31:28.667 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:28.667 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:28.667 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:31:28.667 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:31:28.667 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:31:28.667 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:31:28.667 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:31:28.667 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:28.667 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:31:28.668 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:31:28.668 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:31:28.668 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:31:28.668 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:31:28.668 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:28.668 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:28.668 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:31:28.668 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:31:28.668 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:31:28.668 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:31:28.668 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:28.668 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:31:28.668 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:31:28.669 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:31:28.669 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:28.669 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:28.669 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:31:28.669 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:31:28.669 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:31:28.669 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:31:28.669 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:31:28.669 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:28.669 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:31:28.669 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:31:28.669 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:31:28.669 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:31:28.670 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:31:28.670 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:31:28.670 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:31:28.670 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:28.670 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:31:28.670 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:31:28.670 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:28.670 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:31:28.670 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:31:28.670 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:31:28.670 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:31:28.670 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:31:28.670 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:31:28.671 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:28.671 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:31:28.671 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:31:28.671 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:31:28.671 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:31:28.671 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:31:28.671 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:28.671 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:31:28.671 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:31:28.675 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:31:28.675 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-08-24T21:31:28.675 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-08-24T21:31:29.169 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-08-24T21:31:30.170 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:31:30.171 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:31:30.642 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":182,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:31:30.661 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:31:30.661 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-08-24T21:31:30.661 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:31:30.662 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:31:30.848 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:31:30.848 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:31:30.848 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:31:30.848 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:31:30.848 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 182, 2024-08-24T21:31:30.848 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 64033, 2024-08-24T21:31:30.849 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:31:30.849 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:31:30.849 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:31:30.849 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:31:30.849 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:31:30.849 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 5, 2024-08-24T21:31:30.849 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:31:30.849 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:31:30.849 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:31:30.849 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:31:30.849 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:31:30.849 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:31:30.849 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:31:30.850 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:31:30.850 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:31:30.850 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:31:30.850 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:31:30.850 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:31:30.850 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:31:30.850 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:31:30.850 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:31:30.850 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:31:30.850 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:31:30.850 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:31:30.850 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:31:30.851 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:31:30.851 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:31:30.851 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:31:30.851 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:31:30.851 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:31:30.851 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:31:30.851 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:31:30.851 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:31:30.851 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:31:30.851 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:31:30.851 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:30.851 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:31:30.851 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:31:30.852 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:31:30.852 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:31:30.852 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:31:30.852 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:31:30.852 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:31:30.852 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:31:30.852 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:31:30.852 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:31:30.852 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:31:30.852 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:31:30.852 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:31:30.852 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:31:30.852 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:31:30.853 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:31:30.853 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:31:30.853 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:31:30.853 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:31:30.853 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:31:30.853 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:31:30.853 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:31:30.853 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:31:30.853 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:31:30.853 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:31:30.853 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:31:30.853 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:31:30.853 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:31:30.854 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:31:30.854 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:31:30.854 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:30.854 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:31:30.854 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:30.854 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:31:30.854 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:31:30.854 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:31:30.854 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:31:30.854 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:30.854 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:31:30.854 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:31:30.854 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:31:30.855 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:30.855 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:30.855 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:31:30.855 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:31:30.855 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:31:30.855 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:31:30.855 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:31:30.855 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:30.855 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:31:30.855 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:31:30.855 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:31:30.855 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:31:30.855 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:31:30.856 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:30.856 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:30.856 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:31:30.856 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:31:30.856 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:31:30.856 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:31:30.856 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:30.856 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:31:30.856 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:31:30.856 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:31:30.856 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:30.856 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:30.857 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:31:30.857 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:31:30.857 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:31:30.857 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:31:30.857 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:31:30.857 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:30.857 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:31:30.857 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:31:30.857 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:31:30.857 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:31:30.857 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:31:30.857 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:30.857 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:30.858 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:31:30.858 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:31:30.858 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:31:30.858 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:31:30.858 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:30.858 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:31:30.858 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:31:30.858 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:31:30.858 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:30.858 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:30.858 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:31:30.858 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:31:30.859 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:31:30.859 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:31:30.859 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:31:30.859 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:30.859 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:31:30.859 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:31:30.859 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:31:30.859 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:31:30.859 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:31:30.859 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:31:30.859 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:31:30.859 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:30.859 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:31:30.859 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:31:30.860 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:30.860 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:31:30.860 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:31:30.860 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:31:30.860 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:31:30.860 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:31:30.860 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:31:30.860 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:30.860 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:31:30.860 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:31:30.860 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:31:30.860 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:31:30.860 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:31:30.860 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:31:30.861 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:30.861 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:31:30.861 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:31:30.861 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-08-24T21:31:30.861 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:31:30.861 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:31:30.861 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:30.861 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:31:30.861 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:31:30.863 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:31:30.863 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:31:30.864 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:31:31.052 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:31:31.052 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:31:31.052 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:31:31.053 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:31:31.053 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 182, 2024-08-24T21:31:31.053 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 171581, 2024-08-24T21:31:31.053 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:31:31.053 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:31:31.053 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:31:31.053 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:31:31.053 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:31:31.053 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 6, 2024-08-24T21:31:31.053 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:31:31.053 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:31:31.053 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:31:31.054 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:31:31.054 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:31:31.054 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:31:31.054 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:31:31.054 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:31:31.054 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:31:31.054 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:31:31.054 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:31:31.054 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:31:31.054 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:31:31.054 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:31:31.054 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:31:31.055 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:31:31.055 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:31:31.055 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:31:31.055 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:31:31.055 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:31:31.055 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:31:31.055 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:31:31.055 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:31:31.055 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:31:31.055 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:31:31.055 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:31:31.055 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:31:31.055 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:31:31.056 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:31:31.056 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:31.056 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:31:31.056 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:31:31.056 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:31:31.056 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:31:31.056 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:31:31.056 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:31:31.056 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:31:31.056 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:31:31.056 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:31:31.056 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:31:31.056 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:31:31.057 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:31:31.057 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:31:31.057 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:31:31.057 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:31:31.057 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:31:31.057 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:31:31.057 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:31:31.057 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:31:31.057 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:31:31.057 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:31:31.057 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:31:31.057 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:31:31.058 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:31:31.058 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:31:31.058 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:31:31.058 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:31:31.058 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:31:31.058 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:31:31.058 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:31:31.058 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:31.058 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:31:31.058 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:31.058 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:31:31.058 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:31:31.058 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:31:31.059 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:31:31.059 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:31.059 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:31:31.059 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:31:31.059 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:31:31.059 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:31.059 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:31.059 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:31:31.059 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:31:31.059 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:31:31.059 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:31:31.059 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:31:31.060 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:31.060 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:31:31.060 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:31:31.060 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:31:31.060 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:31:31.060 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:31:31.060 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:31.060 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:31.060 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:31:31.060 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:31:31.060 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:31:31.060 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:31:31.061 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:31.061 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:31:31.061 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:31:31.061 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:31:31.061 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:31.061 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:31.061 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:31:31.061 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:31:31.061 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:31:31.061 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:31:31.061 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:31:31.061 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:31.061 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:31:31.062 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:31:31.062 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:31:31.062 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:31:31.062 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:31:31.062 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:31.062 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:31.062 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:31:31.062 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:31:31.062 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:31:31.062 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:31:31.062 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:31.062 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:31:31.063 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:31:31.063 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:31:31.063 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:31.063 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:31.063 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:31:31.063 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:31:31.063 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:31:31.063 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:31:31.063 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:31:31.063 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:31.063 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:31:31.063 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:31:31.063 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:31:31.064 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:31:31.064 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:31:31.064 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:31:31.064 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:31:31.064 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:31.064 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:31:31.064 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:31:31.064 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:31.064 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:31:31.064 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:31:31.064 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:31:31.064 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:31:31.064 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:31:31.064 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:31:31.065 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:31.065 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:31:31.065 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:31:31.065 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:31:31.065 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:31:31.065 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:31:31.065 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:31:31.065 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:31.065 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:31:31.065 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:31:31.065 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-08-24T21:31:31.065 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:31:31.065 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:31:31.066 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:31:31.066 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:31.066 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:31:31.066 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:31:31.066 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:31:31.066 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:31:31.066 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:31:31.066 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:31.066 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:31:31.066 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:31:31.068 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:31:31.068 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:31:31.068 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:31:31.252 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:31:31.252 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:31:31.253 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:31:31.253 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:31:31.253 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 182, 2024-08-24T21:31:31.253 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 11851, 2024-08-24T21:31:31.253 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:31:31.253 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:31:31.253 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:31:31.253 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:31:31.253 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:31:31.253 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 6, 2024-08-24T21:31:31.253 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:31:31.253 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:31:31.254 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:31:31.254 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:31:31.254 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:31:31.254 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:31:31.254 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:31:31.254 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:31:31.254 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:31:31.254 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:31:31.254 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:31:31.254 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:31:31.254 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:31:31.254 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:31:31.255 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:31:31.255 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:31:31.255 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:31:31.255 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:31:31.255 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:31:31.255 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:31:31.255 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:31:31.255 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:31:31.255 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:31:31.255 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:31:31.255 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:31:31.255 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:31:31.255 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:31:31.256 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:31:31.256 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:31:31.256 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:31.256 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:31:31.256 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:31:31.256 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:31:31.256 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:31:31.256 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:31:31.256 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:31:31.256 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:31:31.256 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:31:31.256 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:31:31.256 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:31:31.257 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:31:31.257 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:31:31.257 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:31:31.257 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:31:31.257 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:31:31.257 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:31:31.257 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:31:31.257 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:31:31.258 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:31:31.258 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:31:31.258 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:31:31.258 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:31:31.258 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:31:31.258 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:31:31.258 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:31:31.258 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:31:31.258 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:31:31.258 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:31:31.258 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:31:31.258 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:31:31.259 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:31.259 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:31:31.259 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:31.259 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:31:31.259 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:31:31.259 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:31:31.259 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:31:31.259 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:31.259 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:31:31.259 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:31:31.259 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:31:31.259 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:31.259 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:31.260 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:31:31.260 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:31:31.260 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:31:31.260 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:31:31.260 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:31:31.260 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:31.260 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:31:31.260 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:31:31.260 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:31:31.260 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:31:31.260 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:31:31.260 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:31.260 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:31.261 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:31:31.261 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:31:31.261 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:31:31.261 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:31:31.261 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:31.261 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:31:31.261 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:31:31.261 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:31:31.261 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:31.261 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:31.261 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:31:31.261 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:31:31.261 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:31:31.261 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:31:31.262 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:31:31.262 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:31.262 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:31:31.262 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:31:31.262 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:31:31.262 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:31:31.262 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:31:31.262 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:31.262 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:31.262 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:31:31.262 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:31:31.262 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:31:31.262 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:31:31.263 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:31.263 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:31:31.263 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:31:31.263 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:31:31.263 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:31.263 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:31.263 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:31:31.263 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:31:31.263 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:31:31.263 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:31:31.263 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:31:31.263 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:31.263 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:31:31.264 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:31:31.264 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:31:31.264 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:31:31.264 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:31:31.264 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:31:31.264 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:31:31.264 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:31.264 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:31:31.264 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:31:31.264 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:31.264 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:31:31.264 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:31:31.264 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:31:31.264 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:31:31.265 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:31:31.265 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:31:31.265 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:31.265 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:31:31.265 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:31:31.265 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:31:31.265 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:31:31.265 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:31:31.265 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:31.265 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:31:31.265 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:31:31.268 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:31:31.268 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-08-24T21:31:31.268 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-08-24T21:31:31.269 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-08-24T21:31:31.269 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-08-24T21:31:31.269 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-08-24T21:31:31.269 INFO:teuthology.orchestra.run:waiting for 300 2024-08-24T21:31:31.287 INFO:tasks.ceph.mon.a:Stopped 2024-08-24T21:31:31.287 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-08-24T21:31:31.287 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:31:31.788 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":182,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":6,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:31:33.259 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:31:33.269 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=405e161a2b6159c5a52e6f4ca14a9f43 2024-08-24T21:31:33.269 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ 405e161a2b6159c5a52e6f4ca14a9f43 != \4\0\5\e\1\6\1\a\2\b\6\1\5\9\c\5\a\5\2\e\6\f\4\c\a\1\4\a\9\f\4\3 ]] 2024-08-24T21:31:33.270 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap44 2024-08-24T21:31:33.270 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap44 2024-08-24T21:31:33.270 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap44 2024-08-24T21:31:33.383 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:31:33.396 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:31:33.398 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap44 2024-08-24T21:31:33.398 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:31:33.483 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:31:33.483 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:31:33.484 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:31:33.484 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:31:33.484 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:31:33.484 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap45.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:31:34.808 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:31:35.355 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":182,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":10,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:31:38.373 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:31:38.818 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":182,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:31:41.837 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:31:45.982 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 7% complete... Importing image diff: 14% complete... Importing image diff: 21% complete... Importing image diff: 28% complete... Importing image diff: 35% complete... Importing image diff: 42% complete... Importing image diff: 50% complete... Importing image diff: 57% complete... Importing image diff: 64% complete... Importing image diff: 71% complete... Importing image diff: 78% complete... Importing image diff: 85% complete... Importing image diff: 92% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2024-08-24T21:31:46.002 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap45 - 2024-08-24T21:31:46.010 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:31:46.011 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:31:46.226 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":184,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:31:46.246 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-08-24T21:31:46.246 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-08-24T21:31:46.246 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:31:46.426 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:31:46.426 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:31:46.426 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:31:46.426 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:31:46.426 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 184, 2024-08-24T21:31:46.426 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 186955, 2024-08-24T21:31:46.426 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:31:46.427 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:31:46.427 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:31:46.427 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:31:46.427 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:31:46.427 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:31:46.427 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:31:46.427 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:31:46.427 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:31:46.427 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:31:46.427 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:31:46.427 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:31:46.427 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:31:46.428 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:31:46.428 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:31:46.428 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:31:46.428 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:31:46.428 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:31:46.428 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:31:46.428 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:31:46.428 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:31:46.428 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:31:46.428 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:31:46.428 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:31:46.428 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:31:46.429 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:31:46.429 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:31:46.429 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:31:46.429 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:31:46.429 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:31:46.429 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:31:46.429 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:31:46.429 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:31:46.429 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:31:46.429 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:46.429 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:31:46.430 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:31:46.430 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:31:46.430 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:31:46.430 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:31:46.430 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:31:46.430 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:31:46.430 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:31:46.430 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:31:46.430 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:31:46.430 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:31:46.430 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:31:46.430 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:31:46.431 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:31:46.431 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:31:46.431 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:31:46.431 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:31:46.431 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:31:46.431 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:31:46.431 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:31:46.431 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:31:46.431 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:31:46.431 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:31:46.431 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:31:46.431 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:31:46.432 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:31:46.432 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:31:46.432 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:31:46.432 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:31:46.432 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:31:46.432 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:46.432 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:31:46.432 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:46.432 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:31:46.432 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:31:46.432 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:31:46.432 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:31:46.432 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:46.433 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:31:46.433 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:31:46.433 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:31:46.433 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:46.433 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:46.433 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:31:46.433 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:31:46.433 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:31:46.434 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:31:46.434 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:31:46.434 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:46.434 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:31:46.434 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:31:46.434 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:31:46.434 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:31:46.434 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:31:46.434 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:46.434 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:46.434 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:31:46.434 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:31:46.435 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:31:46.435 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:31:46.435 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:46.435 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:31:46.435 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:31:46.435 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:31:46.435 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:46.435 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:46.435 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:31:46.435 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:31:46.435 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:31:46.435 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:31:46.435 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:31:46.436 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:46.436 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:31:46.436 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:31:46.436 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:31:46.436 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:31:46.436 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:31:46.436 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:46.436 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:46.436 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:31:46.436 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:31:46.436 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:31:46.436 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:31:46.436 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:46.437 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:31:46.437 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:31:46.437 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:31:46.437 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:46.437 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:46.437 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:31:46.437 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:31:46.437 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:31:46.437 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:31:46.437 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:31:46.437 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:46.437 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:31:46.437 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:31:46.438 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:31:46.438 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:31:46.438 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:31:46.438 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:31:46.438 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:31:46.438 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:46.438 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:31:46.438 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:31:46.438 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:46.438 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:31:46.438 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:31:46.438 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:31:46.438 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:31:46.439 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:31:46.439 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:31:46.439 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:46.439 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:31:46.439 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:31:46.439 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 7 2024-08-24T21:31:46.439 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:31:46.439 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:31:46.439 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:31:46.439 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:46.439 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:31:46.439 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:31:46.439 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:31:46.439 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:31:46.440 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:31:46.440 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:31:46.440 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:46.440 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:31:46.440 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:31:46.440 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:31:46.440 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:31:46.440 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:31:46.440 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:46.440 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:31:46.440 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:31:46.441 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:31:46.441 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-08-24T21:31:46.442 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:31:46.620 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:31:46.620 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:31:46.620 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:31:46.620 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:31:46.620 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 184, 2024-08-24T21:31:46.621 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 27219, 2024-08-24T21:31:46.621 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:31:46.621 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:31:46.621 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:31:46.621 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:31:46.621 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:31:46.621 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:31:46.621 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:31:46.621 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:31:46.621 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:31:46.621 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:31:46.621 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:31:46.622 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:31:46.622 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:31:46.622 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:31:46.622 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:31:46.622 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:31:46.623 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:31:46.623 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:31:46.623 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:31:46.623 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:31:46.623 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:31:46.623 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:31:46.623 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:31:46.623 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:31:46.623 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:31:46.623 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:31:46.624 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:31:46.624 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:31:46.624 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:31:46.624 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:31:46.624 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:31:46.624 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:31:46.624 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:31:46.624 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:31:46.624 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:46.624 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:31:46.624 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:31:46.624 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:31:46.624 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:31:46.625 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:31:46.625 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:31:46.625 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:31:46.625 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:31:46.625 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:31:46.625 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:31:46.625 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:31:46.625 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:31:46.626 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:31:46.626 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:31:46.626 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:31:46.626 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:31:46.626 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:31:46.626 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:31:46.626 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:31:46.627 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:31:46.627 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:31:46.627 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:31:46.627 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:31:46.627 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:31:46.627 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:31:46.627 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:31:46.627 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:31:46.627 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:31:46.627 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:31:46.627 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:31:46.627 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:46.627 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:31:46.628 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:46.628 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:31:46.628 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:31:46.628 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:31:46.628 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:31:46.628 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:46.628 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:31:46.628 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:31:46.628 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:31:46.628 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:46.628 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:46.628 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:31:46.628 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:31:46.629 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:31:46.629 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:31:46.629 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:31:46.629 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:46.629 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:31:46.629 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:31:46.629 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:31:46.629 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:31:46.629 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:31:46.629 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:46.629 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:46.629 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:31:46.629 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:31:46.630 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:31:46.630 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:31:46.630 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:46.630 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:31:46.630 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:31:46.630 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:31:46.630 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:46.630 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:46.630 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:31:46.630 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:31:46.630 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:31:46.630 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:31:46.630 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:31:46.631 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:46.631 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:31:46.631 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:31:46.631 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:31:46.631 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:31:46.631 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:31:46.631 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:46.631 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:46.631 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:31:46.631 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:31:46.631 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:31:46.631 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:31:46.631 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:46.632 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:31:46.632 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:31:46.632 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:31:46.632 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:46.632 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:46.632 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:31:46.632 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:31:46.632 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:31:46.632 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:31:46.632 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:31:46.633 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:46.633 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:31:46.633 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:31:46.633 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:31:46.633 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:31:46.633 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:31:46.633 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:31:46.633 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:31:46.633 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:46.633 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:31:46.633 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:31:46.633 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:46.633 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:31:46.634 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:31:46.634 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:31:46.634 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:31:46.634 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:31:46.634 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:31:46.634 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:46.634 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:31:46.634 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:31:46.634 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:31:46.634 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:31:46.635 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:31:46.635 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:31:46.635 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:31:46.635 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:31:46.635 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:31:46.635 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:31:46.635 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:31:46.635 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:31:46.635 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:31:46.635 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:31:46.636 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:31:46.637 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:31:46.638 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-08-24T21:31:51.143 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:31:51.231 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=cee9fd7790b226557a54cb86461d8867 2024-08-24T21:31:51.233 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap45 - 2024-08-24T21:31:51.233 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:31:51.233 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:31:56.609 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:31:56.621 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=cee9fd7790b226557a54cb86461d8867 2024-08-24T21:31:56.622 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ cee9fd7790b226557a54cb86461d8867 != \c\e\e\9\f\d\7\7\9\0\b\2\2\6\5\5\7\a\5\4\c\b\8\6\4\6\1\d\8\8\6\7 ]] 2024-08-24T21:31:56.622 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap45 2024-08-24T21:31:56.622 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap45 2024-08-24T21:31:56.622 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap45 2024-08-24T21:31:56.729 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:31:56.740 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:31:56.742 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap45 2024-08-24T21:31:56.742 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:31:56.819 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:31:56.819 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:31:56.819 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:31:56.819 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:31:56.819 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:31:56.819 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap46.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:31:58.010 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 1% complete... Importing image diff: 2% complete... Importing image diff: 3% complete... Importing image diff: 4% complete... Importing image diff: 5% complete... Importing image diff: 6% complete... Importing image diff: 7% complete... Importing image diff: 8% complete... Importing image diff: 9% complete... Importing image diff: 10% complete... Importing image diff: 11% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2024-08-24T21:31:58.032 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap46 - 2024-08-24T21:31:58.032 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:31:58.033 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:32:03.244 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:32:03.328 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=0685a2ed8757135ab8fcceaec35cd085 2024-08-24T21:32:03.329 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap46 - 2024-08-24T21:32:03.329 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:32:03.329 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:32:06.638 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-08-24T21:32:06.639 INFO:tasks.ceph.mon.a:Restarting daemon 2024-08-24T21:32:06.639 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-08-24T21:32:06.644 INFO:tasks.ceph.mon.a:Started 2024-08-24T21:32:06.644 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:32:06.644 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:32:07.114 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":184,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":21,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:32:08.684 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:32:08.695 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=0685a2ed8757135ab8fcceaec35cd085 2024-08-24T21:32:08.695 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ 0685a2ed8757135ab8fcceaec35cd085 != \0\6\8\5\a\2\e\d\8\7\5\7\1\3\5\a\b\8\f\c\c\e\a\e\c\3\5\c\d\0\8\5 ]] 2024-08-24T21:32:08.695 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap46 2024-08-24T21:32:08.695 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap46 2024-08-24T21:32:08.695 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap46 2024-08-24T21:32:08.812 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:32:08.825 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:32:08.826 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap46 2024-08-24T21:32:08.826 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:32:08.905 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:32:08.906 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:32:08.906 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:32:08.906 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:32:08.906 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:32:08.906 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap47.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:32:10.038 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 1% complete... Importing image diff: 3% complete... Importing image diff: 4% complete... Importing image diff: 6% complete... Importing image diff: 7% complete... Importing image diff: 9% complete... Importing image diff: 10% complete... Importing image diff: 12% complete... Importing image diff: 14% complete... Importing image diff: 15% complete... Importing image diff: 17% complete... Importing image diff: 18% complete... Importing image diff: 20% complete... Importing image diff: 21% complete... Importing image diff: 23% complete... Importing image diff: 25% complete... Importing image diff: 26% complete... Importing image diff: 28% complete... Importing image diff: 29% complete... Importing image diff: 31% complete... Importing image diff: 32% complete... Importing image diff: 34% complete... Importing image diff: 35% complete... Importing image diff: 37% complete... Importing image diff: 39% complete... Importing image diff: 40% complete... Importing image diff: 42% complete... Importing image diff: 43% complete... Importing image diff: 45% complete... Importing image diff: 46% complete... Importing image diff: 48% complete... Importing image diff: 50% complete... Importing image diff: 51% complete... Importing image diff: 53% complete... Importing image diff: 54% complete... Importing image diff: 56% complete... Importing image diff: 57% complete... Importing image diff: 59% complete... Importing image diff: 60% complete... Importing image diff: 62% complete... Importing image diff: 64% complete... Importing image diff: 65% complete... Importing image diff: 67% complete... Importing image diff: 68% complete... Importing image diff: 70% complete... Importing image diff: 71% complete... Importing image diff: 73% complete... Importing image diff: 75% complete... Importing image diff: 76% complete... Importing image diff: 78% complete... Importing image diff: 79% complete... Importing image diff: 81% complete... Importing image diff: 82% complete... Importing image diff: 84% complete... Importing image diff: 85% complete... Importing image diff: 87% complete... Importing image diff: 89% complete... Importing image diff: 90% complete... Importing image diff: 92% complete... Importing image diff: 93% complete... Importing image diff: 95% complete... Importing image diff: 96% complete... Importing image diff: 98% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2024-08-24T21:32:10.058 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap47 - 2024-08-24T21:32:10.058 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:32:10.059 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:32:10.134 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:32:10.608 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":184,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":24,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:32:13.626 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:32:14.063 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":184,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":28,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:32:15.251 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:32:15.340 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=74d54d8d777ce5be9f87b26100794fc4 2024-08-24T21:32:15.341 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap47 - 2024-08-24T21:32:15.341 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:32:15.342 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:32:17.082 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:32:17.547 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":184,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":31,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:32:20.567 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:32:20.722 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:32:20.732 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=74d54d8d777ce5be9f87b26100794fc4 2024-08-24T21:32:20.732 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ 74d54d8d777ce5be9f87b26100794fc4 != \7\4\d\5\4\d\8\d\7\7\7\c\e\5\b\e\9\f\8\7\b\2\6\1\0\0\7\9\4\f\c\4 ]] 2024-08-24T21:32:20.732 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap47 2024-08-24T21:32:20.732 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap47 2024-08-24T21:32:20.732 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap47 2024-08-24T21:32:29.867 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:32:29.880 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:32:29.881 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap47 2024-08-24T21:32:29.881 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:32:29.960 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:32:29.960 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:32:29.960 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:32:29.961 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:32:29.961 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:32:29.961 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap48.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:32:30.045 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":190,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:32:30.512 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 50% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2024-08-24T21:32:30.529 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap48 - 2024-08-24T21:32:30.529 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:32:30.530 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:32:33.064 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:32:33.533 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":192,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:32:33.550 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:32:33.551 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:32:33.551 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:32:33.725 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:32:33.726 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:32:33.726 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:32:33.726 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:32:33.726 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 192, 2024-08-24T21:32:33.726 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 26933, 2024-08-24T21:32:33.726 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:32:33.726 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:32:33.726 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:32:33.726 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:32:33.726 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:32:33.726 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 1, 2024-08-24T21:32:33.727 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:32:33.727 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:32:33.727 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:32:33.727 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:32:33.727 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:32:33.727 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:32:33.727 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:32:33.727 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:32:33.727 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:32:33.727 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:32:33.727 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:32:33.727 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:32:33.728 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:32:33.728 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:32:33.728 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:32:33.728 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:32:33.728 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:32:33.728 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:32:33.728 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:32:33.728 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:32:33.728 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:32:33.728 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:32:33.728 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:32:33.728 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:32:33.729 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:32:33.729 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:32:33.729 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:32:33.729 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:32:33.729 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:32:33.729 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:33.729 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:32:33.729 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:32:33.729 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:32:33.729 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:32:33.729 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:32:33.729 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:32:33.730 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:32:33.730 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:32:33.730 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:32:33.730 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:32:33.730 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:32:33.730 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:32:33.730 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:32:33.730 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:32:33.730 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:32:33.730 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:32:33.730 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:32:33.731 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:32:33.731 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:32:33.731 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:32:33.731 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:32:33.731 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:32:33.731 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:32:33.731 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:32:33.731 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:32:33.731 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:32:33.731 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:32:33.731 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:32:33.731 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:32:33.731 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:32:33.732 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:33.732 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:32:33.732 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:33.732 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:32:33.732 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:32:33.732 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:32:33.732 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:32:33.732 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:33.732 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:32:33.732 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:32:33.732 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:32:33.732 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:33.733 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:33.733 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:32:33.733 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:32:33.733 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:32:33.733 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:32:33.733 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:32:33.733 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:33.733 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:32:33.733 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:32:33.733 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:32:33.733 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:32:33.733 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:32:33.733 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:33.734 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:33.734 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:32:33.734 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:32:33.734 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:32:33.734 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:32:33.734 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:33.734 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:32:33.734 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:32:33.734 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:32:33.734 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:33.734 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:33.734 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:32:33.734 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:32:33.735 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:32:33.735 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:32:33.735 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:32:33.735 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:33.735 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:32:33.735 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:32:33.735 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:32:33.735 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:32:33.735 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:32:33.735 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:33.735 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:33.735 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:32:33.736 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:32:33.736 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:32:33.736 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:32:33.736 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:33.736 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:32:33.736 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:32:33.736 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:32:33.736 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:33.736 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:33.736 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:32:33.736 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:32:33.736 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:32:33.736 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:32:33.737 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:32:33.737 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:33.737 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:32:33.737 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:32:33.737 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:32:33.737 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:32:33.737 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:32:33.737 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:32:33.737 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:32:33.737 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:33.737 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:32:33.737 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:32:33.737 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:33.738 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:32:33.738 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:32:33.738 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:32:33.738 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:32:33.738 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:32:33.738 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:32:33.738 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:33.738 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:32:33.738 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:32:33.738 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:32:33.738 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:32:33.738 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:32:33.738 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:33.739 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:32:33.739 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:32:33.740 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:32:33.740 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:32:33.740 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:32:33.942 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:32:33.942 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:32:33.942 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:32:33.942 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:32:33.942 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 192, 2024-08-24T21:32:33.942 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 234470, 2024-08-24T21:32:33.942 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:32:33.942 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:32:33.942 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:32:33.942 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:32:33.943 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:32:33.943 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 1, 2024-08-24T21:32:33.943 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:32:33.943 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:32:33.943 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:32:33.943 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:32:33.943 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:32:33.943 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:32:33.943 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:32:33.943 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:32:33.943 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:32:33.943 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:32:33.944 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:32:33.944 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:32:33.944 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:32:33.944 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:32:33.944 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:32:33.944 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:32:33.944 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:32:33.944 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:32:33.944 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:32:33.944 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:32:33.944 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:32:33.944 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:32:33.944 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:32:33.945 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:32:33.945 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:32:33.945 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:32:33.945 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:32:33.945 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:32:33.945 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:32:33.945 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:33.945 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:32:33.945 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:32:33.945 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:32:33.945 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:32:33.945 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:32:33.945 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:32:33.946 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:32:33.946 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:32:33.946 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:32:33.946 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:32:33.946 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:32:33.946 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:32:33.946 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:32:33.946 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:32:33.946 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:32:33.946 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:32:33.946 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:32:33.946 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:32:33.947 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:32:33.947 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:32:33.947 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:32:33.947 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:32:33.947 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:32:33.947 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:32:33.947 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:32:33.947 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:32:33.947 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:32:33.947 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:32:33.947 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:32:33.947 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:32:33.947 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:33.948 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:32:33.948 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:33.948 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:32:33.948 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:32:33.948 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:32:33.948 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:32:33.948 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:33.948 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:32:33.948 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:32:33.948 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:32:33.948 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:33.948 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:33.949 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:32:33.949 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:32:33.949 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:32:33.949 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:32:33.949 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:32:33.949 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:33.949 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:32:33.949 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:32:33.949 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:32:33.949 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:32:33.949 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:32:33.949 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:33.949 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:33.950 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:32:33.950 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:32:33.950 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:32:33.950 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:32:33.950 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:33.950 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:32:33.950 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:32:33.950 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:32:33.950 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:33.950 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:33.951 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:32:33.951 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:32:33.951 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:32:33.951 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:32:33.951 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:32:33.951 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:33.951 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:32:33.951 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:32:33.952 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:32:33.952 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:32:33.952 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:32:33.952 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:33.952 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:33.952 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:32:33.952 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:32:33.952 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:32:33.952 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:32:33.952 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:33.952 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:32:33.953 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:32:33.953 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:32:33.953 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:33.953 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:33.953 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:32:33.953 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:32:33.953 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:32:33.953 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:32:33.953 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:32:33.953 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:33.953 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:32:33.953 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:32:33.953 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:32:33.954 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:32:33.954 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:32:33.954 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:32:33.954 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:32:33.954 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:33.954 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:32:33.954 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:32:33.954 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:33.954 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:32:33.954 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:32:33.954 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:32:33.954 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:32:33.954 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:32:33.955 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:32:33.955 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:33.955 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:32:33.955 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:32:33.955 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 7 2024-08-24T21:32:33.955 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:32:33.955 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:32:33.955 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:32:33.955 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:33.955 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:32:33.955 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:32:33.955 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:32:33.955 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:32:33.956 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:32:33.956 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:32:33.956 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:33.956 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:32:33.956 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:32:33.956 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:32:33.956 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:32:33.956 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:32:33.956 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:33.956 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:32:33.956 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:32:33.960 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:32:33.961 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:32:33.961 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:32:34.153 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:32:34.153 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:32:34.153 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:32:34.153 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:32:34.153 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 192, 2024-08-24T21:32:34.154 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 74752, 2024-08-24T21:32:34.154 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:32:34.154 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:32:34.154 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:32:34.154 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:32:34.154 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:32:34.154 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 1, 2024-08-24T21:32:34.154 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:32:34.154 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:32:34.155 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:32:34.155 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:32:34.155 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:32:34.155 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:32:34.155 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:32:34.155 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:32:34.155 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:32:34.155 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:32:34.155 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:32:34.155 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:32:34.155 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:32:34.155 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:32:34.156 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:32:34.156 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:32:34.156 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:32:34.156 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:32:34.156 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:32:34.156 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:32:34.156 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:32:34.156 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:32:34.156 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:32:34.156 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:32:34.156 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:32:34.156 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:32:34.156 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:32:34.157 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:32:34.157 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:32:34.157 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:34.157 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:32:34.157 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:32:34.157 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:32:34.157 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:32:34.157 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:32:34.157 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:32:34.157 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:32:34.157 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:32:34.157 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:32:34.157 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:32:34.158 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:32:34.158 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:32:34.158 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:32:34.158 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:32:34.158 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:32:34.158 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:32:34.158 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:32:34.158 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:32:34.158 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:32:34.158 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:32:34.158 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:32:34.159 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:32:34.159 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:32:34.159 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:32:34.159 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:32:34.159 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:32:34.159 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:32:34.159 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:32:34.159 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:32:34.159 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:32:34.159 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:34.159 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:32:34.159 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:34.160 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:32:34.160 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:32:34.160 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:32:34.160 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:32:34.160 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:34.160 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:32:34.160 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:32:34.160 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:32:34.160 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:34.160 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:34.160 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:32:34.161 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:32:34.161 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:32:34.161 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:32:34.161 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:32:34.161 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:34.161 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:32:34.161 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:32:34.161 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:32:34.161 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:32:34.161 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:32:34.161 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:34.161 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:34.162 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:32:34.162 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:32:34.162 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:32:34.162 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:32:34.162 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:34.162 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:32:34.162 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:32:34.162 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:32:34.162 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:34.162 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:34.162 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:32:34.162 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:32:34.163 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:32:34.163 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:32:34.163 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:32:34.163 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:34.163 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:32:34.163 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:32:34.163 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:32:34.163 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:32:34.163 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:32:34.163 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:34.163 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:34.163 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:32:34.163 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:32:34.164 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:32:34.164 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:32:34.164 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:34.164 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:32:34.164 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:32:34.164 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:32:34.164 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:34.164 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:34.164 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:32:34.164 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:32:34.164 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:32:34.164 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:32:34.165 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:32:34.165 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:34.165 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:32:34.165 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:32:34.165 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:32:34.165 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:32:34.165 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:32:34.165 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:32:34.165 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:32:34.165 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:34.165 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:32:34.165 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:32:34.166 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:34.166 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:32:34.166 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:32:34.166 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:32:34.166 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:32:34.166 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:32:34.166 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:32:34.166 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:34.166 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:32:34.166 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:32:34.166 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:32:34.166 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:32:34.166 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:32:34.167 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:32:34.167 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:34.167 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:32:34.167 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:32:34.167 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-08-24T21:32:34.167 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:32:34.167 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:32:34.167 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:34.167 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:32:34.167 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:32:34.168 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:32:34.169 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-08-24T21:32:34.169 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-08-24T21:32:34.634 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-08-24T21:32:35.636 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:32:35.636 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:32:35.740 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:32:35.822 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=22671892cc460c4feb94ee83e8f30e56 2024-08-24T21:32:35.823 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap48 - 2024-08-24T21:32:35.823 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:32:35.824 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:32:36.082 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":192,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:32:36.101 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:32:36.101 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-08-24T21:32:36.101 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:32:36.101 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:32:36.286 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:32:36.286 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:32:36.286 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:32:36.286 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:32:36.286 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 192, 2024-08-24T21:32:36.286 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 29494, 2024-08-24T21:32:36.286 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:32:36.286 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:32:36.286 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:32:36.287 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:32:36.287 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:32:36.287 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 4, 2024-08-24T21:32:36.287 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:32:36.287 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:32:36.287 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:32:36.287 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:32:36.287 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:32:36.287 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:32:36.287 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:32:36.287 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:32:36.287 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:32:36.287 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:32:36.288 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:32:36.288 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:32:36.288 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:32:36.288 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:32:36.288 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:32:36.288 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:32:36.288 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:32:36.288 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:32:36.288 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:32:36.288 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:32:36.288 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:32:36.288 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:32:36.288 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:32:36.288 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:32:36.289 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:32:36.289 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:32:36.289 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:32:36.289 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:32:36.289 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:32:36.289 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:36.289 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:32:36.289 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:32:36.289 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:32:36.289 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:32:36.289 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:32:36.289 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:32:36.289 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:32:36.290 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:32:36.290 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:32:36.290 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:32:36.290 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:32:36.290 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:32:36.290 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:32:36.290 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:32:36.290 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:32:36.290 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:32:36.290 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:32:36.291 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:32:36.291 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:32:36.291 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:32:36.291 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:32:36.291 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:32:36.291 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:32:36.291 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:32:36.291 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:32:36.291 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:32:36.291 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:32:36.291 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:32:36.291 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:32:36.291 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:32:36.292 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:36.292 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:32:36.292 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:36.292 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:32:36.292 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:32:36.292 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:32:36.292 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:32:36.292 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:36.292 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:32:36.292 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:32:36.292 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:32:36.292 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:36.292 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:36.292 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:32:36.293 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:32:36.293 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:32:36.293 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:32:36.293 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:32:36.293 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:36.293 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:32:36.293 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:32:36.293 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:32:36.293 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:32:36.293 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:32:36.293 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:36.293 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:36.293 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:32:36.294 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:32:36.294 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:32:36.294 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:32:36.294 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:36.294 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:32:36.294 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:32:36.294 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:32:36.294 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:36.294 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:36.294 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:32:36.294 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:32:36.294 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:32:36.294 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:32:36.295 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:32:36.295 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:36.295 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:32:36.295 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:32:36.295 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:32:36.295 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:32:36.295 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:32:36.295 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:36.295 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:36.295 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:32:36.295 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:32:36.295 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:32:36.295 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:32:36.296 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:36.296 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:32:36.296 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:32:36.296 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:32:36.296 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:36.296 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:36.296 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:32:36.296 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:32:36.296 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:32:36.296 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:32:36.296 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:32:36.296 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:36.296 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:32:36.296 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:32:36.297 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:32:36.297 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:32:36.297 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:32:36.297 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:32:36.297 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:32:36.297 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:36.297 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:32:36.297 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:32:36.297 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:36.297 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:32:36.297 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:32:36.297 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:32:36.297 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:32:36.297 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:32:36.298 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:32:36.298 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:36.298 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:32:36.298 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:32:36.298 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:32:36.298 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:32:36.298 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:32:36.298 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:36.298 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:32:36.298 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:32:36.301 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:32:36.301 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:32:36.302 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:32:36.490 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:32:36.491 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:32:36.491 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:32:36.491 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:32:36.491 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 192, 2024-08-24T21:32:36.491 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 237019, 2024-08-24T21:32:36.491 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:32:36.491 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:32:36.491 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:32:36.491 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:32:36.491 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:32:36.491 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 4, 2024-08-24T21:32:36.492 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:32:36.492 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:32:36.492 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:32:36.492 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:32:36.492 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:32:36.492 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:32:36.492 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:32:36.492 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:32:36.492 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:32:36.492 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:32:36.492 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:32:36.492 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:32:36.492 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:32:36.493 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:32:36.493 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:32:36.493 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:32:36.493 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:32:36.493 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:32:36.493 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:32:36.493 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:32:36.493 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:32:36.493 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:32:36.493 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:32:36.493 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:32:36.493 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:32:36.493 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:32:36.494 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:32:36.494 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:32:36.494 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:32:36.494 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:36.494 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:32:36.494 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:32:36.494 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:32:36.494 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:32:36.494 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:32:36.494 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:32:36.494 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:32:36.494 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:32:36.495 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:32:36.495 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:32:36.495 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:32:36.495 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:32:36.495 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:32:36.495 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:32:36.495 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:32:36.495 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:32:36.495 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:32:36.495 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:32:36.495 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:32:36.495 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:32:36.495 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:32:36.496 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:32:36.496 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:32:36.496 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:32:36.496 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:32:36.496 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:32:36.496 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:32:36.496 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:32:36.496 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:32:36.496 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:32:36.496 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:36.496 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:32:36.496 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:36.497 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:32:36.497 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:32:36.497 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:32:36.497 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:32:36.497 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:36.497 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:32:36.497 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:32:36.497 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:32:36.497 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:36.497 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:36.497 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:32:36.497 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:32:36.497 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:32:36.498 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:32:36.498 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:32:36.498 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:36.498 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:32:36.498 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:32:36.498 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:32:36.498 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:32:36.498 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:32:36.498 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:36.498 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:36.498 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:32:36.498 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:32:36.498 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:32:36.499 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:32:36.499 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:36.499 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:32:36.499 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:32:36.499 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:32:36.499 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:36.499 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:36.499 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:32:36.499 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:32:36.499 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:32:36.499 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:32:36.499 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:32:36.499 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:36.499 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:32:36.500 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:32:36.500 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:32:36.500 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:32:36.500 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:32:36.500 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:36.500 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:36.500 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:32:36.500 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:32:36.500 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:32:36.500 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:32:36.500 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:36.500 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:32:36.500 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:32:36.500 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:32:36.501 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:36.501 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:36.501 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:32:36.501 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:32:36.501 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:32:36.501 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:32:36.501 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:32:36.501 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:36.501 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:32:36.501 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:32:36.501 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:32:36.501 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:32:36.501 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:32:36.502 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:32:36.502 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:32:36.502 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:36.502 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:32:36.502 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:32:36.502 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:36.502 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:32:36.502 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:32:36.502 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:32:36.502 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:32:36.502 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:32:36.502 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:32:36.502 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:36.503 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:32:36.503 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:32:36.503 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 7 2024-08-24T21:32:36.503 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:32:36.503 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:32:36.503 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:32:36.503 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:36.503 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:32:36.503 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:32:36.503 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-08-24T21:32:36.503 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:32:36.503 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:32:36.503 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:32:36.503 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:36.504 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:32:36.504 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:32:36.504 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:32:36.504 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:32:36.504 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:32:36.504 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:36.504 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:32:36.504 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:32:36.506 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:32:36.506 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:32:36.507 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:32:36.695 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:32:36.695 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:32:36.695 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:32:36.695 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:32:36.696 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 192, 2024-08-24T21:32:36.696 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 77295, 2024-08-24T21:32:36.696 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:32:36.696 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:32:36.696 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:32:36.696 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:32:36.696 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:32:36.696 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 4, 2024-08-24T21:32:36.696 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:32:36.696 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:32:36.696 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:32:36.696 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:32:36.696 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:32:36.697 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:32:36.697 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:32:36.697 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:32:36.697 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:32:36.697 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:32:36.697 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:32:36.697 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:32:36.697 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:32:36.697 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:32:36.697 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:32:36.697 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:32:36.697 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:32:36.697 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:32:36.698 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:32:36.698 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:32:36.698 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:32:36.698 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:32:36.698 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:32:36.698 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:32:36.698 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:32:36.698 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:32:36.698 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:32:36.698 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:32:36.699 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:32:36.699 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:36.699 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:32:36.699 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:32:36.699 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:32:36.699 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:32:36.699 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:32:36.699 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:32:36.699 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:32:36.699 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:32:36.699 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:32:36.699 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:32:36.700 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:32:36.700 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:32:36.700 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:32:36.700 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:32:36.700 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:32:36.700 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:32:36.700 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:32:36.700 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:32:36.700 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:32:36.700 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:32:36.701 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:32:36.701 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:32:36.701 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:32:36.701 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:32:36.701 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:32:36.701 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:32:36.701 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:32:36.701 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:32:36.701 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:32:36.701 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:32:36.701 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:36.701 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:32:36.701 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:36.702 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:32:36.702 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:32:36.702 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:32:36.702 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:32:36.702 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:36.702 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:32:36.702 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:32:36.702 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:32:36.702 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:36.702 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:36.702 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:32:36.702 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:32:36.702 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:32:36.703 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:32:36.703 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:32:36.703 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:36.703 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:32:36.703 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:32:36.703 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:32:36.703 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:32:36.703 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:32:36.703 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:36.703 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:36.703 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:32:36.703 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:32:36.704 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:32:36.704 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:32:36.704 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:36.704 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:32:36.704 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:32:36.704 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:32:36.704 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:36.704 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:36.704 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:32:36.704 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:32:36.704 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:32:36.704 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:32:36.704 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:32:36.704 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:36.705 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:32:36.705 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:32:36.705 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:32:36.705 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:32:36.705 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:32:36.705 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:36.705 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:36.705 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:32:36.705 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:32:36.705 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:32:36.705 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:32:36.705 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:36.705 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:32:36.706 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:32:36.706 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:32:36.706 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:36.706 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:36.706 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:32:36.706 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:32:36.706 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:32:36.706 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:32:36.706 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:32:36.706 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:36.706 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:32:36.706 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:32:36.706 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:32:36.707 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:32:36.707 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:32:36.707 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:32:36.707 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:32:36.707 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:36.708 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:32:36.708 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:32:36.708 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:36.708 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:32:36.708 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:32:36.708 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:32:36.708 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:32:36.709 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:32:36.709 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:32:36.709 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:36.709 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:32:36.709 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:32:36.709 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:32:36.709 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:32:36.709 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:32:36.709 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:32:36.709 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:36.709 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:32:36.709 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:32:36.709 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:32:36.710 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:32:36.710 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:32:36.710 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:36.710 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:32:36.710 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:32:36.711 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:32:36.711 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-08-24T21:32:36.711 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-08-24T21:32:36.711 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-08-24T21:32:36.712 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-08-24T21:32:36.712 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-08-24T21:32:36.712 INFO:teuthology.orchestra.run:waiting for 300 2024-08-24T21:32:36.730 INFO:tasks.ceph.mon.a:Stopped 2024-08-24T21:32:36.730 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-08-24T21:32:36.730 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:32:37.236 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":192,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:32:40.257 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:32:40.717 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":192,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":8,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:32:41.198 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:32:41.209 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=22671892cc460c4feb94ee83e8f30e56 2024-08-24T21:32:41.209 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ 22671892cc460c4feb94ee83e8f30e56 != \2\2\6\7\1\8\9\2\c\c\4\6\0\c\4\f\e\b\9\4\e\e\8\3\e\8\f\3\0\e\5\6 ]] 2024-08-24T21:32:41.209 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap48 2024-08-24T21:32:41.209 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap48 2024-08-24T21:32:41.209 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap48 2024-08-24T21:32:41.318 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:32:41.330 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:32:41.331 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap48 2024-08-24T21:32:41.332 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:32:41.409 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:32:41.409 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:32:41.409 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:32:41.409 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:32:41.409 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:32:41.409 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap49.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:32:43.736 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:32:44.184 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":192,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:32:47.203 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:32:51.384 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 30% complete... Importing image diff: 31% complete... Importing image diff: 62% complete... Importing image diff: 92% complete... Importing image diff: 93% complete... Importing image diff: 94% complete... Importing image diff: 95% complete... Importing image diff: 96% complete... Importing image diff: 97% complete... Importing image diff: 98% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2024-08-24T21:32:51.407 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap49 - 2024-08-24T21:32:51.407 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:32:51.408 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:32:52.057 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":194,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:32:52.075 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-08-24T21:32:52.075 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-08-24T21:32:52.076 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:32:52.252 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:32:52.252 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:32:52.252 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:32:52.253 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:32:52.253 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 194, 2024-08-24T21:32:52.253 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 252781, 2024-08-24T21:32:52.253 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:32:52.253 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:32:52.253 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:32:52.253 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:32:52.253 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:32:52.253 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:32:52.253 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:32:52.253 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:32:52.253 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:32:52.253 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:32:52.254 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:32:52.254 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:32:52.254 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:32:52.254 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:32:52.254 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:32:52.254 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:32:52.254 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:32:52.254 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:32:52.254 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:32:52.254 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:32:52.254 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:32:52.254 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:32:52.255 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:32:52.255 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:32:52.255 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:32:52.255 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:32:52.255 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:32:52.255 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:32:52.255 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:32:52.255 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:32:52.255 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:32:52.255 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:32:52.255 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:32:52.255 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:32:52.256 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:52.256 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:32:52.256 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:32:52.256 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:32:52.256 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:32:52.256 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:32:52.256 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:32:52.256 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:32:52.256 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:32:52.256 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:32:52.256 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:32:52.256 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:32:52.256 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:32:52.257 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:32:52.257 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:32:52.257 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:32:52.257 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:32:52.257 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:32:52.257 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:32:52.257 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:32:52.257 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:32:52.257 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:32:52.257 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:32:52.257 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:32:52.257 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:32:52.258 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:32:52.258 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:32:52.258 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:32:52.258 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:32:52.258 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:32:52.258 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:32:52.258 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:52.258 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:32:52.258 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:52.258 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:32:52.258 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:32:52.258 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:32:52.259 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:32:52.259 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:52.259 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:32:52.259 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:32:52.259 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:32:52.259 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:52.259 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:52.259 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:32:52.259 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:32:52.259 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:32:52.259 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:32:52.259 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:32:52.259 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:52.260 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:32:52.260 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:32:52.260 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:32:52.260 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:32:52.260 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:32:52.260 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:52.260 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:52.260 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:32:52.260 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:32:52.260 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:32:52.260 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:32:52.260 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:52.260 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:32:52.261 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:32:52.261 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:32:52.261 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:52.261 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:52.261 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:32:52.261 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:32:52.261 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:32:52.261 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:32:52.261 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:32:52.261 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:52.261 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:32:52.261 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:32:52.261 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:32:52.262 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:32:52.262 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:32:52.262 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:52.262 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:52.262 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:32:52.262 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:32:52.262 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:32:52.262 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:32:52.262 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:52.262 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:32:52.262 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:32:52.262 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:32:52.262 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:52.263 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:52.263 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:32:52.263 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:32:52.263 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:32:52.263 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:32:52.263 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:32:52.263 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:52.263 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:32:52.263 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:32:52.263 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:32:52.263 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:32:52.263 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:32:52.263 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:32:52.264 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:32:52.264 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:52.264 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:32:52.264 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:32:52.264 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:52.264 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:32:52.264 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:32:52.264 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:32:52.264 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:32:52.264 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:32:52.264 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:32:52.264 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:52.264 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:32:52.264 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:32:52.265 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 7 2024-08-24T21:32:52.265 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:32:52.265 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:32:52.265 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:32:52.265 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:52.265 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:32:52.265 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:32:52.265 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-08-24T21:32:52.265 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:32:52.265 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:32:52.265 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:32:52.265 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:52.265 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:32:52.266 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:32:52.266 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:32:52.266 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:32:52.266 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:32:52.266 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:52.266 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:32:52.266 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:32:52.267 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:32:52.267 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-08-24T21:32:52.267 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:32:52.474 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:32:52.474 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:32:52.474 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:32:52.474 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:32:52.474 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 194, 2024-08-24T21:32:52.474 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 93072, 2024-08-24T21:32:52.475 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:32:52.475 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:32:52.475 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:32:52.475 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:32:52.475 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 1, 2024-08-24T21:32:52.475 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:32:52.475 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:32:52.475 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:32:52.475 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:32:52.475 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:32:52.475 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:32:52.476 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:32:52.476 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:32:52.476 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:32:52.476 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:32:52.476 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:32:52.476 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:32:52.476 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:32:52.476 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:32:52.476 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:32:52.476 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:32:52.476 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:32:52.476 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:32:52.476 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:32:52.477 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:32:52.477 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:32:52.477 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:32:52.477 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:32:52.477 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:32:52.477 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:32:52.477 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:32:52.477 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:32:52.477 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:32:52.477 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:32:52.477 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:52.477 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:32:52.477 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:32:52.477 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:32:52.478 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:32:52.478 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:32:52.478 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:32:52.478 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:32:52.478 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:32:52.478 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:32:52.478 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:32:52.478 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:32:52.478 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:32:52.478 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:32:52.478 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:32:52.479 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:32:52.479 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:32:52.479 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:32:52.479 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:32:52.479 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:32:52.479 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:32:52.479 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:32:52.479 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:32:52.479 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:32:52.479 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:32:52.479 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:32:52.479 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:32:52.479 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:32:52.480 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:32:52.480 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:32:52.480 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:32:52.480 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:52.480 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:32:52.480 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:52.480 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:32:52.480 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:32:52.480 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:32:52.480 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:32:52.480 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:52.480 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:32:52.481 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:32:52.481 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:32:52.481 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:52.481 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:52.481 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:32:52.481 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:32:52.481 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:32:52.481 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:32:52.482 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:32:52.482 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:52.482 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:32:52.482 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:32:52.482 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:32:52.482 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:32:52.482 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:32:52.482 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:52.482 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:52.482 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:32:52.482 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:32:52.482 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:32:52.483 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:32:52.483 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:52.483 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:32:52.483 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:32:52.483 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:32:52.483 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:52.483 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:52.483 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:32:52.483 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:32:52.483 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:32:52.483 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:32:52.483 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:32:52.483 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:52.484 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:32:52.484 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:32:52.484 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:32:52.484 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:32:52.484 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:32:52.484 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:52.484 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:52.484 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:32:52.484 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:32:52.484 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:32:52.484 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:32:52.484 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:52.484 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:32:52.485 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:32:52.485 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:32:52.485 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:52.485 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:52.485 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:32:52.485 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:32:52.485 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:32:52.485 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:32:52.485 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:32:52.485 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:52.485 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:32:52.485 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:32:52.485 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:32:52.486 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:32:52.486 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:32:52.486 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:32:52.486 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:32:52.486 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:52.486 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:32:52.486 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:32:52.486 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:52.486 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:32:52.486 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:32:52.486 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:32:52.486 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:32:52.486 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:32:52.487 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:32:52.487 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:52.487 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:32:52.487 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:32:52.487 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:32:52.487 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:32:52.487 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:32:52.487 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:32:52.487 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:32:52.487 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:32:52.487 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:32:52.487 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-08-24T21:32:52.487 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:32:52.488 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:32:52.488 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:32:52.488 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:32:52.488 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:32:52.490 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:32:52.491 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-08-24T21:32:56.657 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:32:56.724 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=2250d0c37078a0d2da5df940e0407343 2024-08-24T21:32:56.725 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap49 - 2024-08-24T21:32:56.725 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:32:56.725 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:33:02.113 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:33:02.124 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=2250d0c37078a0d2da5df940e0407343 2024-08-24T21:33:02.124 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ 2250d0c37078a0d2da5df940e0407343 != \2\2\5\0\d\0\c\3\7\0\7\8\a\0\d\2\d\a\5\d\f\9\4\0\e\0\4\0\7\3\4\3 ]] 2024-08-24T21:33:02.124 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap49 2024-08-24T21:33:02.124 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap49 2024-08-24T21:33:02.124 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap49 2024-08-24T21:33:02.233 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:33:02.244 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:33:02.245 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap49 2024-08-24T21:33:02.246 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:33:02.327 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:33:02.327 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:33:02.327 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:33:02.327 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:33:02.327 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:33:02.327 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap50.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:33:03.416 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 18% complete... Importing image diff: 19% complete... Importing image diff: 20% complete... Importing image diff: 21% complete... Importing image diff: 22% complete... Importing image diff: 23% complete... Importing image diff: 24% complete... Importing image diff: 25% complete... Importing image diff: 26% complete... Importing image diff: 27% complete... Importing image diff: 45% complete... Importing image diff: 63% complete... Importing image diff: 81% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2024-08-24T21:33:03.437 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap50 - 2024-08-24T21:33:03.437 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:33:03.437 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:33:08.653 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:33:08.741 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=e0dfdb7e1df40aedb6e164f5b8a05a5c 2024-08-24T21:33:08.743 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap50 - 2024-08-24T21:33:08.743 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:33:08.743 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:33:12.492 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-08-24T21:33:12.492 INFO:tasks.ceph.mon.a:Restarting daemon 2024-08-24T21:33:12.492 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-08-24T21:33:12.497 INFO:tasks.ceph.mon.a:Started 2024-08-24T21:33:12.497 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:33:12.497 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:33:12.963 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":194,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":21,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:33:14.131 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:33:14.142 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=e0dfdb7e1df40aedb6e164f5b8a05a5c 2024-08-24T21:33:14.142 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ e0dfdb7e1df40aedb6e164f5b8a05a5c != \e\0\d\f\d\b\7\e\1\d\f\4\0\a\e\d\b\6\e\1\6\4\f\5\b\8\a\0\5\a\5\c ]] 2024-08-24T21:33:14.142 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap50 2024-08-24T21:33:14.142 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap50 2024-08-24T21:33:14.142 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap50 2024-08-24T21:33:14.247 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:33:14.259 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:33:14.260 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap50 2024-08-24T21:33:14.260 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:33:14.339 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:33:14.339 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:33:14.339 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:33:14.339 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:33:14.339 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:33:14.339 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap51.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:33:15.984 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:33:16.843 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":194,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":25,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:33:18.467 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 2% complete... Importing image diff: 5% complete... Importing image diff: 7% complete... Importing image diff: 10% complete... Importing image diff: 13% complete... Importing image diff: 15% complete... Importing image diff: 18% complete... Importing image diff: 21% complete... Importing image diff: 23% complete... Importing image diff: 26% complete... Importing image diff: 28% complete... Importing image diff: 31% complete... Importing image diff: 34% complete... Importing image diff: 36% complete... Importing image diff: 39% complete... Importing image diff: 42% complete... Importing image diff: 44% complete... Importing image diff: 47% complete... Importing image diff: 50% complete... Importing image diff: 52% complete... Importing image diff: 55% complete... Importing image diff: 57% complete... Importing image diff: 60% complete... Importing image diff: 63% complete... Importing image diff: 65% complete... Importing image diff: 68% complete... Importing image diff: 71% complete... Importing image diff: 73% complete... Importing image diff: 76% complete... Importing image diff: 78% complete... Importing image diff: 81% complete... Importing image diff: 84% complete... Importing image diff: 86% complete... Importing image diff: 89% complete... Importing image diff: 92% complete... Importing image diff: 94% complete... Importing image diff: 97% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2024-08-24T21:33:18.485 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap51 - 2024-08-24T21:33:18.485 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:33:18.485 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:33:19.885 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:33:20.351 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":194,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":29,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:33:23.373 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:33:23.732 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:33:23.810 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=bf095393e6a7b871adf5eb45fc727f6e 2024-08-24T21:33:23.811 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap51 - 2024-08-24T21:33:23.812 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:33:23.812 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:33:23.838 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":194,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":32,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:33:26.857 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:33:27.315 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":198,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:33:27.334 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:33:27.334 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:33:27.335 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:33:27.522 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:33:27.522 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:33:27.522 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:33:27.522 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:33:27.522 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 198, 2024-08-24T21:33:27.523 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 14876, 2024-08-24T21:33:27.523 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:33:27.523 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:33:27.523 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:33:27.523 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:33:27.523 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:33:27.523 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 2, 2024-08-24T21:33:27.523 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:33:27.523 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:33:27.523 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:33:27.523 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:33:27.523 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:33:27.524 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:33:27.524 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:33:27.524 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:33:27.524 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:33:27.524 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:33:27.524 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:33:27.524 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:33:27.524 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:33:27.524 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:33:27.524 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:33:27.524 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:33:27.524 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:33:27.524 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:33:27.525 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:33:27.525 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:33:27.525 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:33:27.525 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:33:27.525 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:33:27.525 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:33:27.525 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:33:27.525 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:33:27.525 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:33:27.525 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:33:27.525 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:33:27.526 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:27.526 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:33:27.526 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:33:27.526 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:33:27.526 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:33:27.526 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:33:27.526 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:33:27.526 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:33:27.526 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:33:27.526 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:33:27.526 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:33:27.526 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:33:27.527 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:33:27.527 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:33:27.527 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:33:27.527 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:33:27.527 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:33:27.527 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:33:27.527 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:33:27.527 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:33:27.527 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:33:27.527 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:33:27.527 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:33:27.527 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:33:27.528 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:33:27.528 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:33:27.528 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:33:27.528 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:33:27.528 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:33:27.528 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:33:27.528 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:33:27.528 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:27.528 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:33:27.528 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:27.528 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:33:27.528 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:33:27.528 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:33:27.529 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:33:27.529 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:27.529 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:33:27.529 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:33:27.529 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:33:27.529 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:27.529 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:27.529 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:33:27.529 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:33:27.529 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:33:27.529 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:33:27.529 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:33:27.529 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:27.530 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:33:27.530 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:33:27.530 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:33:27.530 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:33:27.530 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:33:27.530 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:27.530 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:27.530 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:33:27.530 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:33:27.530 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:33:27.530 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:33:27.530 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:27.531 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:33:27.531 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:33:27.531 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:33:27.531 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:27.531 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:27.531 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:33:27.531 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:33:27.531 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:33:27.531 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:33:27.531 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:33:27.531 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:27.531 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:33:27.531 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:33:27.532 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:33:27.532 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:33:27.532 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:33:27.532 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:27.532 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:27.532 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:33:27.532 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:33:27.532 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:33:27.532 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:33:27.532 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:27.532 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:33:27.532 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:33:27.533 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:33:27.533 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:27.533 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:27.533 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:33:27.533 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:33:27.533 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:33:27.533 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:33:27.533 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:33:27.533 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:27.533 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:33:27.533 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:33:27.533 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:33:27.533 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:33:27.534 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:33:27.534 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:33:27.534 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:33:27.534 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:27.534 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:33:27.534 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:33:27.534 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:27.534 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:33:27.534 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:33:27.534 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:33:27.534 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:33:27.534 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:33:27.535 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:33:27.535 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:27.535 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:33:27.535 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:33:27.535 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:33:27.535 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:33:27.535 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:33:27.535 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:27.535 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:33:27.535 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:33:27.539 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:33:27.539 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:33:27.539 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:33:27.726 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:33:27.726 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:33:27.726 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:33:27.726 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:33:27.726 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 198, 2024-08-24T21:33:27.727 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 288255, 2024-08-24T21:33:27.727 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:33:27.727 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:33:27.727 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:33:27.727 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:33:27.727 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:33:27.727 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 2, 2024-08-24T21:33:27.727 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:33:27.727 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:33:27.727 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:33:27.727 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:33:27.727 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:33:27.728 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:33:27.728 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:33:27.728 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:33:27.728 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:33:27.728 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:33:27.728 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:33:27.728 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:33:27.728 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:33:27.728 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:33:27.728 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:33:27.728 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:33:27.728 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:33:27.728 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:33:27.729 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:33:27.729 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:33:27.729 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:33:27.729 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:33:27.729 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:33:27.729 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:33:27.729 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:33:27.729 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:33:27.729 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:33:27.729 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:33:27.729 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:33:27.729 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:27.729 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:33:27.730 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:33:27.730 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:33:27.730 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:33:27.730 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:33:27.730 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:33:27.730 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:33:27.730 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:33:27.730 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:33:27.730 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:33:27.730 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:33:27.730 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:33:27.730 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:33:27.730 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:33:27.731 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:33:27.731 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:33:27.731 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:33:27.731 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:33:27.731 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:33:27.731 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:33:27.731 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:33:27.731 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:33:27.731 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:33:27.731 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:33:27.731 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:33:27.731 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:33:27.732 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:33:27.732 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:33:27.732 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:33:27.732 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:33:27.732 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:27.732 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:33:27.732 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:27.732 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:33:27.732 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:33:27.732 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:33:27.732 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:33:27.732 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:27.732 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:33:27.732 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:33:27.733 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:33:27.733 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:27.733 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:27.733 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:33:27.733 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:33:27.733 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:33:27.733 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:33:27.733 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:33:27.733 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:27.733 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:33:27.733 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:33:27.733 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:33:27.734 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:33:27.734 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:33:27.734 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:27.734 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:27.734 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:33:27.734 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:33:27.734 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:33:27.734 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:33:27.734 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:27.734 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:33:27.734 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:33:27.734 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:33:27.734 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:27.735 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:27.735 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:33:27.735 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:33:27.735 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:33:27.735 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:33:27.735 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:33:27.735 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:27.735 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:33:27.735 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:33:27.735 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:33:27.735 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:33:27.735 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:33:27.736 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:27.736 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:27.736 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:33:27.736 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:33:27.736 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:33:27.736 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:33:27.736 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:27.736 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:33:27.736 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:33:27.736 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:33:27.736 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:27.736 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:27.736 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:33:27.736 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:33:27.737 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:33:27.737 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:33:27.737 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:33:27.737 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:27.737 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:33:27.737 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:33:27.737 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:33:27.737 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:33:27.737 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:33:27.737 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:33:27.737 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:33:27.737 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:27.738 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:33:27.738 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:33:27.738 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:27.738 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:33:27.738 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:33:27.738 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:33:27.738 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:33:27.738 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:33:27.738 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:33:27.738 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:27.738 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:33:27.738 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:33:27.738 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 7 2024-08-24T21:33:27.739 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:33:27.739 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:33:27.739 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:33:27.739 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:27.739 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:33:27.739 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:33:27.739 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-08-24T21:33:27.739 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:33:27.739 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:33:27.739 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:33:27.739 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:27.739 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:33:27.740 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:33:27.740 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:33:27.740 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:33:27.740 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:33:27.740 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:27.740 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:33:27.740 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:33:27.742 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:33:27.742 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:33:27.742 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:33:27.928 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:33:27.928 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:33:27.928 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:33:27.928 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:33:27.928 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 198, 2024-08-24T21:33:27.928 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 128526, 2024-08-24T21:33:27.928 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:33:27.928 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:33:27.928 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:33:27.928 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:33:27.928 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:33:27.929 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 2, 2024-08-24T21:33:27.929 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:33:27.929 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:33:27.929 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:33:27.929 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:33:27.929 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:33:27.929 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:33:27.929 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:33:27.929 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:33:27.929 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:33:27.929 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:33:27.929 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:33:27.929 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:33:27.930 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:33:27.930 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:33:27.930 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:33:27.930 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:33:27.930 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:33:27.930 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:33:27.930 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:33:27.930 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:33:27.930 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:33:27.930 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:33:27.930 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:33:27.930 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:33:27.930 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:33:27.931 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:33:27.931 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:33:27.931 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:33:27.931 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:33:27.931 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:27.931 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:33:27.931 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:33:27.931 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:33:27.931 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:33:27.931 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:33:27.931 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:33:27.931 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:33:27.931 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:33:27.932 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:33:27.932 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:33:27.932 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:33:27.932 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:33:27.932 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:33:27.932 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:33:27.932 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:33:27.932 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:33:27.932 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:33:27.932 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:33:27.932 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:33:27.932 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:33:27.932 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:33:27.933 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:33:27.933 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:33:27.933 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:33:27.933 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:33:27.933 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:33:27.933 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:33:27.933 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:33:27.933 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:33:27.933 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:33:27.933 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:27.933 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:33:27.933 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:27.933 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:33:27.933 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:33:27.934 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:33:27.934 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:33:27.934 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:27.934 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:33:27.934 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:33:27.934 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:33:27.934 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:27.934 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:27.934 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:33:27.934 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:33:27.934 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:33:27.934 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:33:27.934 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:33:27.935 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:27.935 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:33:27.935 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:33:27.935 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:33:27.935 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:33:27.935 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:33:27.936 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:27.936 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:27.936 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:33:27.936 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:33:27.936 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:33:27.936 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:33:27.936 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:27.936 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:33:27.936 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:33:27.936 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:33:27.936 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:27.936 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:27.937 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:33:27.937 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:33:27.937 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:33:27.937 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:33:27.937 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:33:27.937 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:27.937 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:33:27.937 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:33:27.937 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:33:27.937 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:33:27.937 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:33:27.937 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:27.937 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:27.937 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:33:27.938 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:33:27.938 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:33:27.938 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:33:27.938 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:27.938 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:33:27.938 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:33:27.938 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:33:27.938 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:27.938 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:27.938 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:33:27.938 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:33:27.938 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:33:27.938 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:33:27.939 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:33:27.939 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:27.939 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:33:27.939 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:33:27.939 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:33:27.939 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:33:27.939 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:33:27.939 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:33:27.939 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:33:27.939 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:27.939 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:33:27.939 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:33:27.939 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:27.940 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:33:27.940 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:33:27.940 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:33:27.940 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:33:27.940 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:33:27.940 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:33:27.940 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:27.940 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:33:27.940 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:33:27.940 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:33:27.940 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:33:27.940 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:33:27.940 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:33:27.941 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:27.941 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:33:27.941 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:33:27.941 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:33:27.941 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:33:27.941 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:33:27.941 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:27.941 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:33:27.941 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:33:27.943 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:33:27.943 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-08-24T21:33:27.944 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-08-24T21:33:28.427 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-08-24T21:33:29.178 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:33:29.189 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=bf095393e6a7b871adf5eb45fc727f6e 2024-08-24T21:33:29.189 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ bf095393e6a7b871adf5eb45fc727f6e != \b\f\0\9\5\3\9\3\e\6\a\7\b\8\7\1\a\d\f\5\e\b\4\5\f\c\7\2\7\f\6\e ]] 2024-08-24T21:33:29.189 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap51 2024-08-24T21:33:29.189 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap51 2024-08-24T21:33:29.189 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap51 2024-08-24T21:33:29.295 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:33:29.306 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:33:29.308 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap51 2024-08-24T21:33:29.308 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:33:29.385 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:33:29.385 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:33:29.385 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:33:29.385 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:33:29.385 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:33:29.385 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap52.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:33:29.428 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:33:29.428 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:33:30.139 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":198,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:33:30.156 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:33:30.156 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-08-24T21:33:30.156 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:33:30.157 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:33:30.333 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:33:30.334 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:33:30.334 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:33:30.334 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:33:30.334 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 198, 2024-08-24T21:33:30.334 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 17687, 2024-08-24T21:33:30.334 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:33:30.334 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:33:30.334 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:33:30.334 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:33:30.334 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:33:30.334 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 5, 2024-08-24T21:33:30.334 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:33:30.335 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:33:30.335 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:33:30.335 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:33:30.335 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:33:30.335 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:33:30.335 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:33:30.335 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:33:30.335 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:33:30.335 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:33:30.335 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:33:30.335 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:33:30.335 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:33:30.335 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:33:30.336 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:33:30.336 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:33:30.336 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:33:30.336 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:33:30.336 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:33:30.336 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:33:30.336 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:33:30.336 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:33:30.336 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:33:30.336 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:33:30.336 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:33:30.336 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:33:30.336 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:33:30.336 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:33:30.337 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:33:30.337 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:30.337 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:33:30.337 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:33:30.337 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:33:30.337 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:33:30.337 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:33:30.337 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:33:30.337 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:33:30.337 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:33:30.337 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:33:30.337 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:33:30.338 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:33:30.338 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:33:30.338 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:33:30.338 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:33:30.338 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:33:30.338 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:33:30.338 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:33:30.338 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:33:30.338 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:33:30.338 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:33:30.338 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:33:30.338 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:33:30.338 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:33:30.339 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:33:30.339 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:33:30.339 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:33:30.339 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:33:30.339 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:33:30.339 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:33:30.339 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:33:30.339 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:30.339 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:33:30.339 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:30.339 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:33:30.339 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:33:30.339 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:33:30.342 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:33:30.342 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:30.342 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:33:30.342 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:33:30.342 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:33:30.342 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:30.342 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:30.342 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:33:30.343 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:33:30.343 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:33:30.343 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:33:30.343 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:33:30.343 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:30.343 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:33:30.343 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:33:30.343 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:33:30.343 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:33:30.343 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:33:30.343 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:30.343 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:30.344 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:33:30.344 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:33:30.344 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:33:30.344 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:33:30.344 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:30.344 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:33:30.344 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:33:30.344 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:33:30.344 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:30.344 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:30.344 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:33:30.344 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:33:30.345 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:33:30.345 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:33:30.345 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:33:30.345 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:30.345 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:33:30.345 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:33:30.345 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:33:30.345 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:33:30.345 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:33:30.345 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:30.345 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:30.345 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:33:30.345 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:33:30.346 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:33:30.346 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:33:30.346 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:30.346 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:33:30.346 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:33:30.346 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:33:30.346 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:30.346 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:30.346 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:33:30.346 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:33:30.346 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:33:30.346 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:33:30.346 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:33:30.347 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:30.347 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:33:30.347 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:33:30.347 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:33:30.347 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:33:30.347 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:33:30.347 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:33:30.347 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:33:30.347 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:30.347 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:33:30.347 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:33:30.347 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:30.347 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:33:30.348 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:33:30.348 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:33:30.348 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:33:30.348 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:33:30.348 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:33:30.348 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:30.348 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:33:30.348 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:33:30.348 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:33:30.348 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:33:30.348 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:33:30.348 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:30.348 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:33:30.348 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:33:30.349 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:33:30.350 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:33:30.350 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:33:30.377 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 1% complete... Importing image diff: 2% complete... Importing image diff: 3% complete... Importing image diff: 4% complete... Importing image diff: 5% complete... Importing image diff: 6% complete... Importing image diff: 7% complete... Importing image diff: 8% complete... Importing image diff: 9% complete... Importing image diff: 10% complete... Importing image diff: 11% complete... Importing image diff: 12% complete... Importing image diff: 13% complete... Importing image diff: 41% complete... Importing image diff: 42% complete... Importing image diff: 43% complete... Importing image diff: 44% complete... Importing image diff: 72% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2024-08-24T21:33:30.397 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap52 - 2024-08-24T21:33:30.397 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:33:30.397 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:33:30.556 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:33:30.556 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:33:30.556 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:33:30.556 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:33:30.557 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 198, 2024-08-24T21:33:30.557 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 291085, 2024-08-24T21:33:30.557 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:33:30.557 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:33:30.557 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:33:30.557 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:33:30.557 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:33:30.557 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 5, 2024-08-24T21:33:30.557 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:33:30.557 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:33:30.557 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:33:30.557 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:33:30.558 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:33:30.558 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:33:30.558 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:33:30.558 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:33:30.558 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:33:30.558 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:33:30.558 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:33:30.558 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:33:30.558 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:33:30.558 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:33:30.558 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:33:30.558 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:33:30.558 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:33:30.559 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:33:30.559 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:33:30.559 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:33:30.559 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:33:30.559 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:33:30.559 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:33:30.559 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:33:30.559 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:33:30.559 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:33:30.559 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:33:30.559 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:33:30.559 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:33:30.559 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:30.560 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:33:30.560 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:33:30.560 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:33:30.560 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:33:30.560 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:33:30.560 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:33:30.560 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:33:30.560 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:33:30.560 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:33:30.560 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:33:30.560 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:33:30.560 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:33:30.560 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:33:30.561 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:33:30.561 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:33:30.561 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:33:30.561 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:33:30.561 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:33:30.561 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:33:30.561 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:33:30.561 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:33:30.561 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:33:30.561 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:33:30.561 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:33:30.561 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:33:30.561 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:33:30.562 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:33:30.562 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:33:30.562 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:33:30.562 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:33:30.562 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:30.562 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:33:30.562 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:30.562 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:33:30.562 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:33:30.562 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:33:30.562 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:33:30.562 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:30.563 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:33:30.563 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:33:30.563 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:33:30.563 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:30.563 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:30.563 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:33:30.563 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:33:30.563 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:33:30.563 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:33:30.563 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:33:30.563 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:30.563 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:33:30.563 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:33:30.564 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:33:30.564 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:33:30.564 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:33:30.564 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:30.564 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:30.564 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:33:30.564 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:33:30.564 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:33:30.564 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:33:30.564 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:30.564 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:33:30.564 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:33:30.564 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:33:30.565 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:30.565 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:30.565 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:33:30.565 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:33:30.565 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:33:30.565 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:33:30.565 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:33:30.565 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:30.565 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:33:30.565 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:33:30.565 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:33:30.565 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:33:30.565 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:33:30.566 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:30.566 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:30.566 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:33:30.566 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:33:30.566 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:33:30.566 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:33:30.566 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:30.566 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:33:30.566 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:33:30.566 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:33:30.566 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:30.566 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:30.566 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:33:30.567 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:33:30.567 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:33:30.567 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:33:30.567 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:33:30.567 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:30.567 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:33:30.567 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:33:30.567 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:33:30.567 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:33:30.567 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:33:30.567 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:33:30.567 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:33:30.567 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:30.567 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:33:30.568 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:33:30.568 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:30.568 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:33:30.568 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:33:30.568 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:33:30.568 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:33:30.568 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:33:30.568 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:33:30.568 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:30.568 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:33:30.568 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:33:30.568 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 7 2024-08-24T21:33:30.568 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:33:30.569 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:33:30.569 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:33:30.569 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:30.569 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:33:30.569 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:33:30.569 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:33:30.569 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:33:30.569 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:33:30.569 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:33:30.569 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:30.569 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:33:30.569 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:33:30.569 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:33:30.570 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:33:30.570 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:33:30.570 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:30.570 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:33:30.570 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:33:30.573 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:33:30.573 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:33:30.573 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:33:30.765 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:33:30.765 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:33:30.766 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:33:30.766 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:33:30.766 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 198, 2024-08-24T21:33:30.766 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 131364, 2024-08-24T21:33:30.766 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:33:30.766 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:33:30.766 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:33:30.766 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:33:30.766 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:33:30.766 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 5, 2024-08-24T21:33:30.766 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:33:30.766 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:33:30.767 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:33:30.767 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:33:30.767 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:33:30.767 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:33:30.767 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:33:30.767 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:33:30.767 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:33:30.767 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:33:30.767 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:33:30.767 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:33:30.767 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:33:30.767 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:33:30.767 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:33:30.767 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:33:30.768 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:33:30.768 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:33:30.768 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:33:30.768 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:33:30.768 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:33:30.768 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:33:30.768 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:33:30.768 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:33:30.768 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:33:30.768 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:33:30.768 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:33:30.768 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:33:30.768 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:33:30.769 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:30.769 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:33:30.769 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:33:30.769 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:33:30.769 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:33:30.769 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:33:30.769 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:33:30.769 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:33:30.769 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:33:30.769 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:33:30.769 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:33:30.769 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:33:30.769 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:33:30.770 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:33:30.770 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:33:30.770 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:33:30.770 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:33:30.770 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:33:30.770 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:33:30.770 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:33:30.770 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:33:30.770 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:33:30.770 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:33:30.770 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:33:30.770 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:33:30.770 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:33:30.771 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:33:30.771 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:33:30.771 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:33:30.771 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:33:30.771 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:33:30.771 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:30.771 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:33:30.771 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:30.771 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:33:30.771 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:33:30.771 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:33:30.771 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:33:30.771 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:30.772 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:33:30.772 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:33:30.772 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:33:30.772 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:30.772 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:30.772 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:33:30.772 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:33:30.772 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:33:30.772 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:33:30.772 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:33:30.772 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:30.772 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:33:30.772 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:33:30.773 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:33:30.773 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:33:30.773 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:33:30.773 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:30.773 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:30.773 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:33:30.773 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:33:30.773 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:33:30.773 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:33:30.773 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:30.773 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:33:30.773 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:33:30.773 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:33:30.774 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:30.774 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:30.774 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:33:30.774 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:33:30.774 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:33:30.774 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:33:30.774 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:33:30.774 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:30.774 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:33:30.774 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:33:30.774 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:33:30.774 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:33:30.774 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:33:30.775 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:30.775 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:30.775 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:33:30.775 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:33:30.775 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:33:30.775 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:33:30.775 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:30.775 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:33:30.775 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:33:30.775 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:33:30.775 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:30.775 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:30.775 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:33:30.775 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:33:30.776 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:33:30.776 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:33:30.776 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:33:30.776 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:30.776 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:33:30.776 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:33:30.776 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:33:30.776 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:33:30.776 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:33:30.776 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:33:30.776 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:33:30.776 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:30.776 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:33:30.776 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:33:30.777 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:30.777 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:33:30.777 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:33:30.777 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:33:30.777 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:33:30.777 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:33:30.777 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:33:30.777 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:30.777 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:33:30.777 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:33:30.777 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:33:30.778 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:33:30.778 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:33:30.778 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:33:30.778 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:30.778 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:33:30.778 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:33:30.778 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:33:30.778 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:33:30.778 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:33:30.778 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:30.778 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:33:30.778 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:33:30.780 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:33:30.780 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-08-24T21:33:30.780 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['b'] 2024-08-24T21:33:30.780 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-08-24T21:33:30.780 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-08-24T21:33:30.780 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-08-24T21:33:30.780 INFO:teuthology.orchestra.run:waiting for 300 2024-08-24T21:33:30.798 INFO:tasks.ceph.mon.a:Stopped 2024-08-24T21:33:30.798 INFO:tasks.mon_thrash:Sending STOP to mon b 2024-08-24T21:33:30.799 INFO:tasks.ceph.mon.b:Sent signal 19 2024-08-24T21:33:30.799 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-08-24T21:33:35.540 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:33:35.618 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=b0964d8aa62de06be95fd9dc5741b34e 2024-08-24T21:33:35.619 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap52 - 2024-08-24T21:33:35.619 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:33:35.620 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:33:41.013 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:33:41.023 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=b0964d8aa62de06be95fd9dc5741b34e 2024-08-24T21:33:41.023 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ b0964d8aa62de06be95fd9dc5741b34e != \b\0\9\6\4\d\8\a\a\6\2\d\e\0\6\b\e\9\5\f\d\9\d\c\5\7\4\1\b\3\4\e ]] 2024-08-24T21:33:41.023 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap52 2024-08-24T21:33:41.024 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap52 2024-08-24T21:33:41.024 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap52 2024-08-24T21:33:45.799 INFO:tasks.mon_thrash:Sending CONT to mon b 2024-08-24T21:33:45.800 INFO:tasks.ceph.mon.b:Sent signal 18 2024-08-24T21:33:45.800 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-08-24T21:33:45.800 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:33:51.109 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":200,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:33:51.131 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-08-24T21:33:51.131 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-08-24T21:33:51.131 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:33:51.311 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:33:51.311 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:33:51.311 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:33:51.311 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:33:51.312 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 200, 2024-08-24T21:33:51.312 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 311841, 2024-08-24T21:33:51.312 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:33:51.312 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:33:51.312 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:33:51.312 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:33:51.312 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:33:51.312 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:33:51.312 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:33:51.313 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:33:51.313 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:33:51.313 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:33:51.313 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:33:51.313 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:33:51.313 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:33:51.313 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:33:51.313 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:33:51.313 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:33:51.313 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:33:51.313 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:33:51.313 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:33:51.313 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:33:51.314 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:33:51.314 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:33:51.314 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:33:51.314 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:33:51.314 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:33:51.314 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:33:51.314 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:33:51.314 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:33:51.315 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:33:51.315 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:33:51.315 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:33:51.315 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:33:51.315 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:33:51.315 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:33:51.316 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:51.316 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:33:51.316 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:33:51.316 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:33:51.316 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:33:51.316 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:33:51.316 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:33:51.316 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:33:51.316 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:33:51.316 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:33:51.317 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:33:51.317 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:33:51.317 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:33:51.317 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:33:51.317 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:33:51.317 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:33:51.317 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:33:51.317 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:33:51.317 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:33:51.317 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:33:51.317 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:33:51.317 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:33:51.317 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:33:51.318 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:33:51.318 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:33:51.318 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:33:51.318 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:33:51.318 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:33:51.318 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:33:51.318 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:33:51.318 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:33:51.318 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:51.319 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:33:51.319 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:51.319 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:33:51.319 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:33:51.319 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:33:51.319 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:33:51.319 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:51.319 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:33:51.319 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:33:51.319 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:33:51.319 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:51.319 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:51.319 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:33:51.320 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:33:51.320 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:33:51.320 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:33:51.320 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:33:51.320 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:51.320 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:33:51.320 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:33:51.320 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:33:51.320 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:33:51.320 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:33:51.320 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:51.320 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:51.320 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:33:51.321 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:33:51.321 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:33:51.321 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:33:51.321 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:51.321 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:33:51.322 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:33:51.322 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:33:51.322 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:51.322 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:51.322 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:33:51.322 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:33:51.322 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:33:51.322 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:33:51.322 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:33:51.322 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:51.322 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:33:51.322 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:33:51.323 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:33:51.323 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:33:51.323 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:33:51.323 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:51.323 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:51.323 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:33:51.323 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:33:51.323 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:33:51.323 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:33:51.323 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:51.323 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:33:51.324 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:33:51.324 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:33:51.324 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:51.324 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:51.324 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:33:51.324 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:33:51.324 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:33:51.324 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:33:51.324 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:33:51.324 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:51.324 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:33:51.324 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:33:51.325 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:33:51.325 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:33:51.325 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:33:51.325 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:33:51.325 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:33:51.325 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:51.325 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:33:51.325 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:33:51.325 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:51.325 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:33:51.325 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:33:51.325 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:33:51.326 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:33:51.326 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:33:51.326 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:33:51.326 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:51.327 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:33:51.327 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:33:51.327 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 7 2024-08-24T21:33:51.327 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:33:51.327 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:33:51.327 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:33:51.327 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:51.327 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:33:51.327 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:33:51.327 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-08-24T21:33:51.328 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:33:51.328 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:33:51.328 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:33:51.328 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:51.328 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:33:51.328 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:33:51.328 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:33:51.328 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:33:51.328 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:33:51.328 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:51.328 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:33:51.328 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:33:51.330 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:33:51.330 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-08-24T21:33:51.330 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:33:51.508 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:33:51.509 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:33:51.509 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:33:51.509 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:33:51.510 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 200, 2024-08-24T21:33:51.510 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 152108, 2024-08-24T21:33:51.510 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:33:51.510 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:33:51.510 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:33:51.510 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:33:51.511 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:33:51.511 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:33:51.511 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:33:51.511 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:33:51.511 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:33:51.511 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:33:51.512 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:33:51.512 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:33:51.512 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:33:51.512 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:33:51.512 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:33:51.512 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:33:51.513 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:33:51.513 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:33:51.513 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:33:51.513 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:33:51.513 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:33:51.514 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:33:51.514 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:33:51.514 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:33:51.514 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:33:51.514 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:33:51.514 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:33:51.515 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:33:51.515 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:33:51.515 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:33:51.515 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:33:51.515 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:33:51.515 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:33:51.516 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:33:51.516 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:51.516 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:33:51.516 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:33:51.516 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:33:51.516 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:33:51.516 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:33:51.516 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:33:51.516 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:33:51.516 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:33:51.517 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:33:51.517 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:33:51.517 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:33:51.517 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:33:51.517 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:33:51.518 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:33:51.518 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:33:51.518 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:33:51.518 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:33:51.518 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:33:51.518 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:33:51.519 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:33:51.519 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:33:51.519 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:33:51.519 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:33:51.519 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:33:51.519 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:33:51.519 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:33:51.520 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:33:51.520 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:33:51.520 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:33:51.520 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:33:51.520 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:51.521 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:33:51.521 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:51.521 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:33:51.521 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:33:51.521 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:33:51.521 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:33:51.521 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:51.522 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:33:51.522 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:33:51.522 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:33:51.522 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:51.522 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:51.522 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:33:51.522 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:33:51.523 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:33:51.523 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:33:51.523 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:33:51.523 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:51.523 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:33:51.523 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:33:51.523 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:33:51.524 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:33:51.524 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:33:51.524 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:51.524 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:51.524 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:33:51.524 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:33:51.524 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:33:51.525 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:33:51.525 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:51.525 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:33:51.525 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:33:51.526 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:33:51.526 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:51.526 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:51.526 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:33:51.526 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:33:51.526 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:33:51.527 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:33:51.527 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:33:51.527 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:51.527 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:33:51.527 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:33:51.528 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:33:51.528 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:33:51.528 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:33:51.528 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:51.528 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:51.528 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:33:51.529 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:33:51.529 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:33:51.529 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:33:51.529 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:51.529 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:33:51.529 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:33:51.529 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:33:51.530 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:51.530 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:51.530 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:33:51.530 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:33:51.530 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:33:51.530 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:33:51.531 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:33:51.531 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:51.531 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:33:51.531 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:33:51.531 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:33:51.531 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:33:51.531 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:33:51.531 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:33:51.531 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:33:51.532 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:51.532 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:33:51.532 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:33:51.532 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:51.532 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:33:51.532 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:33:51.532 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:33:51.533 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:33:51.533 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:33:51.533 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:33:51.533 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:51.533 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:33:51.533 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:33:51.533 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:33:51.534 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:33:51.534 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:33:51.534 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:33:51.534 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:33:51.534 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:33:51.534 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:33:51.534 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:33:51.535 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:33:51.535 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:33:51.535 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:33:51.535 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:33:51.535 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:33:51.536 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:33:51.536 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-08-24T21:33:51.897 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:33:51.910 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:33:51.911 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap52 2024-08-24T21:33:51.911 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:33:52.003 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:33:52.003 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:33:52.003 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:33:52.003 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:33:52.003 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:33:52.004 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap53.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:33:52.899 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 1% complete... Importing image diff: 2% complete... Importing image diff: 3% complete... Importing image diff: 4% complete... Importing image diff: 5% complete... Importing image diff: 6% complete... Importing image diff: 7% complete... Importing image diff: 8% complete... Importing image diff: 9% complete... Importing image diff: 10% complete... Importing image diff: 11% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2024-08-24T21:33:52.919 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap53 - 2024-08-24T21:33:52.920 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:33:52.920 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:33:58.110 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:33:58.192 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=00825c99c11d42cd9f07419eccd23a9b 2024-08-24T21:33:58.193 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap53 - 2024-08-24T21:33:58.193 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:33:58.193 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:34:03.611 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:34:03.621 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=00825c99c11d42cd9f07419eccd23a9b 2024-08-24T21:34:03.621 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ 00825c99c11d42cd9f07419eccd23a9b != \0\0\8\2\5\c\9\9\c\1\1\d\4\2\c\d\9\f\0\7\4\1\9\e\c\c\d\2\3\a\9\b ]] 2024-08-24T21:34:03.621 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap53 2024-08-24T21:34:03.621 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap53 2024-08-24T21:34:03.621 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap53 2024-08-24T21:34:03.728 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:34:03.739 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:34:03.741 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap53 2024-08-24T21:34:03.741 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:34:03.828 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:34:03.828 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:34:03.828 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:34:03.828 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:34:03.828 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:34:03.828 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap54.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:34:04.987 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2024-08-24T21:34:05.008 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap54 - 2024-08-24T21:34:05.008 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:34:05.009 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:34:10.215 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:34:10.290 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=5ba35c17f68589d0ff6ed3d1dd376d2c 2024-08-24T21:34:10.291 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap54 - 2024-08-24T21:34:10.292 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:34:10.292 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:34:11.537 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-08-24T21:34:11.537 INFO:tasks.ceph.mon.a:Restarting daemon 2024-08-24T21:34:11.538 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-08-24T21:34:11.542 INFO:tasks.ceph.mon.a:Started 2024-08-24T21:34:11.543 INFO:tasks.mon_thrash:Sending STOP to mon b 2024-08-24T21:34:11.543 INFO:tasks.ceph.mon.b:Sent signal 19 2024-08-24T21:34:11.543 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-08-24T21:34:15.714 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:34:15.724 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=5ba35c17f68589d0ff6ed3d1dd376d2c 2024-08-24T21:34:15.724 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ 5ba35c17f68589d0ff6ed3d1dd376d2c != \5\b\a\3\5\c\1\7\f\6\8\5\8\9\d\0\f\f\6\e\d\3\d\1\d\d\3\7\6\d\2\c ]] 2024-08-24T21:34:15.724 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap54 2024-08-24T21:34:15.724 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap54 2024-08-24T21:34:15.725 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap54 2024-08-24T21:34:15.831 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:34:15.842 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:34:15.843 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap54 2024-08-24T21:34:15.844 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:34:15.921 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:34:15.921 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:34:15.921 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:34:15.921 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:34:15.921 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:34:15.922 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap55.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:34:24.007 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 24% complete... Importing image diff: 25% complete... Importing image diff: 26% complete... Importing image diff: 27% complete... Importing image diff: 51% complete... Importing image diff: 75% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2024-08-24T21:34:24.025 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap55 - 2024-08-24T21:34:24.026 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:34:24.026 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:34:26.544 INFO:tasks.mon_thrash:Sending CONT to mon b 2024-08-24T21:34:26.545 INFO:tasks.ceph.mon.b:Sent signal 18 2024-08-24T21:34:26.545 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:34:26.545 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:34:27.244 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":208,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:34:27.262 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:34:27.263 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:34:27.263 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:34:27.461 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:34:27.462 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:34:27.462 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:34:27.462 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:34:27.462 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 208, 2024-08-24T21:34:27.462 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 15776, 2024-08-24T21:34:27.462 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:34:27.462 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:34:27.462 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:34:27.462 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:34:27.462 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:34:27.463 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:34:27.463 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:34:27.463 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:34:27.463 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:34:27.463 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:34:27.463 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:34:27.463 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:34:27.463 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:34:27.463 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:34:27.463 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:34:27.463 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:34:27.463 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:34:27.463 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:34:27.463 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:34:27.464 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:34:27.464 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:34:27.464 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:34:27.464 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:34:27.464 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:34:27.464 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:34:27.464 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:34:27.464 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:34:27.464 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:34:27.464 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:34:27.464 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:34:27.464 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:34:27.464 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:34:27.464 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:34:27.464 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:34:27.465 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:34:27.465 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:27.465 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:34:27.465 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:34:27.465 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:34:27.465 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:34:27.465 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:34:27.465 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:34:27.465 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:34:27.465 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:34:27.465 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:34:27.465 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:34:27.466 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:34:27.466 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:34:27.466 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:34:27.466 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:34:27.466 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:34:27.466 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:34:27.466 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:34:27.466 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:34:27.466 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:34:27.466 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:34:27.466 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:34:27.466 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:34:27.467 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:34:27.467 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:34:27.467 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:34:27.467 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:34:27.467 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:34:27.467 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:34:27.467 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:34:27.467 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:34:27.467 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:27.467 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:34:27.467 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:27.467 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:34:27.467 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:34:27.467 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:34:27.468 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:34:27.468 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:27.468 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:34:27.468 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:34:27.468 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:34:27.468 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:27.468 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:27.468 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:34:27.468 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:34:27.468 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:34:27.468 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:34:27.468 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:34:27.468 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:27.469 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:34:27.469 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:34:27.469 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:34:27.469 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:34:27.469 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:34:27.469 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:27.469 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:27.469 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:34:27.469 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:34:27.469 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:34:27.469 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:34:27.469 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:27.469 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:34:27.469 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:34:27.469 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:34:27.470 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:27.470 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:27.470 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:34:27.470 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:34:27.470 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:34:27.470 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:34:27.470 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:34:27.470 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:27.470 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:34:27.470 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:34:27.470 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:34:27.470 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:34:27.471 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:34:27.471 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:27.471 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:27.471 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:34:27.471 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:34:27.471 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:34:27.471 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:34:27.471 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:27.471 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:34:27.471 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:34:27.471 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:34:27.471 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:27.472 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:27.472 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:34:27.472 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:34:27.472 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:34:27.472 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:34:27.472 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:34:27.472 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:27.472 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:34:27.472 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:34:27.472 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:34:27.472 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:34:27.472 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:34:27.472 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:34:27.472 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:34:27.472 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:27.473 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:34:27.473 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:34:27.473 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:27.473 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:34:27.473 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:34:27.473 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:34:27.473 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:34:27.473 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:34:27.473 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:34:27.473 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:27.474 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:34:27.474 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:34:27.474 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:34:27.474 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:34:27.474 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:34:27.474 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:27.474 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:34:27.474 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:34:27.479 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:34:27.479 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:34:27.479 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:34:27.668 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:34:27.668 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:34:27.668 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:34:27.668 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:34:27.668 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 208, 2024-08-24T21:34:27.668 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 348196, 2024-08-24T21:34:27.668 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:34:27.668 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:34:27.668 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:34:27.669 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:34:27.669 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:34:27.669 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:34:27.669 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:34:27.669 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:34:27.669 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:34:27.669 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:34:27.669 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:34:27.669 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:34:27.669 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:34:27.669 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:34:27.669 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:34:27.669 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:34:27.670 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:34:27.670 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:34:27.670 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:34:27.670 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:34:27.670 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:34:27.670 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:34:27.670 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:34:27.670 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:34:27.670 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:34:27.670 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:34:27.670 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:34:27.670 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:34:27.671 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:34:27.671 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:34:27.671 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:34:27.671 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:34:27.671 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:34:27.671 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:34:27.671 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:34:27.671 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:27.671 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:34:27.671 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:34:27.671 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:34:27.671 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:34:27.672 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:34:27.672 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:34:27.672 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:34:27.672 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:34:27.672 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:34:27.672 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:34:27.672 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:34:27.672 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:34:27.672 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:34:27.672 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:34:27.672 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:34:27.672 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:34:27.673 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:34:27.673 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:34:27.673 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:34:27.673 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:34:27.673 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:34:27.673 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:34:27.673 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:34:27.673 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:34:27.673 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:34:27.673 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:34:27.673 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:34:27.673 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:34:27.673 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:34:27.674 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:34:27.674 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:27.674 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:34:27.674 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:27.674 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:34:27.674 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:34:27.674 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:34:27.674 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:34:27.674 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:27.674 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:34:27.674 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:34:27.674 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:34:27.674 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:27.675 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:27.675 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:34:27.675 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:34:27.675 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:34:27.675 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:34:27.675 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:34:27.675 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:27.675 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:34:27.675 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:34:27.675 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:34:27.675 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:34:27.675 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:34:27.676 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:27.676 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:27.676 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:34:27.676 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:34:27.676 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:34:27.676 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:34:27.676 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:27.676 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:34:27.676 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:34:27.676 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:34:27.676 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:27.676 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:27.676 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:34:27.677 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:34:27.677 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:34:27.677 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:34:27.677 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:34:27.677 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:27.677 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:34:27.677 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:34:27.677 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:34:27.677 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:34:27.677 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:34:27.677 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:27.677 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:27.678 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:34:27.678 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:34:27.678 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:34:27.678 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:34:27.678 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:27.678 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:34:27.678 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:34:27.678 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:34:27.678 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:27.678 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:27.678 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:34:27.678 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:34:27.679 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:34:27.679 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:34:27.679 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:34:27.679 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:27.679 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:34:27.679 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:34:27.679 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:34:27.679 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:34:27.679 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:34:27.679 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:34:27.679 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:34:27.679 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:27.680 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:34:27.680 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:34:27.680 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:27.680 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:34:27.680 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:34:27.680 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:34:27.680 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:34:27.680 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:34:27.680 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:34:27.680 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:27.680 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:34:27.680 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:34:27.680 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 7 2024-08-24T21:34:27.681 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:34:27.681 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:34:27.681 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:34:27.681 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:27.681 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:34:27.681 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:34:27.681 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:34:27.681 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:34:27.681 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:34:27.681 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:34:27.681 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:27.681 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:34:27.681 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:34:27.682 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:34:27.682 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:34:27.682 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:34:27.682 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:27.682 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:34:27.682 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:34:27.683 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:34:27.683 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:34:27.683 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:34:27.859 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:34:27.860 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:34:27.860 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:34:27.860 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:34:27.860 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 208, 2024-08-24T21:34:27.860 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 188459, 2024-08-24T21:34:27.860 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:34:27.860 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:34:27.860 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:34:27.860 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:34:27.860 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:34:27.860 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:34:27.861 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:34:27.861 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:34:27.861 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:34:27.861 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:34:27.861 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:34:27.861 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:34:27.861 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:34:27.861 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:34:27.861 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:34:27.861 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:34:27.861 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:34:27.861 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:34:27.861 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:34:27.862 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:34:27.862 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:34:27.862 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:34:27.862 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:34:27.862 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:34:27.862 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:34:27.862 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:34:27.862 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:34:27.862 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:34:27.862 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:34:27.862 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:34:27.862 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:34:27.863 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:34:27.863 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:34:27.863 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:34:27.863 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:34:27.863 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:27.863 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:34:27.863 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:34:27.863 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:34:27.863 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:34:27.863 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:34:27.863 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:34:27.863 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:34:27.864 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:34:27.864 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:34:27.864 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:34:27.864 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:34:27.864 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:34:27.864 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:34:27.864 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:34:27.864 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:34:27.864 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:34:27.864 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:34:27.864 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:34:27.864 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:34:27.864 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:34:27.865 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:34:27.865 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:34:27.865 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:34:27.865 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:34:27.865 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:34:27.865 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:34:27.865 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:34:27.865 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:34:27.865 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:34:27.865 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:34:27.865 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:27.865 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:34:27.865 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:27.865 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:34:27.866 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:34:27.866 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:34:27.866 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:34:27.866 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:27.866 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:34:27.866 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:34:27.866 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:34:27.866 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:27.866 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:27.866 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:34:27.866 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:34:27.866 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:34:27.866 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:34:27.867 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:34:27.867 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:27.867 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:34:27.867 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:34:27.867 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:34:27.867 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:34:27.867 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:34:27.867 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:27.867 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:27.867 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:34:27.867 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:34:27.867 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:34:27.867 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:34:27.868 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:27.868 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:34:27.868 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:34:27.868 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:34:27.868 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:27.868 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:27.868 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:34:27.868 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:34:27.868 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:34:27.868 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:34:27.868 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:34:27.868 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:27.868 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:34:27.869 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:34:27.869 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:34:27.869 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:34:27.869 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:34:27.869 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:27.869 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:27.869 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:34:27.869 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:34:27.869 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:34:27.869 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:34:27.869 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:27.869 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:34:27.869 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:34:27.870 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:34:27.870 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:27.870 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:27.870 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:34:27.870 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:34:27.870 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:34:27.870 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:34:27.870 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:34:27.870 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:27.870 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:34:27.870 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:34:27.870 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:34:27.870 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:34:27.871 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:34:27.871 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:34:27.871 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:34:27.871 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:27.871 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:34:27.871 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:34:27.871 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:27.871 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:34:27.871 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:34:27.871 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:34:27.871 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:34:27.871 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:34:27.872 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:34:27.872 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:27.872 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:34:27.872 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:34:27.872 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:34:27.872 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:34:27.872 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:34:27.872 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:34:27.872 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:27.872 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:34:27.872 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:34:27.872 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:34:27.872 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:34:27.873 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:34:27.873 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:27.873 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:34:27.873 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:34:27.874 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:34:27.874 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-08-24T21:34:27.874 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-08-24T21:34:28.375 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-08-24T21:34:29.259 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:34:29.332 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=ac3052cbc7549b0b227750ecf5f13c69 2024-08-24T21:34:29.333 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap55 - 2024-08-24T21:34:29.333 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:34:29.334 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:34:29.376 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:34:29.376 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:34:29.832 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":208,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:34:29.851 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:34:29.851 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-08-24T21:34:29.851 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:34:29.851 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:34:30.038 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:34:30.038 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:34:30.038 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:34:30.038 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:34:30.039 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 208, 2024-08-24T21:34:30.039 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 18353, 2024-08-24T21:34:30.039 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:34:30.039 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:34:30.039 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:34:30.039 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:34:30.039 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:34:30.039 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 3, 2024-08-24T21:34:30.039 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:34:30.039 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:34:30.039 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:34:30.039 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:34:30.040 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:34:30.040 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:34:30.040 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:34:30.040 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:34:30.040 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:34:30.040 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:34:30.040 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:34:30.040 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:34:30.040 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:34:30.040 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:34:30.040 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:34:30.040 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:34:30.041 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:34:30.041 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:34:30.041 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:34:30.041 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:34:30.041 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:34:30.041 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:34:30.041 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:34:30.041 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:34:30.041 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:34:30.041 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:34:30.041 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:34:30.041 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:34:30.041 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:34:30.042 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:30.042 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:34:30.042 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:34:30.042 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:34:30.042 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:34:30.042 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:34:30.042 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:34:30.042 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:34:30.042 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:34:30.042 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:34:30.042 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:34:30.042 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:34:30.043 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:34:30.043 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:34:30.043 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:34:30.043 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:34:30.043 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:34:30.043 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:34:30.043 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:34:30.043 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:34:30.043 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:34:30.043 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:34:30.043 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:34:30.043 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:34:30.044 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:34:30.044 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:34:30.044 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:34:30.044 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:34:30.044 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:34:30.044 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:34:30.044 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:34:30.044 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:30.044 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:34:30.044 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:30.044 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:34:30.044 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:34:30.044 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:34:30.045 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:34:30.045 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:30.045 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:34:30.045 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:34:30.045 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:34:30.045 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:30.045 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:30.045 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:34:30.045 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:34:30.045 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:34:30.045 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:34:30.045 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:34:30.045 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:30.046 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:34:30.046 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:34:30.046 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:34:30.046 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:34:30.046 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:34:30.046 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:30.046 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:30.046 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:34:30.047 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:34:30.047 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:34:30.047 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:34:30.047 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:30.047 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:34:30.047 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:34:30.047 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:34:30.047 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:30.047 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:30.047 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:34:30.047 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:34:30.047 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:34:30.047 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:34:30.048 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:34:30.048 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:30.048 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:34:30.048 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:34:30.048 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:34:30.048 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:34:30.048 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:34:30.048 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:30.048 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:30.048 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:34:30.048 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:34:30.048 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:34:30.048 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:34:30.049 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:30.049 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:34:30.049 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:34:30.049 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:34:30.049 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:30.049 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:30.049 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:34:30.049 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:34:30.049 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:34:30.049 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:34:30.049 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:34:30.049 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:30.049 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:34:30.050 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:34:30.050 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:34:30.050 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:34:30.050 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:34:30.050 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:34:30.050 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:34:30.050 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:30.050 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:34:30.050 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:34:30.050 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:30.050 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:34:30.050 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:34:30.050 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:34:30.051 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:34:30.051 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:34:30.051 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:34:30.051 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:30.051 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:34:30.051 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:34:30.051 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:34:30.051 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:34:30.051 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:34:30.051 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:30.051 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:34:30.051 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:34:30.053 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:34:30.053 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:34:30.053 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:34:30.241 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:34:30.241 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:34:30.242 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:34:30.242 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:34:30.242 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 208, 2024-08-24T21:34:30.242 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 350770, 2024-08-24T21:34:30.242 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:34:30.242 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:34:30.242 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:34:30.242 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:34:30.242 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:34:30.242 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 3, 2024-08-24T21:34:30.242 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:34:30.243 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:34:30.243 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:34:30.243 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:34:30.243 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:34:30.243 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:34:30.243 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:34:30.243 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:34:30.243 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:34:30.243 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:34:30.243 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:34:30.243 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:34:30.243 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:34:30.244 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:34:30.244 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:34:30.244 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:34:30.244 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:34:30.244 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:34:30.244 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:34:30.244 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:34:30.244 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:34:30.244 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:34:30.244 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:34:30.244 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:34:30.244 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:34:30.244 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:34:30.245 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:34:30.245 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:34:30.245 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:34:30.245 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:30.245 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:34:30.245 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:34:30.245 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:34:30.245 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:34:30.245 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:34:30.245 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:34:30.245 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:34:30.245 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:34:30.246 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:34:30.246 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:34:30.246 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:34:30.246 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:34:30.246 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:34:30.246 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:34:30.246 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:34:30.246 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:34:30.246 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:34:30.246 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:34:30.246 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:34:30.246 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:34:30.247 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:34:30.247 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:34:30.247 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:34:30.247 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:34:30.247 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:34:30.247 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:34:30.247 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:34:30.247 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:34:30.247 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:34:30.247 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:34:30.247 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:30.247 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:34:30.247 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:30.248 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:34:30.248 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:34:30.248 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:34:30.248 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:34:30.248 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:30.248 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:34:30.248 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:34:30.248 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:34:30.248 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:30.248 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:30.248 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:34:30.248 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:34:30.248 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:34:30.249 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:34:30.249 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:34:30.249 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:30.249 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:34:30.249 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:34:30.249 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:34:30.249 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:34:30.249 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:34:30.249 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:30.249 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:30.249 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:34:30.249 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:34:30.249 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:34:30.250 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:34:30.250 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:30.250 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:34:30.250 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:34:30.250 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:34:30.250 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:30.250 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:30.250 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:34:30.250 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:34:30.250 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:34:30.250 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:34:30.250 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:34:30.250 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:30.251 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:34:30.251 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:34:30.251 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:34:30.251 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:34:30.251 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:34:30.251 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:30.251 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:30.251 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:34:30.251 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:34:30.251 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:34:30.251 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:34:30.251 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:30.251 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:34:30.252 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:34:30.252 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:34:30.252 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:30.252 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:30.252 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:34:30.252 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:34:30.252 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:34:30.252 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:34:30.252 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:34:30.252 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:30.252 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:34:30.252 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:34:30.252 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:34:30.253 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:34:30.253 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:34:30.253 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:34:30.253 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:34:30.253 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:30.253 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:34:30.253 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:34:30.253 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:30.253 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:34:30.253 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:34:30.253 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:34:30.253 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:34:30.253 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:34:30.254 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:34:30.254 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:30.254 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:34:30.254 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:34:30.254 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 7 2024-08-24T21:34:30.254 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:34:30.254 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:34:30.254 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:34:30.254 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:30.254 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:34:30.254 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:34:30.254 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:34:30.254 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:34:30.255 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:34:30.255 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:34:30.255 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:30.255 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:34:30.255 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:34:30.255 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:34:30.255 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:34:30.255 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:34:30.255 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:30.255 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:34:30.255 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:34:30.257 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:34:30.257 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:34:30.257 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:34:30.446 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:34:30.446 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:34:30.446 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:34:30.446 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:34:30.446 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 208, 2024-08-24T21:34:30.446 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 191045, 2024-08-24T21:34:30.446 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:34:30.446 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:34:30.447 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:34:30.447 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:34:30.447 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:34:30.447 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 3, 2024-08-24T21:34:30.447 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:34:30.447 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:34:30.447 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:34:30.447 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:34:30.447 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:34:30.447 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:34:30.447 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:34:30.447 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:34:30.448 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:34:30.448 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:34:30.448 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:34:30.448 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:34:30.448 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:34:30.448 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:34:30.448 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:34:30.448 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:34:30.448 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:34:30.448 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:34:30.448 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:34:30.448 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:34:30.448 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:34:30.449 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:34:30.449 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:34:30.449 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:34:30.449 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:34:30.449 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:34:30.449 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:34:30.449 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:34:30.449 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:34:30.449 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:30.449 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:34:30.449 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:34:30.449 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:34:30.450 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:34:30.450 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:34:30.450 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:34:30.450 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:34:30.450 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:34:30.450 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:34:30.450 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:34:30.450 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:34:30.450 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:34:30.450 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:34:30.450 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:34:30.450 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:34:30.450 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:34:30.451 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:34:30.451 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:34:30.451 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:34:30.451 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:34:30.451 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:34:30.451 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:34:30.451 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:34:30.451 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:34:30.451 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:34:30.451 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:34:30.451 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:34:30.451 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:34:30.451 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:34:30.452 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:34:30.452 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:30.452 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:34:30.452 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:30.452 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:34:30.452 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:34:30.452 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:34:30.452 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:34:30.452 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:30.452 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:34:30.452 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:34:30.452 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:34:30.452 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:30.453 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:30.453 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:34:30.453 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:34:30.453 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:34:30.453 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:34:30.453 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:34:30.453 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:30.453 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:34:30.453 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:34:30.453 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:34:30.453 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:34:30.453 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:34:30.453 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:30.454 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:30.454 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:34:30.454 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:34:30.454 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:34:30.454 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:34:30.454 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:30.454 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:34:30.454 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:34:30.454 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:34:30.454 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:30.454 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:30.454 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:34:30.454 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:34:30.455 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:34:30.455 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:34:30.455 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:34:30.455 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:30.455 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:34:30.455 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:34:30.455 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:34:30.455 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:34:30.455 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:34:30.455 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:30.455 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:30.455 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:34:30.455 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:34:30.456 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:34:30.456 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:34:30.456 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:30.456 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:34:30.456 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:34:30.456 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:34:30.456 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:30.456 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:30.456 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:34:30.456 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:34:30.456 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:34:30.456 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:34:30.456 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:34:30.457 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:30.457 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:34:30.457 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:34:30.457 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:34:30.457 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:34:30.457 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:34:30.457 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:34:30.457 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:34:30.457 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:30.457 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:34:30.457 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:34:30.457 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:30.457 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:34:30.457 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:34:30.458 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:34:30.458 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:34:30.458 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:34:30.458 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:34:30.458 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:30.458 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:34:30.458 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:34:30.458 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:34:30.458 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:34:30.458 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:34:30.458 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:34:30.458 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:30.458 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:34:30.459 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:34:30.459 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-08-24T21:34:30.459 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:34:30.459 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:34:30.459 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:30.459 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:34:30.459 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:34:30.461 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:34:30.462 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2024-08-24T21:34:30.462 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['a', 'c'] 2024-08-24T21:34:30.462 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-08-24T21:34:30.462 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-08-24T21:34:30.462 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-08-24T21:34:30.462 INFO:teuthology.orchestra.run:waiting for 300 2024-08-24T21:34:30.484 INFO:tasks.ceph.mon.b:Stopped 2024-08-24T21:34:30.484 INFO:tasks.mon_thrash:Sending STOP to mon a 2024-08-24T21:34:30.484 INFO:tasks.ceph.mon.a:Sent signal 19 2024-08-24T21:34:30.484 INFO:tasks.mon_thrash:Sending STOP to mon c 2024-08-24T21:34:30.484 INFO:tasks.ceph.mon.c:Sent signal 19 2024-08-24T21:34:30.485 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-08-24T21:34:34.719 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:34:34.730 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=ac3052cbc7549b0b227750ecf5f13c69 2024-08-24T21:34:34.730 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ ac3052cbc7549b0b227750ecf5f13c69 != \a\c\3\0\5\2\c\b\c\7\5\4\9\b\0\b\2\2\7\7\5\0\e\c\f\5\f\1\3\c\6\9 ]] 2024-08-24T21:34:34.730 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap55 2024-08-24T21:34:34.730 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap55 2024-08-24T21:34:34.730 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap55 2024-08-24T21:34:45.485 INFO:tasks.mon_thrash:Sending CONT to mon a 2024-08-24T21:34:45.486 INFO:tasks.ceph.mon.a:Sent signal 18 2024-08-24T21:34:45.486 INFO:tasks.mon_thrash:Sending CONT to mon c 2024-08-24T21:34:45.487 INFO:tasks.ceph.mon.c:Sent signal 18 2024-08-24T21:34:45.487 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-08-24T21:34:45.487 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:34:50.613 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:34:50.626 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:34:50.626 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap55 2024-08-24T21:34:50.627 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:34:50.716 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:34:50.716 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:34:50.716 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:34:50.716 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:34:50.717 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:34:50.717 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap56.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:34:50.806 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":212,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:34:50.824 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-08-24T21:34:50.825 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-08-24T21:34:50.825 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:34:51.173 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:34:51.173 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:34:51.173 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:34:51.173 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:34:51.173 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 212, 2024-08-24T21:34:51.173 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 39486, 2024-08-24T21:34:51.173 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:34:51.174 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:34:51.174 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:34:51.174 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:34:51.174 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:34:51.174 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:34:51.174 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:34:51.174 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:34:51.174 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:34:51.174 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:34:51.174 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:34:51.174 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:34:51.174 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:34:51.174 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:34:51.175 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:34:51.175 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:34:51.175 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:34:51.175 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:34:51.175 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:34:51.175 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:34:51.175 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:34:51.175 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:34:51.175 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:34:51.175 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:34:51.175 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:34:51.175 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:34:51.175 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:34:51.176 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:34:51.176 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:34:51.176 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:34:51.176 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:34:51.176 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:34:51.176 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:34:51.176 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:34:51.176 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:51.176 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:34:51.176 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:34:51.176 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:34:51.176 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:34:51.176 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:34:51.177 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:34:51.177 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:34:51.177 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:34:51.177 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:34:51.177 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:34:51.177 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:34:51.177 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:34:51.177 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:34:51.177 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:34:51.177 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:34:51.177 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:34:51.177 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:34:51.177 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:34:51.178 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:34:51.178 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:34:51.178 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:34:51.178 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:34:51.178 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:34:51.178 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:34:51.178 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:34:51.178 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:34:51.178 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:34:51.178 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:34:51.178 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:34:51.178 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:34:51.178 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:51.179 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:34:51.179 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:51.179 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:34:51.179 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:34:51.179 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:34:51.179 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:34:51.179 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:51.179 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:34:51.179 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:34:51.179 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:34:51.179 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:51.179 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:51.179 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:34:51.180 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:34:51.180 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:34:51.180 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:34:51.180 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:34:51.180 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:51.180 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:34:51.180 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:34:51.180 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:34:51.180 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:34:51.180 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:34:51.180 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:51.180 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:51.180 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:34:51.181 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:34:51.181 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:34:51.181 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:34:51.181 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:51.181 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:34:51.181 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:34:51.181 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:34:51.181 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:51.181 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:51.181 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:34:51.181 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:34:51.181 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:34:51.181 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:34:51.182 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:34:51.182 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:51.182 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:34:51.182 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:34:51.182 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:34:51.182 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:34:51.182 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:34:51.182 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:51.182 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:51.182 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:34:51.182 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:34:51.182 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:34:51.183 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:34:51.183 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:51.183 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:34:51.183 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:34:51.183 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:34:51.183 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:51.183 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:51.183 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:34:51.183 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:34:51.183 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:34:51.183 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:34:51.183 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:34:51.183 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:51.183 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:34:51.184 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:34:51.184 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:34:51.184 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:34:51.184 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:34:51.184 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:34:51.184 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:34:51.184 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:51.184 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:34:51.184 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:34:51.184 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:51.184 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:34:51.184 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:34:51.184 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:34:51.185 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:34:51.185 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:34:51.185 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:34:51.185 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:51.185 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:34:51.185 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:34:51.185 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:34:51.185 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:34:51.185 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:34:51.185 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:34:51.185 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:51.185 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:34:51.185 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:34:51.185 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-08-24T21:34:51.186 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:34:51.186 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:34:51.186 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:51.186 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:34:51.186 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:34:51.203 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:34:51.203 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-08-24T21:34:51.204 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:34:51.555 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:34:51.555 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:34:51.555 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:34:51.555 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:34:51.555 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 212, 2024-08-24T21:34:51.555 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 372082, 2024-08-24T21:34:51.556 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:34:51.556 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:34:51.556 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:34:51.556 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:34:51.556 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 1, 2024-08-24T21:34:51.556 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:34:51.556 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:34:51.556 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:34:51.556 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:34:51.556 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:34:51.556 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:34:51.556 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:34:51.557 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:34:51.557 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:34:51.557 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:34:51.557 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:34:51.557 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:34:51.557 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:34:51.557 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:34:51.557 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:34:51.557 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:34:51.558 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:34:51.558 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:34:51.558 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:34:51.558 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:34:51.558 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:34:51.558 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:34:51.558 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:34:51.558 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:34:51.558 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:34:51.558 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:34:51.558 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:34:51.558 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:34:51.559 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:34:51.559 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:51.559 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:34:51.559 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:34:51.559 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:34:51.559 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:34:51.559 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:34:51.559 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:34:51.560 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:34:51.560 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:34:51.560 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:34:51.560 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:34:51.560 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:34:51.560 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:34:51.560 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:34:51.560 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:34:51.560 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:34:51.560 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:34:51.560 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:34:51.560 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:34:51.560 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:34:51.561 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:34:51.561 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:34:51.561 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:34:51.561 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:34:51.561 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:34:51.561 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:34:51.561 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:34:51.561 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:34:51.561 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:34:51.561 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:34:51.561 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:34:51.561 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:51.562 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:34:51.562 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:51.562 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:34:51.562 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:34:51.562 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:34:51.562 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:34:51.562 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:51.562 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:34:51.562 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:34:51.562 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:34:51.562 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:51.562 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:51.562 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:34:51.563 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:34:51.563 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:34:51.563 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:34:51.563 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:34:51.563 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:51.563 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:34:51.563 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:34:51.563 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:34:51.563 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:34:51.563 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:34:51.563 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:51.563 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:51.563 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:34:51.564 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:34:51.564 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:34:51.564 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:34:51.564 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:51.564 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:34:51.564 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:34:51.564 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:34:51.564 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:51.564 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:51.564 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:34:51.564 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:34:51.564 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:34:51.564 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:34:51.565 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:34:51.565 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:51.565 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:34:51.565 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:34:51.565 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:34:51.565 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:34:51.565 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:34:51.565 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:51.565 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:51.565 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:34:51.565 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:34:51.565 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:34:51.566 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:34:51.566 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:51.566 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:34:51.566 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:34:51.566 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:34:51.566 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:51.566 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:51.566 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:34:51.566 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:34:51.566 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:34:51.566 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:34:51.566 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:34:51.566 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:51.567 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:34:51.567 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:34:51.567 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:34:51.567 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:34:51.567 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:34:51.567 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:34:51.567 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:34:51.567 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:51.567 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:34:51.567 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:34:51.567 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:51.567 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:34:51.567 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:34:51.568 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:34:51.568 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:34:51.568 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:34:51.568 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:34:51.568 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:51.568 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:34:51.568 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:34:51.568 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 7 2024-08-24T21:34:51.568 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:34:51.568 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:34:51.568 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:34:51.568 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:51.568 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:34:51.569 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:34:51.569 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-08-24T21:34:51.569 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:34:51.569 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:34:51.569 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:34:51.569 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:34:51.569 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:34:51.569 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:34:51.570 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:34:51.570 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:34:51.570 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:34:51.570 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:34:51.570 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:34:51.570 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:34:51.593 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:34:51.593 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-08-24T21:34:54.538 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 3% complete... Importing image diff: 7% complete... Importing image diff: 10% complete... Importing image diff: 14% complete... Importing image diff: 18% complete... Importing image diff: 21% complete... Importing image diff: 25% complete... Importing image diff: 29% complete... Importing image diff: 32% complete... Importing image diff: 36% complete... Importing image diff: 40% complete... Importing image diff: 43% complete... Importing image diff: 47% complete... Importing image diff: 51% complete... Importing image diff: 54% complete... Importing image diff: 58% complete... Importing image diff: 62% complete... Importing image diff: 65% complete... Importing image diff: 69% complete... Importing image diff: 73% complete... Importing image diff: 76% complete... Importing image diff: 77% complete... Importing image diff: 81% complete... Importing image diff: 84% complete... Importing image diff: 88% complete... Importing image diff: 92% complete... Importing image diff: 95% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2024-08-24T21:34:54.561 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap56 - 2024-08-24T21:34:54.561 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:34:54.561 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:34:59.802 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:34:59.875 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=4494bbf71e2542c5034fb0e3c7aef280 2024-08-24T21:34:59.877 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap56 - 2024-08-24T21:34:59.877 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:34:59.877 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:35:05.320 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:35:05.330 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=4494bbf71e2542c5034fb0e3c7aef280 2024-08-24T21:35:05.330 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ 4494bbf71e2542c5034fb0e3c7aef280 != \4\4\9\4\b\b\f\7\1\e\2\5\4\2\c\5\0\3\4\f\b\0\e\3\c\7\a\e\f\2\8\0 ]] 2024-08-24T21:35:05.330 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap56 2024-08-24T21:35:05.330 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap56 2024-08-24T21:35:05.330 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap56 2024-08-24T21:35:05.438 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:35:05.449 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:35:05.451 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap56 2024-08-24T21:35:05.451 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:35:05.537 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:35:05.537 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:35:05.537 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:35:05.537 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:35:05.537 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:35:05.537 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap57.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:35:09.567 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 3% complete... Importing image diff: 6% complete... Importing image diff: 7% complete... Importing image diff: 10% complete... Importing image diff: 14% complete... Importing image diff: 17% complete... Importing image diff: 20% complete... Importing image diff: 21% complete... Importing image diff: 25% complete... Importing image diff: 28% complete... Importing image diff: 31% complete... Importing image diff: 35% complete... Importing image diff: 38% complete... Importing image diff: 42% complete... Importing image diff: 45% complete... Importing image diff: 48% complete... Importing image diff: 52% complete... Importing image diff: 55% complete... Importing image diff: 59% complete... Importing image diff: 62% complete... Importing image diff: 65% complete... Importing image diff: 69% complete... Importing image diff: 72% complete... Importing image diff: 76% complete... Importing image diff: 79% complete... Importing image diff: 82% complete... Importing image diff: 86% complete... Importing image diff: 89% complete... Importing image diff: 93% complete... Importing image diff: 96% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2024-08-24T21:35:09.592 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap57 - 2024-08-24T21:35:09.592 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:35:09.593 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:35:11.593 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-08-24T21:35:11.594 INFO:tasks.ceph.mon.b:Restarting daemon 2024-08-24T21:35:11.594 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-08-24T21:35:11.598 INFO:tasks.ceph.mon.b:Started 2024-08-24T21:35:11.598 INFO:tasks.mon_thrash:Sending STOP to mon a 2024-08-24T21:35:11.599 INFO:tasks.ceph.mon.a:Sent signal 19 2024-08-24T21:35:11.599 INFO:tasks.mon_thrash:Sending STOP to mon c 2024-08-24T21:35:11.599 INFO:tasks.ceph.mon.c:Sent signal 19 2024-08-24T21:35:11.599 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-08-24T21:35:14.725 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:35:14.804 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=7b5c327b973e3cfa7f5701a95e95a7c8 2024-08-24T21:35:14.806 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap57 - 2024-08-24T21:35:14.806 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:35:14.806 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:35:26.600 INFO:tasks.mon_thrash:Sending CONT to mon a 2024-08-24T21:35:26.600 INFO:tasks.ceph.mon.a:Sent signal 18 2024-08-24T21:35:26.600 INFO:tasks.mon_thrash:Sending CONT to mon c 2024-08-24T21:35:26.601 INFO:tasks.ceph.mon.c:Sent signal 18 2024-08-24T21:35:26.601 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:35:26.601 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:35:31.912 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":216,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:35:34.931 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:35:35.397 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":220,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:35:35.416 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:35:35.416 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:35:35.416 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:35:35.606 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:35:35.606 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:35:35.606 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:35:35.606 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:35:35.606 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 220, 2024-08-24T21:35:35.606 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 83921, 2024-08-24T21:35:35.606 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:35:35.606 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:35:35.606 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:35:35.606 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:35:35.607 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:35:35.607 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 3, 2024-08-24T21:35:35.607 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:35:35.607 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:35:35.607 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:35:35.607 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:35:35.607 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:35:35.607 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:35:35.607 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:35:35.607 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:35:35.607 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:35:35.607 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:35:35.607 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:35:35.608 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:35:35.608 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:35:35.608 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:35:35.608 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:35:35.608 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:35:35.608 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:35:35.608 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:35:35.608 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:35:35.608 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:35:35.608 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:35:35.608 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:35:35.608 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:35:35.608 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:35:35.608 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:35:35.609 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:35:35.609 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:35:35.609 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:35:35.609 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:35:35.609 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:35.609 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:35:35.609 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:35:35.609 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:35:35.609 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:35:35.609 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:35:35.609 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:35:35.609 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:35:35.609 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:35:35.609 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:35:35.610 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:35:35.610 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:35:35.610 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:35:35.610 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:35:35.610 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:35:35.610 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:35:35.610 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:35:35.610 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:35:35.610 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:35:35.610 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:35:35.610 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:35:35.610 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:35:35.610 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:35:35.611 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:35:35.611 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:35:35.611 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:35:35.611 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:35:35.611 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:35:35.611 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:35:35.611 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:35:35.611 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:35:35.611 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:35.611 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:35:35.611 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:35.611 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:35:35.611 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:35:35.612 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:35:35.612 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:35:35.612 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:35.612 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:35:35.612 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:35:35.612 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:35:35.612 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:35.612 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:35.612 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:35:35.612 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:35:35.612 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:35:35.612 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:35:35.612 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:35:35.612 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:35.613 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:35:35.613 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:35:35.613 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:35:35.613 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:35:35.613 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:35:35.613 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:35.613 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:35.613 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:35:35.613 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:35:35.613 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:35:35.613 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:35:35.613 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:35.613 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:35:35.614 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:35:35.614 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:35:35.614 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:35.614 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:35.614 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:35:35.614 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:35:35.614 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:35:35.614 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:35:35.614 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:35:35.615 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:35.615 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:35:35.615 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:35:35.615 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:35:35.615 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:35:35.616 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:35:35.616 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:35.616 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:35.616 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:35:35.616 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:35:35.616 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:35:35.616 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:35:35.616 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:35.616 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:35:35.616 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:35:35.616 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:35:35.616 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:35.617 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:35.617 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:35:35.617 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:35:35.617 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:35:35.617 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:35:35.617 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:35:35.617 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:35.617 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:35:35.617 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:35:35.618 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:35:35.618 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:35:35.618 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:35:35.618 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:35:35.618 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:35:35.618 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:35.618 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:35:35.618 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:35:35.618 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:35.618 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:35:35.619 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:35:35.619 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:35:35.619 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:35:35.619 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:35:35.619 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:35:35.619 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:35.619 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:35:35.619 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:35:35.619 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:35:35.619 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:35:35.619 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:35:35.619 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:35:35.620 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:35.620 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:35:35.620 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:35:35.620 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-08-24T21:35:35.620 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:35:35.620 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:35:35.620 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:35.620 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:35:35.620 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:35:35.622 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:35:35.622 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:35:35.623 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:35:35.809 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:35:35.809 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:35:35.809 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:35:35.809 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:35:35.809 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 220, 2024-08-24T21:35:35.809 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 416339, 2024-08-24T21:35:35.810 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:35:35.810 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:35:35.810 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:35:35.810 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:35:35.810 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:35:35.810 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 3, 2024-08-24T21:35:35.810 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:35:35.810 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:35:35.810 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:35:35.810 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:35:35.810 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:35:35.810 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:35:35.810 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:35:35.811 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:35:35.811 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:35:35.811 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:35:35.811 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:35:35.811 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:35:35.811 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:35:35.811 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:35:35.811 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:35:35.811 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:35:35.811 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:35:35.811 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:35:35.811 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:35:35.811 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:35:35.812 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:35:35.812 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:35:35.812 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:35:35.812 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:35:35.812 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:35:35.812 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:35:35.812 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:35:35.812 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:35:35.812 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:35:35.812 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:35.812 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:35:35.812 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:35:35.812 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:35:35.813 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:35:35.813 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:35:35.813 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:35:35.813 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:35:35.813 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:35:35.813 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:35:35.813 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:35:35.813 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:35:35.814 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:35:35.814 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:35:35.814 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:35:35.814 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:35:35.814 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:35:35.814 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:35:35.814 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:35:35.814 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:35:35.814 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:35:35.814 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:35:35.814 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:35:35.814 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:35:35.815 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:35:35.815 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:35:35.815 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:35:35.815 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:35:35.815 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:35:35.815 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:35:35.815 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:35:35.815 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:35.815 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:35:35.815 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:35.815 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:35:35.815 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:35:35.816 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:35:35.816 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:35:35.816 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:35.816 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:35:35.816 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:35:35.816 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:35:35.816 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:35.816 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:35.816 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:35:35.816 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:35:35.816 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:35:35.816 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:35:35.816 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:35:35.817 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:35.817 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:35:35.817 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:35:35.817 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:35:35.817 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:35:35.817 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:35:35.817 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:35.817 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:35.817 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:35:35.817 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:35:35.817 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:35:35.817 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:35:35.817 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:35.818 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:35:35.818 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:35:35.818 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:35:35.818 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:35.818 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:35.818 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:35:35.818 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:35:35.818 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:35:35.818 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:35:35.818 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:35:35.818 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:35.818 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:35:35.818 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:35:35.819 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:35:35.819 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:35:35.819 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:35:35.819 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:35.819 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:35.819 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:35:35.819 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:35:35.820 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:35:35.820 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:35:35.820 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:35.820 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:35:35.820 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:35:35.820 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:35:35.820 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:35.820 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:35.820 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:35:35.820 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:35:35.820 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:35:35.820 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:35:35.820 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:35:35.820 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:35.821 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:35:35.821 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:35:35.821 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:35:35.821 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:35:35.821 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:35:35.821 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:35:35.821 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:35:35.821 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:35.821 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:35:35.821 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:35:35.821 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:35.821 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:35:35.822 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:35:35.822 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:35:35.822 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:35:35.822 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:35:35.822 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:35:35.822 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:35.822 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:35:35.822 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:35:35.822 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 6 2024-08-24T21:35:35.823 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:35:35.823 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:35:35.823 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:35:35.823 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:35.823 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:35:35.823 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:35:35.823 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:35:35.823 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:35:35.823 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:35:35.823 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:35:35.824 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:35.824 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:35:35.824 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:35:35.824 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:35:35.824 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:35:35.825 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:35:35.825 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:35.825 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:35:35.825 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:35:35.826 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:35:35.826 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:35:35.826 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:35:36.014 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:35:36.014 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:35:36.014 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:35:36.014 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:35:36.014 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 220, 2024-08-24T21:35:36.015 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 24280, 2024-08-24T21:35:36.015 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:35:36.015 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:35:36.015 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:35:36.015 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:35:36.015 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:35:36.015 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 4, 2024-08-24T21:35:36.015 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:35:36.015 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:35:36.015 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:35:36.015 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:35:36.015 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:35:36.016 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:35:36.016 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:35:36.016 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:35:36.016 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:35:36.016 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:35:36.016 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:35:36.016 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:35:36.016 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:35:36.016 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:35:36.016 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:35:36.016 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:35:36.016 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:35:36.017 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:35:36.017 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:35:36.017 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:35:36.017 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:35:36.017 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:35:36.017 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:35:36.017 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:35:36.017 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:35:36.017 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:35:36.017 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:35:36.017 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:35:36.017 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:35:36.017 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:36.018 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:35:36.018 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:35:36.018 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:35:36.018 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:35:36.018 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:35:36.018 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:35:36.018 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:35:36.018 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:35:36.018 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:35:36.018 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:35:36.018 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:35:36.018 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:35:36.018 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:35:36.019 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:35:36.019 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:35:36.019 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:35:36.019 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:35:36.019 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:35:36.019 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:35:36.019 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:35:36.019 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:35:36.019 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:35:36.019 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:35:36.019 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:35:36.019 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:35:36.019 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:35:36.019 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:35:36.020 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:35:36.020 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:35:36.020 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:35:36.020 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:36.020 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:35:36.020 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:36.020 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:35:36.020 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:35:36.020 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:35:36.020 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:35:36.020 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:36.020 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:35:36.020 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:35:36.020 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:35:36.021 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:36.021 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:36.021 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:35:36.021 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:35:36.021 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:35:36.021 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:35:36.021 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:35:36.021 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:36.021 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:35:36.021 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:35:36.021 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:35:36.021 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:35:36.021 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:35:36.022 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:36.022 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:36.022 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:35:36.022 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:35:36.022 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:35:36.022 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:35:36.022 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:36.022 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:35:36.022 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:35:36.022 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:35:36.022 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:36.022 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:36.022 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:35:36.023 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:35:36.023 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:35:36.023 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:35:36.023 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:35:36.023 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:36.023 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:35:36.023 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:35:36.023 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:35:36.023 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:35:36.024 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:35:36.024 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:36.024 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:36.024 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:35:36.024 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:35:36.024 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:35:36.024 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:35:36.024 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:36.024 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:35:36.024 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:35:36.025 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:35:36.025 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:36.025 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:36.025 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:35:36.025 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:35:36.025 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:35:36.025 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:35:36.025 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:35:36.025 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:36.025 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:35:36.025 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:35:36.025 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:35:36.025 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:35:36.026 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:35:36.026 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:35:36.026 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:35:36.026 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:36.026 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:35:36.026 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:35:36.026 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:36.026 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:35:36.026 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:35:36.026 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:35:36.026 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:35:36.026 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:35:36.026 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:35:36.027 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:36.027 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:35:36.027 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:35:36.027 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:35:36.027 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:35:36.027 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:35:36.027 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:36.027 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:35:36.027 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:35:36.029 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:35:36.029 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-08-24T21:35:36.029 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-08-24T21:35:36.517 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-08-24T21:35:37.518 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:35:37.518 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:35:37.984 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":220,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:35:38.003 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:35:38.004 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-08-24T21:35:38.004 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:35:38.004 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:35:38.187 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:35:38.187 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:35:38.187 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:35:38.187 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:35:38.187 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 220, 2024-08-24T21:35:38.187 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 86503, 2024-08-24T21:35:38.187 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:35:38.188 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:35:38.188 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:35:38.188 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:35:38.188 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:35:38.188 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 6, 2024-08-24T21:35:38.188 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:35:38.188 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:35:38.188 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:35:38.188 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:35:38.188 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:35:38.188 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:35:38.188 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:35:38.189 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:35:38.189 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:35:38.189 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:35:38.189 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:35:38.189 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:35:38.189 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:35:38.189 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:35:38.189 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:35:38.189 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:35:38.189 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:35:38.189 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:35:38.189 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:35:38.190 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:35:38.190 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:35:38.190 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:35:38.190 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:35:38.190 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:35:38.190 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:35:38.190 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:35:38.190 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:35:38.190 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:35:38.190 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:35:38.190 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:38.191 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:35:38.191 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:35:38.191 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:35:38.191 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:35:38.191 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:35:38.191 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:35:38.191 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:35:38.191 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:35:38.191 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:35:38.191 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:35:38.191 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:35:38.191 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:35:38.192 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:35:38.192 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:35:38.192 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:35:38.192 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:35:38.192 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:35:38.192 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:35:38.192 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:35:38.192 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:35:38.192 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:35:38.192 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:35:38.192 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:35:38.192 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:35:38.193 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:35:38.193 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:35:38.193 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:35:38.193 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:35:38.193 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:35:38.193 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:35:38.193 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:38.193 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:35:38.193 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:38.193 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:35:38.193 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:35:38.193 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:35:38.193 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:35:38.194 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:38.194 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:35:38.194 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:35:38.194 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:35:38.194 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:38.194 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:38.194 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:35:38.194 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:35:38.194 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:35:38.194 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:35:38.194 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:35:38.194 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:38.195 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:35:38.195 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:35:38.195 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:35:38.195 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:35:38.195 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:35:38.195 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:38.195 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:38.195 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:35:38.195 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:35:38.195 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:35:38.195 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:35:38.195 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:38.196 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:35:38.196 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:35:38.196 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:35:38.196 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:38.196 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:38.196 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:35:38.196 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:35:38.196 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:35:38.196 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:35:38.196 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:35:38.196 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:38.196 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:35:38.197 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:35:38.197 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:35:38.197 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:35:38.197 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:35:38.197 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:38.197 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:38.197 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:35:38.197 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:35:38.197 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:35:38.197 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:35:38.197 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:38.197 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:35:38.197 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:35:38.198 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:35:38.198 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:38.198 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:38.198 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:35:38.198 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:35:38.198 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:35:38.198 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:35:38.198 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:35:38.198 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:38.198 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:35:38.198 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:35:38.198 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:35:38.198 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:35:38.199 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:35:38.199 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:35:38.199 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:35:38.199 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:38.199 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:35:38.199 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:35:38.199 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:38.199 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:35:38.199 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:35:38.199 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:35:38.199 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:35:38.199 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:35:38.199 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:35:38.200 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:38.200 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:35:38.200 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:35:38.200 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:35:38.200 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:35:38.200 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:35:38.200 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:35:38.200 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:38.200 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:35:38.200 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:35:38.200 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:35:38.200 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:35:38.200 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:35:38.201 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:38.201 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:35:38.201 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:35:38.202 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:35:38.203 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:35:38.203 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:35:38.211 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:35:38.222 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=7b5c327b973e3cfa7f5701a95e95a7c8 2024-08-24T21:35:38.222 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ 7b5c327b973e3cfa7f5701a95e95a7c8 != \7\b\5\c\3\2\7\b\9\7\3\e\3\c\f\a\7\f\5\7\0\1\a\9\5\e\9\5\a\7\c\8 ]] 2024-08-24T21:35:38.222 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap57 2024-08-24T21:35:38.222 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap57 2024-08-24T21:35:38.222 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap57 2024-08-24T21:35:38.330 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:35:38.341 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:35:38.343 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap57 2024-08-24T21:35:38.343 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:35:38.389 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:35:38.389 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:35:38.389 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:35:38.389 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:35:38.389 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 220, 2024-08-24T21:35:38.389 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 418919, 2024-08-24T21:35:38.389 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:35:38.390 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:35:38.390 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:35:38.390 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:35:38.390 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:35:38.390 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 6, 2024-08-24T21:35:38.390 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:35:38.390 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:35:38.390 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:35:38.390 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:35:38.390 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:35:38.390 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:35:38.390 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:35:38.390 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:35:38.391 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:35:38.391 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:35:38.391 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:35:38.391 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:35:38.391 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:35:38.391 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:35:38.391 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:35:38.391 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:35:38.392 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:35:38.392 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:35:38.392 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:35:38.392 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:35:38.392 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:35:38.392 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:35:38.392 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:35:38.392 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:35:38.392 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:35:38.392 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:35:38.392 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:35:38.392 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:35:38.392 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:35:38.393 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:38.393 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:35:38.393 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:35:38.393 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:35:38.393 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:35:38.393 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:35:38.393 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:35:38.393 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:35:38.393 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:35:38.393 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:35:38.393 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:35:38.393 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:35:38.394 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:35:38.394 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:35:38.394 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:35:38.394 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:35:38.394 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:35:38.394 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:35:38.394 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:35:38.394 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:35:38.394 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:35:38.394 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:35:38.394 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:35:38.394 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:35:38.395 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:35:38.395 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:35:38.395 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:35:38.395 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:35:38.395 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:35:38.395 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:35:38.395 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:35:38.395 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:38.395 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:35:38.395 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:38.395 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:35:38.395 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:35:38.395 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:35:38.396 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:35:38.396 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:38.396 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:35:38.396 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:35:38.396 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:35:38.396 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:38.396 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:38.396 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:35:38.396 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:35:38.396 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:35:38.396 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:35:38.396 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:35:38.396 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:38.397 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:35:38.397 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:35:38.397 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:35:38.397 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:35:38.397 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:35:38.397 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:38.397 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:38.397 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:35:38.397 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:35:38.397 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:35:38.397 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:35:38.397 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:38.397 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:35:38.398 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:35:38.398 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:35:38.398 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:38.398 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:38.398 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:35:38.398 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:35:38.398 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:35:38.398 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:35:38.398 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:35:38.398 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:38.398 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:35:38.398 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:35:38.399 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:35:38.399 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:35:38.399 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:35:38.399 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:38.399 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:38.399 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:35:38.399 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:35:38.399 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:35:38.399 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:35:38.399 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:38.399 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:35:38.399 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:35:38.400 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:35:38.400 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:38.400 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:38.400 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:35:38.400 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:35:38.400 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:35:38.400 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:35:38.400 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:35:38.400 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:38.400 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:35:38.400 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:35:38.400 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:35:38.400 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:35:38.400 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:35:38.401 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:35:38.401 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:35:38.401 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:38.401 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:35:38.401 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:35:38.401 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:38.401 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:35:38.401 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:35:38.401 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:35:38.401 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:35:38.401 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:35:38.401 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:35:38.401 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:38.402 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:35:38.402 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:35:38.402 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 6 2024-08-24T21:35:38.402 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:35:38.402 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:35:38.402 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:35:38.402 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:38.402 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:35:38.402 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:35:38.402 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-08-24T21:35:38.402 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:35:38.402 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:35:38.402 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:35:38.403 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:38.403 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:35:38.403 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:35:38.403 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:35:38.403 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:35:38.403 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:35:38.403 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:38.403 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:35:38.403 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:35:38.404 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:35:38.404 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:35:38.405 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:35:38.423 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:35:38.423 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:35:38.423 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:35:38.424 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:35:38.424 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:35:38.424 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap58.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:35:38.638 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:35:38.638 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:35:38.638 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:35:38.638 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:35:38.638 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 220, 2024-08-24T21:35:38.638 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 26905, 2024-08-24T21:35:38.638 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:35:38.638 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:35:38.638 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:35:38.639 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:35:38.639 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:35:38.639 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 6, 2024-08-24T21:35:38.639 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:35:38.639 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:35:38.639 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:35:38.639 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:35:38.639 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:35:38.639 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:35:38.639 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:35:38.639 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:35:38.639 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:35:38.639 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:35:38.640 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:35:38.640 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:35:38.640 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:35:38.640 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:35:38.640 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:35:38.640 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:35:38.640 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:35:38.640 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:35:38.640 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:35:38.640 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:35:38.640 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:35:38.640 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:35:38.640 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:35:38.641 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:35:38.641 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:35:38.641 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:35:38.641 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:35:38.641 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:35:38.641 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:35:38.641 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:38.641 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:35:38.641 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:35:38.641 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:35:38.641 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:35:38.641 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:35:38.641 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:35:38.642 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:35:38.642 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:35:38.642 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:35:38.642 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:35:38.642 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:35:38.642 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:35:38.642 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:35:38.642 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:35:38.642 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:35:38.642 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:35:38.642 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:35:38.642 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:35:38.642 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:35:38.642 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:35:38.643 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:35:38.643 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:35:38.643 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:35:38.643 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:35:38.643 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:35:38.643 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:35:38.643 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:35:38.643 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:35:38.643 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:35:38.643 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:35:38.643 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:38.643 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:35:38.643 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:38.644 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:35:38.644 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:35:38.644 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:35:38.644 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:35:38.644 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:38.644 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:35:38.644 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:35:38.644 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:35:38.644 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:38.644 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:38.644 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:35:38.644 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:35:38.644 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:35:38.645 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:35:38.645 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:35:38.645 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:38.645 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:35:38.645 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:35:38.645 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:35:38.645 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:35:38.645 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:35:38.645 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:38.645 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:38.645 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:35:38.645 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:35:38.645 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:35:38.646 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:35:38.646 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:38.646 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:35:38.646 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:35:38.646 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:35:38.646 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:38.646 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:38.646 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:35:38.646 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:35:38.646 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:35:38.646 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:35:38.646 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:35:38.646 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:38.646 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:35:38.647 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:35:38.647 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:35:38.647 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:35:38.647 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:35:38.647 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:38.647 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:38.647 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:35:38.647 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:35:38.647 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:35:38.647 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:35:38.647 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:38.647 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:35:38.648 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:35:38.648 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:35:38.648 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:38.648 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:38.648 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:35:38.648 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:35:38.648 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:35:38.648 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:35:38.648 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:35:38.648 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:38.648 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:35:38.648 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:35:38.649 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:35:38.649 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:35:38.649 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:35:38.649 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:35:38.649 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:35:38.649 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:38.649 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:35:38.649 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:35:38.649 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:38.649 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:35:38.649 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:35:38.649 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:35:38.649 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:35:38.650 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:35:38.650 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:35:38.650 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:38.650 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:35:38.650 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:35:38.650 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:35:38.650 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:35:38.650 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:35:38.650 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:38.650 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:35:38.650 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:35:38.675 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:35:38.676 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2024-08-24T21:35:38.676 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-08-24T21:35:38.676 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-08-24T21:35:38.676 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-08-24T21:35:38.676 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-08-24T21:35:38.676 INFO:teuthology.orchestra.run:waiting for 300 2024-08-24T21:35:38.703 INFO:tasks.ceph.mon.b:Stopped 2024-08-24T21:35:38.704 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-08-24T21:35:38.704 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:35:39.178 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":220,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:35:42.197 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:35:42.643 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":220,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":10,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:35:45.663 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:35:46.115 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":220,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:35:49.134 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:35:53.172 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":224,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:35:53.191 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-08-24T21:35:53.191 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-08-24T21:35:53.191 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:35:53.367 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:35:53.367 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:35:53.367 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:35:53.367 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:35:53.368 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 224, 2024-08-24T21:35:53.368 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 101683, 2024-08-24T21:35:53.368 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:35:53.368 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:35:53.368 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:35:53.368 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:35:53.368 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:35:53.368 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:35:53.368 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:35:53.368 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:35:53.368 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:35:53.368 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:35:53.368 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:35:53.369 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:35:53.369 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:35:53.369 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:35:53.369 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:35:53.369 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:35:53.369 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:35:53.369 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:35:53.369 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:35:53.369 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:35:53.369 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:35:53.369 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:35:53.369 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:35:53.370 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:35:53.370 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:35:53.370 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:35:53.370 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:35:53.370 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:35:53.370 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:35:53.370 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:35:53.370 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:35:53.370 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:35:53.370 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:35:53.370 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:35:53.371 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:53.371 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:35:53.371 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:35:53.371 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:35:53.371 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:35:53.371 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:35:53.371 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:35:53.371 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:35:53.371 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:35:53.371 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:35:53.371 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:35:53.371 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:35:53.371 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:35:53.372 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:35:53.372 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:35:53.372 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:35:53.372 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:35:53.372 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:35:53.372 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:35:53.372 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:35:53.372 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:35:53.372 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:35:53.372 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:35:53.372 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:35:53.372 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:35:53.373 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:35:53.373 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:35:53.373 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:35:53.373 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:35:53.373 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:35:53.373 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:35:53.373 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:53.373 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:35:53.373 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:53.373 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:35:53.373 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:35:53.373 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:35:53.373 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:35:53.374 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:53.374 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:35:53.374 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:35:53.374 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:35:53.374 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:53.374 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:53.374 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:35:53.374 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:35:53.374 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:35:53.374 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:35:53.374 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:35:53.374 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:53.375 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:35:53.375 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:35:53.375 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:35:53.375 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:35:53.375 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:35:53.375 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:53.375 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:53.375 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:35:53.375 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:35:53.375 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:35:53.375 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:35:53.375 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:53.375 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:35:53.376 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:35:53.376 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:35:53.376 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:53.376 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:53.376 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:35:53.376 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:35:53.376 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:35:53.376 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:35:53.376 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:35:53.376 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:53.376 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:35:53.376 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:35:53.376 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:35:53.377 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:35:53.377 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:35:53.377 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:53.377 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:53.377 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:35:53.377 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:35:53.377 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:35:53.377 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:35:53.377 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:53.377 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:35:53.377 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:35:53.377 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:35:53.377 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:53.377 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:53.378 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:35:53.378 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:35:53.378 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:35:53.378 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:35:53.378 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:35:53.378 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:53.378 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:35:53.378 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:35:53.378 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:35:53.378 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:35:53.378 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:35:53.379 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:35:53.379 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:35:53.379 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:53.379 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:35:53.379 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:35:53.379 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:53.379 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:35:53.379 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:35:53.379 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:35:53.379 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:35:53.379 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:35:53.380 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:35:53.380 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:53.380 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:35:53.380 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:35:53.380 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:35:53.380 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:35:53.380 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:35:53.380 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:35:53.380 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:53.380 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:35:53.381 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:35:53.381 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-08-24T21:35:53.381 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:35:53.381 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:35:53.381 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:53.381 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:35:53.381 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:35:53.382 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:35:53.382 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-08-24T21:35:53.383 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:35:53.559 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:35:53.560 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:35:53.560 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:35:53.560 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:35:53.560 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 224, 2024-08-24T21:35:53.560 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 434088, 2024-08-24T21:35:53.560 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:35:53.560 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:35:53.560 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:35:53.560 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:35:53.560 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:35:53.560 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:35:53.560 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:35:53.561 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:35:53.561 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:35:53.561 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:35:53.561 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:35:53.561 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:35:53.561 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:35:53.561 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:35:53.561 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:35:53.561 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:35:53.561 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:35:53.561 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:35:53.561 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:35:53.561 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:35:53.561 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:35:53.562 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:35:53.562 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:35:53.562 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:35:53.562 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:35:53.562 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:35:53.562 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:35:53.562 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:35:53.562 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:35:53.562 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:35:53.563 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:35:53.563 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:35:53.563 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:35:53.563 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:35:53.563 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:53.563 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:35:53.563 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:35:53.563 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:35:53.563 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:35:53.563 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:35:53.563 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:35:53.563 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:35:53.563 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:35:53.564 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:35:53.564 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:35:53.564 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:35:53.564 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:35:53.564 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:35:53.564 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:35:53.564 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:35:53.564 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:35:53.564 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:35:53.564 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:35:53.564 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:35:53.564 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:35:53.564 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:35:53.565 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:35:53.565 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:35:53.565 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:35:53.565 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:35:53.565 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:35:53.565 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:35:53.565 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:35:53.565 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:35:53.565 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:35:53.565 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:53.565 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:35:53.565 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:53.565 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:35:53.566 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:35:53.566 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:35:53.566 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:35:53.566 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:53.566 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:35:53.566 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:35:53.566 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:35:53.566 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:53.566 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:53.567 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:35:53.567 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:35:53.567 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:35:53.567 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:35:53.567 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:35:53.567 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:53.567 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:35:53.567 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:35:53.567 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:35:53.568 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:35:53.568 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:35:53.568 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:53.568 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:53.568 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:35:53.568 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:35:53.568 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:35:53.568 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:35:53.568 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:53.568 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:35:53.568 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:35:53.568 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:35:53.569 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:53.569 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:53.569 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:35:53.569 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:35:53.569 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:35:53.569 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:35:53.569 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:35:53.569 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:53.569 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:35:53.569 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:35:53.569 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:35:53.569 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:35:53.569 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:35:53.569 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:53.570 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:53.570 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:35:53.570 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:35:53.570 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:35:53.570 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:35:53.570 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:53.570 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:35:53.570 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:35:53.570 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:35:53.570 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:53.570 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:53.570 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:35:53.570 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:35:53.571 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:35:53.571 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:35:53.571 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:35:53.571 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:53.571 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:35:53.571 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:35:53.571 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:35:53.571 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:35:53.571 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:35:53.571 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:35:53.571 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:35:53.571 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:53.571 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:35:53.572 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:35:53.572 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:53.572 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:35:53.572 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:35:53.572 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:35:53.572 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:35:53.572 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:35:53.572 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:35:53.572 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:53.572 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:35:53.572 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:35:53.572 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 6 2024-08-24T21:35:53.572 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:35:53.572 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:35:53.573 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:35:53.573 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:53.573 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:35:53.573 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:35:53.573 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:35:53.573 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:35:53.573 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:35:53.573 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:35:53.573 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:35:53.573 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:35:53.573 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:35:53.573 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:35:53.573 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:35:53.574 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:35:53.574 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:35:53.574 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:35:53.574 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:35:53.575 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:35:53.575 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-08-24T21:35:53.889 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 50% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2024-08-24T21:35:53.911 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap58 - 2024-08-24T21:35:53.912 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:35:53.912 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:35:59.167 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:35:59.242 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=c637d5676e30cc71952ade343660ecba 2024-08-24T21:35:59.243 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap58 - 2024-08-24T21:35:59.243 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:35:59.244 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:36:04.797 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:36:04.807 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=c637d5676e30cc71952ade343660ecba 2024-08-24T21:36:04.807 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ c637d5676e30cc71952ade343660ecba != \c\6\3\7\d\5\6\7\6\e\3\0\c\c\7\1\9\5\2\a\d\e\3\4\3\6\6\0\e\c\b\a ]] 2024-08-24T21:36:04.807 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap58 2024-08-24T21:36:04.807 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap58 2024-08-24T21:36:04.807 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap58 2024-08-24T21:36:04.944 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:36:04.957 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:36:04.958 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap58 2024-08-24T21:36:04.959 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:36:05.042 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:36:05.042 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:36:05.042 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:36:05.042 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:36:05.042 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:36:05.043 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap59.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:36:05.902 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 52% complete... Importing image diff: 77% complete... Importing image diff: 97% complete... Importing image diff: 100% complete...done. 2024-08-24T21:36:05.922 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap59 - 2024-08-24T21:36:05.923 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:36:05.923 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:36:11.149 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:36:11.229 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=c637d5676e30cc71952ade343660ecba 2024-08-24T21:36:11.230 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap59 - 2024-08-24T21:36:11.230 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:36:11.230 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:36:13.576 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-08-24T21:36:13.576 INFO:tasks.ceph.mon.b:Restarting daemon 2024-08-24T21:36:13.576 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-08-24T21:36:13.581 INFO:tasks.ceph.mon.b:Started 2024-08-24T21:36:13.581 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:36:13.581 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:36:14.047 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":224,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:36:16.556 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:36:16.566 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=c637d5676e30cc71952ade343660ecba 2024-08-24T21:36:16.566 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ c637d5676e30cc71952ade343660ecba != \c\6\3\7\d\5\6\7\6\e\3\0\c\c\7\1\9\5\2\a\d\e\3\4\3\6\6\0\e\c\b\a ]] 2024-08-24T21:36:16.566 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap59 2024-08-24T21:36:16.566 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap59 2024-08-24T21:36:16.566 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap59 2024-08-24T21:36:16.673 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:36:16.685 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:36:16.686 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap59 2024-08-24T21:36:16.687 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:36:16.762 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:36:16.762 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:36:16.762 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:36:16.763 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:36:16.763 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:36:16.763 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap60.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:36:17.067 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:36:17.505 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":226,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:36:17.522 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:36:17.523 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:36:17.523 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:36:17.699 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:36:17.699 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:36:17.699 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:36:17.700 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:36:17.700 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 226, 2024-08-24T21:36:17.700 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 126014, 2024-08-24T21:36:17.700 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:36:17.700 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:36:17.700 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:36:17.700 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:36:17.700 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:36:17.700 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 3, 2024-08-24T21:36:17.700 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:36:17.700 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:36:17.700 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:36:17.701 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:36:17.701 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:36:17.701 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:36:17.701 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:36:17.701 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:36:17.701 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:36:17.701 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:36:17.701 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:36:17.701 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:36:17.701 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:36:17.701 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:36:17.701 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:36:17.701 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:36:17.702 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:36:17.702 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:36:17.702 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:36:17.702 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:36:17.702 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:36:17.702 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:36:17.702 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:36:17.702 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:36:17.702 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:36:17.702 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:36:17.702 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:36:17.702 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:36:17.703 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:36:17.703 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:17.703 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:36:17.703 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:36:17.703 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:36:17.703 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:36:17.703 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:36:17.703 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:36:17.703 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:36:17.703 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:36:17.703 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:36:17.703 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:36:17.704 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:36:17.704 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:36:17.704 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:36:17.704 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:36:17.704 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:36:17.704 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:36:17.704 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:36:17.704 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:36:17.704 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:36:17.704 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:36:17.704 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:36:17.704 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:36:17.704 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:36:17.705 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:36:17.705 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:36:17.705 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:36:17.705 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:36:17.705 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:36:17.705 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:36:17.705 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:36:17.705 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:17.705 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:36:17.705 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:17.705 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:36:17.705 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:36:17.705 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:36:17.706 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:36:17.706 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:17.706 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:36:17.706 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:36:17.706 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:36:17.706 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:17.706 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:17.706 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:36:17.706 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:36:17.706 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:36:17.706 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:36:17.706 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:36:17.707 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:17.707 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:36:17.707 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:36:17.707 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:36:17.707 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:36:17.707 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:36:17.707 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:17.707 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:17.707 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:36:17.707 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:36:17.707 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:36:17.707 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:36:17.707 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:17.708 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:36:17.708 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:36:17.708 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:36:17.708 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:17.708 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:17.708 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:36:17.708 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:36:17.708 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:36:17.708 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:36:17.708 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:36:17.708 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:17.708 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:36:17.708 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:36:17.709 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:36:17.709 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:36:17.709 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:36:17.709 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:17.709 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:17.709 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:36:17.709 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:36:17.709 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:36:17.709 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:36:17.709 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:17.709 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:36:17.709 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:36:17.709 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:36:17.710 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:17.710 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:17.710 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:36:17.710 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:36:17.710 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:36:17.710 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:36:17.710 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:36:17.710 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:17.710 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:36:17.710 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:36:17.710 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:36:17.710 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:36:17.710 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:36:17.711 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:36:17.711 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:36:17.711 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:17.711 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:36:17.711 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:36:17.711 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:17.711 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:36:17.711 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:36:17.711 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:36:17.711 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:36:17.711 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:36:17.711 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:36:17.711 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:17.712 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:36:17.712 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:36:17.712 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:36:17.712 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:36:17.712 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:36:17.712 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:36:17.712 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:17.712 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:36:17.712 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:36:17.712 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-08-24T21:36:17.712 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:36:17.712 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:36:17.712 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:17.713 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:36:17.713 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:36:17.714 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:36:17.714 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:36:17.714 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:36:17.890 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:36:17.891 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:36:17.891 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:36:17.891 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:36:17.891 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 226, 2024-08-24T21:36:17.891 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 458419, 2024-08-24T21:36:17.891 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:36:17.891 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:36:17.891 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:36:17.891 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:36:17.891 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:36:17.892 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 3, 2024-08-24T21:36:17.892 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:36:17.892 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:36:17.892 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:36:17.892 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:36:17.892 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:36:17.892 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:36:17.892 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:36:17.892 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:36:17.892 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:36:17.892 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:36:17.892 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:36:17.892 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:36:17.893 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:36:17.893 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:36:17.893 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:36:17.893 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:36:17.893 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:36:17.893 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:36:17.893 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:36:17.893 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:36:17.893 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:36:17.893 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:36:17.893 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:36:17.893 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:36:17.893 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:36:17.893 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:36:17.894 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:36:17.894 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:36:17.894 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:36:17.894 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:17.894 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:36:17.894 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:36:17.894 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:36:17.894 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:36:17.894 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:36:17.894 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:36:17.894 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:36:17.894 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:36:17.895 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:36:17.895 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:36:17.895 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:36:17.895 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:36:17.895 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:36:17.895 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:36:17.895 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:36:17.895 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:36:17.895 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:36:17.895 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:36:17.895 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:36:17.895 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:36:17.895 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:36:17.896 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:36:17.896 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:36:17.896 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:36:17.896 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:36:17.896 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:36:17.896 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:36:17.896 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:36:17.897 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:36:17.897 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:36:17.897 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:17.897 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:36:17.897 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:17.897 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:36:17.897 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:36:17.897 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:36:17.897 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:36:17.897 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:17.897 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:36:17.898 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:36:17.898 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:36:17.898 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:17.898 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:17.898 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:36:17.898 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:36:17.898 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:36:17.898 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:36:17.898 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:36:17.898 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:17.898 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:36:17.898 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:36:17.899 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:36:17.899 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:36:17.899 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:36:17.899 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:17.899 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:17.899 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:36:17.899 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:36:17.899 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:36:17.899 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:36:17.899 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:17.899 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:36:17.899 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:36:17.899 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:36:17.900 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:17.900 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:17.900 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:36:17.900 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:36:17.900 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:36:17.900 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:36:17.900 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:36:17.900 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:17.900 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:36:17.900 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:36:17.900 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:36:17.900 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:36:17.900 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:36:17.901 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:17.901 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:17.901 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:36:17.901 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:36:17.901 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:36:17.901 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:36:17.901 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:17.901 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:36:17.901 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:36:17.901 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:36:17.901 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:17.901 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:17.901 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:36:17.901 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:36:17.902 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:36:17.902 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:36:17.902 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:36:17.902 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:17.902 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:36:17.902 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:36:17.902 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:36:17.902 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:36:17.902 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:36:17.902 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:36:17.902 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:36:17.902 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:17.902 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:36:17.903 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:36:17.903 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:17.903 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:36:17.903 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:36:17.903 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:36:17.903 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:36:17.903 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:36:17.903 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:36:17.903 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:17.903 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:36:17.904 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:36:17.904 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 6 2024-08-24T21:36:17.904 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:36:17.904 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:36:17.904 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:36:17.904 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:17.904 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:36:17.904 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:36:17.904 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-08-24T21:36:17.904 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:36:17.904 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:36:17.904 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:36:17.905 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:17.905 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:36:17.905 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:36:17.905 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:36:17.905 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:36:17.905 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:36:17.905 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:17.905 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:36:17.905 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:36:17.906 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:36:17.907 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:36:17.907 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:36:17.926 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2024-08-24T21:36:17.946 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap60 - 2024-08-24T21:36:17.946 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:36:17.946 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:36:18.105 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:36:18.105 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:36:18.105 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:36:18.105 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:36:18.106 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 226, 2024-08-24T21:36:18.106 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 4377, 2024-08-24T21:36:18.106 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:36:18.106 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:36:18.106 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:36:18.106 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:36:18.106 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:36:18.106 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 3, 2024-08-24T21:36:18.106 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:36:18.106 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:36:18.106 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:36:18.106 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:36:18.106 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:36:18.107 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:36:18.107 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:36:18.107 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:36:18.107 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:36:18.107 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:36:18.107 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:36:18.107 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:36:18.107 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:36:18.107 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:36:18.107 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:36:18.107 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:36:18.107 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:36:18.108 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:36:18.108 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:36:18.108 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:36:18.108 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:36:18.108 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:36:18.108 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:36:18.108 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:36:18.108 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:36:18.108 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:36:18.108 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:36:18.108 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:36:18.108 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:36:18.108 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:18.109 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:36:18.109 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:36:18.109 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:36:18.109 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:36:18.109 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:36:18.109 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:36:18.109 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:36:18.109 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:36:18.109 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:36:18.109 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:36:18.109 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:36:18.109 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:36:18.109 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:36:18.110 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:36:18.110 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:36:18.110 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:36:18.110 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:36:18.110 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:36:18.110 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:36:18.110 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:36:18.110 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:36:18.110 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:36:18.110 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:36:18.110 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:36:18.111 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:36:18.111 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:36:18.111 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:36:18.111 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:36:18.111 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:36:18.111 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:36:18.111 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:18.111 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:36:18.111 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:18.111 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:36:18.111 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:36:18.111 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:36:18.111 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:36:18.112 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:18.112 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:36:18.112 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:36:18.112 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:36:18.112 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:18.112 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:18.112 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:36:18.112 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:36:18.112 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:36:18.112 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:36:18.112 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:36:18.112 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:18.112 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:36:18.113 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:36:18.113 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:36:18.113 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:36:18.113 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:36:18.113 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:18.113 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:18.113 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:36:18.113 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:36:18.113 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:36:18.113 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:36:18.113 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:18.113 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:36:18.113 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:36:18.113 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:36:18.114 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:18.114 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:18.114 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:36:18.114 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:36:18.114 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:36:18.114 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:36:18.114 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:36:18.114 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:18.114 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:36:18.114 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:36:18.114 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:36:18.114 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:36:18.114 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:36:18.115 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:18.115 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:18.115 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:36:18.115 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:36:18.115 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:36:18.115 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:36:18.115 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:18.115 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:36:18.115 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:36:18.115 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:36:18.115 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:18.115 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:18.116 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:36:18.116 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:36:18.116 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:36:18.116 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:36:18.116 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:36:18.116 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:18.116 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:36:18.116 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:36:18.116 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:36:18.116 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:36:18.116 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:36:18.116 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:36:18.116 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:36:18.117 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:18.117 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:36:18.117 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:36:18.117 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:18.117 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:36:18.117 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:36:18.117 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:36:18.117 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:36:18.117 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:36:18.117 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:36:18.117 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:18.117 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:36:18.117 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:36:18.118 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:36:18.118 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:36:18.118 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:36:18.118 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:18.118 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:36:18.118 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:36:18.121 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:36:18.121 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-08-24T21:36:18.121 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-08-24T21:36:18.594 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-08-24T21:36:19.596 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:36:19.596 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:36:20.074 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":226,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:36:20.091 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:36:20.092 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-08-24T21:36:20.092 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:36:20.092 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:36:20.266 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:36:20.267 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:36:20.267 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:36:20.267 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:36:20.267 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 226, 2024-08-24T21:36:20.267 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 128581, 2024-08-24T21:36:20.267 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:36:20.267 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:36:20.267 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:36:20.267 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:36:20.267 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:36:20.268 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 5, 2024-08-24T21:36:20.268 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:36:20.268 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:36:20.268 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:36:20.268 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:36:20.268 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:36:20.268 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:36:20.268 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:36:20.268 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:36:20.268 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:36:20.268 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:36:20.268 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:36:20.268 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:36:20.269 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:36:20.269 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:36:20.269 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:36:20.269 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:36:20.269 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:36:20.269 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:36:20.269 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:36:20.269 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:36:20.269 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:36:20.269 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:36:20.269 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:36:20.269 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:36:20.269 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:36:20.270 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:36:20.270 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:36:20.270 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:36:20.270 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:36:20.270 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:20.270 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:36:20.270 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:36:20.270 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:36:20.270 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:36:20.270 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:36:20.270 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:36:20.271 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:36:20.271 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:36:20.271 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:36:20.271 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:36:20.271 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:36:20.271 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:36:20.271 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:36:20.271 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:36:20.271 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:36:20.271 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:36:20.271 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:36:20.271 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:36:20.272 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:36:20.272 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:36:20.272 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:36:20.272 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:36:20.272 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:36:20.272 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:36:20.272 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:36:20.272 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:36:20.272 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:36:20.272 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:36:20.272 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:36:20.272 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:36:20.272 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:20.273 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:36:20.273 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:20.273 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:36:20.273 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:36:20.273 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:36:20.273 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:36:20.273 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:20.273 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:36:20.273 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:36:20.273 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:36:20.274 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:20.274 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:20.274 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:36:20.274 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:36:20.274 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:36:20.274 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:36:20.274 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:36:20.274 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:20.274 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:36:20.274 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:36:20.274 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:36:20.274 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:36:20.274 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:36:20.275 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:20.275 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:20.275 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:36:20.275 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:36:20.275 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:36:20.275 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:36:20.275 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:20.275 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:36:20.275 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:36:20.275 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:36:20.275 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:20.275 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:20.275 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:36:20.276 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:36:20.276 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:36:20.276 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:36:20.276 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:36:20.276 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:20.276 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:36:20.276 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:36:20.276 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:36:20.276 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:36:20.276 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:36:20.276 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:20.276 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:20.277 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:36:20.277 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:36:20.277 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:36:20.277 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:36:20.277 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:20.277 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:36:20.277 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:36:20.277 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:36:20.277 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:20.277 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:20.277 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:36:20.277 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:36:20.277 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:36:20.278 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:36:20.278 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:36:20.278 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:20.278 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:36:20.278 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:36:20.278 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:36:20.278 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:36:20.278 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:36:20.278 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:36:20.278 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:36:20.278 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:20.278 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:36:20.278 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:36:20.279 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:20.279 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:36:20.279 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:36:20.279 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:36:20.279 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:36:20.279 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:36:20.279 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:36:20.279 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:20.279 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:36:20.279 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:36:20.279 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:36:20.279 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:36:20.280 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:36:20.280 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:36:20.280 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:20.280 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:36:20.280 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:36:20.280 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:36:20.280 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:36:20.280 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:36:20.280 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:20.280 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:36:20.280 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:36:20.282 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:36:20.282 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:36:20.282 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:36:20.473 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:36:20.473 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:36:20.473 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:36:20.473 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:36:20.473 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 226, 2024-08-24T21:36:20.473 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 461001, 2024-08-24T21:36:20.473 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:36:20.474 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:36:20.474 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:36:20.474 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:36:20.474 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:36:20.474 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 6, 2024-08-24T21:36:20.474 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:36:20.474 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:36:20.474 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:36:20.474 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:36:20.474 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:36:20.474 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:36:20.474 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:36:20.475 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:36:20.475 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:36:20.475 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:36:20.475 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:36:20.475 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:36:20.475 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:36:20.475 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:36:20.475 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:36:20.475 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:36:20.475 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:36:20.475 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:36:20.475 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:36:20.475 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:36:20.476 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:36:20.476 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:36:20.476 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:36:20.476 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:36:20.476 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:36:20.476 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:36:20.476 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:36:20.476 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:36:20.476 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:36:20.476 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:20.476 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:36:20.476 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:36:20.477 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:36:20.477 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:36:20.477 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:36:20.477 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:36:20.477 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:36:20.477 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:36:20.477 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:36:20.477 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:36:20.477 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:36:20.477 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:36:20.477 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:36:20.477 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:36:20.478 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:36:20.478 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:36:20.478 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:36:20.478 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:36:20.478 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:36:20.478 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:36:20.478 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:36:20.478 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:36:20.478 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:36:20.478 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:36:20.478 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:36:20.478 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:36:20.479 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:36:20.479 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:36:20.479 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:36:20.479 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:36:20.479 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:20.479 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:36:20.479 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:20.479 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:36:20.479 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:36:20.479 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:36:20.479 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:36:20.479 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:20.479 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:36:20.480 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:36:20.480 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:36:20.480 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:20.480 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:20.480 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:36:20.480 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:36:20.480 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:36:20.480 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:36:20.481 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:36:20.481 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:20.481 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:36:20.481 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:36:20.481 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:36:20.481 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:36:20.481 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:36:20.481 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:20.481 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:20.481 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:36:20.481 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:36:20.481 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:36:20.482 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:36:20.482 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:20.482 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:36:20.482 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:36:20.482 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:36:20.482 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:20.482 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:20.482 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:36:20.482 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:36:20.482 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:36:20.482 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:36:20.482 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:36:20.483 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:20.483 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:36:20.483 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:36:20.483 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:36:20.483 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:36:20.483 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:36:20.483 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:20.483 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:20.483 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:36:20.483 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:36:20.483 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:36:20.484 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:36:20.484 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:20.484 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:36:20.484 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:36:20.484 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:36:20.484 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:20.484 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:20.484 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:36:20.484 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:36:20.484 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:36:20.484 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:36:20.484 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:36:20.484 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:20.484 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:36:20.485 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:36:20.485 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:36:20.485 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:36:20.485 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:36:20.485 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:36:20.485 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:36:20.485 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:20.485 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:36:20.485 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:36:20.485 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:20.485 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:36:20.485 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:36:20.486 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:36:20.486 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:36:20.486 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:36:20.487 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:36:20.487 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:20.487 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:36:20.487 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:36:20.487 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 6 2024-08-24T21:36:20.487 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:36:20.487 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:36:20.487 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:36:20.488 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:20.488 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:36:20.488 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:36:20.488 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:36:20.488 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:36:20.488 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:36:20.488 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:36:20.488 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:20.488 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:36:20.488 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:36:20.488 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:36:20.488 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:36:20.488 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:36:20.488 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:20.489 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:36:20.489 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:36:20.490 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:36:20.490 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:36:20.491 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:36:20.689 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:36:20.689 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:36:20.689 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:36:20.689 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:36:20.689 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 226, 2024-08-24T21:36:20.689 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 6962, 2024-08-24T21:36:20.689 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:36:20.689 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:36:20.689 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:36:20.689 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:36:20.690 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:36:20.690 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 6, 2024-08-24T21:36:20.690 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:36:20.690 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:36:20.690 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:36:20.690 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:36:20.690 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:36:20.690 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:36:20.690 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:36:20.690 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:36:20.690 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:36:20.690 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:36:20.690 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:36:20.691 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:36:20.691 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:36:20.691 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:36:20.691 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:36:20.691 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:36:20.691 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:36:20.691 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:36:20.691 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:36:20.691 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:36:20.691 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:36:20.691 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:36:20.691 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:36:20.691 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:36:20.692 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:36:20.692 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:36:20.692 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:36:20.692 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:36:20.692 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:36:20.692 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:20.692 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:36:20.692 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:36:20.692 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:36:20.692 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:36:20.692 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:36:20.692 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:36:20.692 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:36:20.693 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:36:20.693 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:36:20.693 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:36:20.693 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:36:20.693 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:36:20.693 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:36:20.693 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:36:20.693 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:36:20.693 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:36:20.693 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:36:20.693 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:36:20.693 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:36:20.694 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:36:20.694 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:36:20.694 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:36:20.694 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:36:20.694 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:36:20.694 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:36:20.694 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:36:20.694 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:36:20.694 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:36:20.694 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:36:20.694 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:36:20.694 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:20.694 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:36:20.695 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:20.695 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:36:20.695 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:36:20.695 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:36:20.695 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:36:20.695 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:20.695 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:36:20.695 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:36:20.695 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:36:20.695 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:20.695 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:20.695 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:36:20.695 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:36:20.696 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:36:20.696 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:36:20.696 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:36:20.696 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:20.696 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:36:20.696 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:36:20.696 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:36:20.696 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:36:20.696 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:36:20.696 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:20.696 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:20.696 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:36:20.696 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:36:20.696 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:36:20.697 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:36:20.697 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:20.697 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:36:20.697 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:36:20.697 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:36:20.697 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:20.697 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:20.697 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:36:20.697 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:36:20.697 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:36:20.697 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:36:20.697 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:36:20.697 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:20.697 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:36:20.698 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:36:20.698 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:36:20.698 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:36:20.698 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:36:20.698 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:20.698 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:20.698 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:36:20.698 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:36:20.698 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:36:20.698 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:36:20.698 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:20.698 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:36:20.698 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:36:20.699 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:36:20.699 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:20.699 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:20.699 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:36:20.699 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:36:20.699 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:36:20.699 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:36:20.699 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:36:20.699 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:20.699 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:36:20.699 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:36:20.699 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:36:20.699 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:36:20.700 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:36:20.700 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:36:20.700 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:36:20.700 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:20.700 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:36:20.700 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:36:20.700 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:20.700 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:36:20.700 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:36:20.700 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:36:20.700 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:36:20.700 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:36:20.700 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:36:20.700 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:20.701 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:36:20.701 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:36:20.701 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:36:20.701 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:36:20.701 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:36:20.701 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:20.701 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:36:20.701 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:36:20.703 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:36:20.703 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2024-08-24T21:36:20.703 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['c'] 2024-08-24T21:36:20.703 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-08-24T21:36:20.703 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-08-24T21:36:20.704 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-08-24T21:36:20.704 INFO:teuthology.orchestra.run:waiting for 300 2024-08-24T21:36:20.719 INFO:tasks.ceph.mon.b:Stopped 2024-08-24T21:36:20.720 INFO:tasks.mon_thrash:Sending STOP to mon c 2024-08-24T21:36:20.720 INFO:tasks.ceph.mon.c:Sent signal 19 2024-08-24T21:36:20.720 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-08-24T21:36:23.142 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:36:23.226 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=6cb0de93eb3895552bc5d2ce54a7ec45 2024-08-24T21:36:23.228 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap60 - 2024-08-24T21:36:23.228 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:36:23.228 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:36:28.651 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:36:28.661 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=6cb0de93eb3895552bc5d2ce54a7ec45 2024-08-24T21:36:28.661 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ 6cb0de93eb3895552bc5d2ce54a7ec45 != \6\c\b\0\d\e\9\3\e\b\3\8\9\5\5\5\2\b\c\5\d\2\c\e\5\4\a\7\e\c\4\5 ]] 2024-08-24T21:36:28.661 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap60 2024-08-24T21:36:28.662 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap60 2024-08-24T21:36:28.662 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap60 2024-08-24T21:36:35.721 INFO:tasks.mon_thrash:Sending CONT to mon c 2024-08-24T21:36:35.722 INFO:tasks.ceph.mon.c:Sent signal 18 2024-08-24T21:36:35.722 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-08-24T21:36:35.722 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:36:40.835 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:36:40.850 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:36:40.851 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap60 2024-08-24T21:36:40.851 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:36:40.938 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:36:40.938 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:36:40.938 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:36:40.939 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:36:40.939 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:36:40.939 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap61.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:36:41.051 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":228,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:36:41.072 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-08-24T21:36:41.072 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-08-24T21:36:41.072 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:36:41.419 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:36:41.419 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:36:41.419 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:36:41.419 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:36:41.419 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 228, 2024-08-24T21:36:41.420 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 149733, 2024-08-24T21:36:41.420 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:36:41.420 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:36:41.420 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:36:41.420 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:36:41.420 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:36:41.420 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:36:41.420 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:36:41.420 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:36:41.420 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:36:41.420 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:36:41.420 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:36:41.420 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:36:41.421 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:36:41.421 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:36:41.421 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:36:41.421 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:36:41.421 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:36:41.421 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:36:41.421 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:36:41.421 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:36:41.421 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:36:41.421 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:36:41.421 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:36:41.421 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:36:41.422 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:36:41.422 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:36:41.422 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:36:41.422 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:36:41.422 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:36:41.422 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:36:41.422 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:36:41.422 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:36:41.422 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:36:41.423 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:36:41.423 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:41.423 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:36:41.423 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:36:41.423 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:36:41.423 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:36:41.423 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:36:41.423 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:36:41.423 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:36:41.423 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:36:41.423 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:36:41.424 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:36:41.424 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:36:41.424 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:36:41.424 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:36:41.424 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:36:41.424 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:36:41.424 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:36:41.424 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:36:41.424 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:36:41.424 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:36:41.424 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:36:41.424 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:36:41.424 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:36:41.425 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:36:41.425 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:36:41.425 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:36:41.425 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:36:41.425 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:36:41.425 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:36:41.425 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:36:41.425 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:36:41.425 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:41.425 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:36:41.425 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:41.425 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:36:41.425 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:36:41.426 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:36:41.426 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:36:41.426 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:41.426 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:36:41.426 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:36:41.426 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:36:41.426 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:41.426 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:41.426 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:36:41.426 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:36:41.426 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:36:41.427 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:36:41.427 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:36:41.427 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:41.427 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:36:41.427 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:36:41.427 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:36:41.427 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:36:41.427 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:36:41.427 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:41.427 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:41.427 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:36:41.428 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:36:41.428 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:36:41.428 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:36:41.428 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:41.428 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:36:41.428 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:36:41.428 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:36:41.428 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:41.428 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:41.428 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:36:41.428 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:36:41.429 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:36:41.429 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:36:41.429 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:36:41.429 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:41.429 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:36:41.429 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:36:41.429 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:36:41.429 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:36:41.429 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:36:41.429 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:41.429 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:41.429 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:36:41.430 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:36:41.430 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:36:41.430 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:36:41.430 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:41.430 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:36:41.430 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:36:41.430 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:36:41.430 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:41.430 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:41.430 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:36:41.430 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:36:41.430 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:36:41.430 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:36:41.431 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:36:41.431 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:41.431 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:36:41.431 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:36:41.431 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:36:41.431 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:36:41.431 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:36:41.431 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:36:41.431 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:36:41.431 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:41.431 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:36:41.431 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:36:41.431 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:41.431 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:36:41.432 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:36:41.432 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:36:41.432 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:36:41.432 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:36:41.432 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:36:41.432 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:41.432 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:36:41.432 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:36:41.432 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:36:41.432 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:36:41.432 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:36:41.432 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:36:41.432 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:41.433 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:36:41.433 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:36:41.433 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:36:41.433 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:36:41.433 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:36:41.433 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:41.433 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:36:41.433 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:36:41.450 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:36:41.450 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-08-24T21:36:41.450 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:36:41.686 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:36:41.686 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:36:41.686 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:36:41.687 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:36:41.687 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 228, 2024-08-24T21:36:41.687 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 482215, 2024-08-24T21:36:41.687 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:36:41.687 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:36:41.687 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:36:41.687 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:36:41.687 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:36:41.687 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:36:41.687 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:36:41.687 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:36:41.688 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:36:41.688 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:36:41.688 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:36:41.688 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:36:41.688 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:36:41.688 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:36:41.688 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:36:41.688 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:36:41.688 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:36:41.688 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:36:41.688 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:36:41.688 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:36:41.688 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:36:41.689 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:36:41.689 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:36:41.689 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:36:41.689 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:36:41.689 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:36:41.689 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:36:41.689 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:36:41.689 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:36:41.689 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:36:41.689 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:36:41.689 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:36:41.689 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:36:41.690 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:36:41.690 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:41.690 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:36:41.690 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:36:41.690 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:36:41.690 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:36:41.690 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:36:41.690 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:36:41.690 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:36:41.690 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:36:41.690 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:36:41.690 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:36:41.691 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:36:41.691 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:36:41.691 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:36:41.691 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:36:41.691 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:36:41.691 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:36:41.691 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:36:41.691 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:36:41.691 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:36:41.691 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:36:41.691 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:36:41.691 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:36:41.692 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:36:41.692 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:36:41.692 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:36:41.692 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:36:41.692 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:36:41.692 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:36:41.692 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:36:41.692 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:36:41.692 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:41.692 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:36:41.692 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:41.692 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:36:41.692 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:36:41.693 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:36:41.693 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:36:41.693 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:41.693 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:36:41.693 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:36:41.693 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:36:41.693 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:41.693 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:41.693 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:36:41.693 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:36:41.693 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:36:41.693 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:36:41.693 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:36:41.694 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:41.694 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:36:41.694 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:36:41.694 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:36:41.694 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:36:41.694 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:36:41.694 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:41.694 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:41.694 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:36:41.694 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:36:41.694 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:36:41.694 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:36:41.694 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:41.695 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:36:41.695 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:36:41.695 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:36:41.695 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:41.695 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:41.695 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:36:41.695 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:36:41.695 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:36:41.695 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:36:41.695 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:36:41.695 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:41.695 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:36:41.695 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:36:41.697 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:36:41.697 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:36:41.697 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:36:41.697 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:41.697 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:41.697 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:36:41.698 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:36:41.698 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:36:41.698 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:36:41.698 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:41.698 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:36:41.698 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:36:41.698 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:36:41.698 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:41.698 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:41.698 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:36:41.699 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:36:41.699 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:36:41.699 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:36:41.699 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:36:41.699 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:41.699 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:36:41.699 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:36:41.699 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:36:41.699 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:36:41.699 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:36:41.699 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:36:41.699 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:36:41.700 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:41.700 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:36:41.700 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:36:41.700 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:41.700 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:36:41.700 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:36:41.700 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:36:41.700 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:36:41.700 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:36:41.700 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:36:41.700 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:41.700 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:36:41.700 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:36:41.701 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 6 2024-08-24T21:36:41.701 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:36:41.701 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:36:41.701 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:36:41.701 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:41.701 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:36:41.701 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:36:41.701 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-08-24T21:36:41.701 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:36:41.701 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:36:41.701 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:36:41.701 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:36:41.701 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:36:41.702 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:36:41.702 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:36:41.702 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:36:41.702 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:36:41.702 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:36:41.702 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:36:41.702 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:36:41.703 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:36:41.703 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-08-24T21:36:41.768 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 24% complete... Importing image diff: 25% complete... Importing image diff: 50% complete... Importing image diff: 75% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2024-08-24T21:36:41.785 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap61 - 2024-08-24T21:36:41.786 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:36:41.786 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:36:46.997 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:36:47.068 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=3ea08e9fdb8504a2ab94aa9d5fa521a9 2024-08-24T21:36:47.070 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap61 - 2024-08-24T21:36:47.070 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:36:47.070 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:36:52.439 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:36:52.449 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=3ea08e9fdb8504a2ab94aa9d5fa521a9 2024-08-24T21:36:52.450 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ 3ea08e9fdb8504a2ab94aa9d5fa521a9 != \3\e\a\0\8\e\9\f\d\b\8\5\0\4\a\2\a\b\9\4\a\a\9\d\5\f\a\5\2\1\a\9 ]] 2024-08-24T21:36:52.450 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap61 2024-08-24T21:36:52.450 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap61 2024-08-24T21:36:52.450 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap61 2024-08-24T21:36:52.556 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:36:52.568 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:36:52.569 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap61 2024-08-24T21:36:52.569 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:36:52.647 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:36:52.647 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:36:52.648 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:36:52.648 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:36:52.648 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:36:52.648 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap62.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:36:53.785 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 10% complete... Importing image diff: 20% complete... Importing image diff: 30% complete... Importing image diff: 40% complete... Importing image diff: 50% complete... Importing image diff: 60% complete... Importing image diff: 70% complete... Importing image diff: 80% complete... Importing image diff: 90% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2024-08-24T21:36:53.803 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap62 - 2024-08-24T21:36:53.803 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:36:53.803 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:36:58.986 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:36:59.058 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=b858851f9cc13df8fa707ef78d8c12e5 2024-08-24T21:36:59.059 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap62 - 2024-08-24T21:36:59.059 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:36:59.060 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:37:01.704 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-08-24T21:37:01.704 INFO:tasks.ceph.mon.b:Restarting daemon 2024-08-24T21:37:01.704 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-08-24T21:37:01.709 INFO:tasks.ceph.mon.b:Started 2024-08-24T21:37:01.709 INFO:tasks.mon_thrash:Sending STOP to mon c 2024-08-24T21:37:01.709 INFO:tasks.ceph.mon.c:Sent signal 19 2024-08-24T21:37:01.709 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-08-24T21:37:04.454 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:37:04.465 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=b858851f9cc13df8fa707ef78d8c12e5 2024-08-24T21:37:04.465 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ b858851f9cc13df8fa707ef78d8c12e5 != \b\8\5\8\8\5\1\f\9\c\c\1\3\d\f\8\f\a\7\0\7\e\f\7\8\d\8\c\1\2\e\5 ]] 2024-08-24T21:37:04.465 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap62 2024-08-24T21:37:04.465 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap62 2024-08-24T21:37:04.465 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap62 2024-08-24T21:37:04.573 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:37:04.585 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:37:04.586 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap62 2024-08-24T21:37:04.586 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:37:09.949 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:37:09.949 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:37:09.949 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:37:09.949 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:37:09.949 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:37:09.949 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap63.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:37:11.690 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 52% complete... Importing image diff: 77% complete... Importing image diff: 97% complete... Importing image diff: 100% complete...done. 2024-08-24T21:37:11.711 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap63 - 2024-08-24T21:37:11.712 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:37:11.712 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:37:16.710 INFO:tasks.mon_thrash:Sending CONT to mon c 2024-08-24T21:37:16.711 INFO:tasks.ceph.mon.c:Sent signal 18 2024-08-24T21:37:16.711 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:37:16.711 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:37:16.853 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:37:16.909 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=b858851f9cc13df8fa707ef78d8c12e5 2024-08-24T21:37:16.910 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap63 - 2024-08-24T21:37:16.910 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:37:16.910 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:37:17.164 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":232,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:37:17.182 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:37:17.182 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:37:17.182 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:37:17.366 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:37:17.366 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:37:17.366 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:37:17.366 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:37:17.366 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 232, 2024-08-24T21:37:17.366 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 185681, 2024-08-24T21:37:17.366 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:37:17.366 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:37:17.366 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:37:17.366 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:37:17.367 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:37:17.367 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:37:17.367 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:37:17.367 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:37:17.367 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:37:17.367 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:37:17.367 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:37:17.367 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:37:17.367 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:37:17.367 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:37:17.367 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:37:17.367 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:37:17.368 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:37:17.368 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:37:17.368 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:37:17.368 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:37:17.368 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:37:17.368 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:37:17.368 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:37:17.368 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:37:17.368 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:37:17.368 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:37:17.368 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:37:17.368 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:37:17.368 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:37:17.369 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:37:17.369 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:37:17.369 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:37:17.369 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:37:17.369 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:37:17.369 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:37:17.369 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:17.369 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:37:17.369 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:37:17.369 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:37:17.369 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:37:17.369 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:37:17.369 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:37:17.370 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:37:17.370 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:37:17.370 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:37:17.370 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:37:17.370 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:37:17.370 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:37:17.370 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:37:17.370 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:37:17.370 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:37:17.370 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:37:17.370 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:37:17.370 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:37:17.370 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:37:17.371 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:37:17.371 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:37:17.371 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:37:17.371 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:37:17.371 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:37:17.371 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:37:17.371 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:37:17.371 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:37:17.371 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:37:17.371 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:37:17.371 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:37:17.371 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:17.371 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:37:17.372 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:17.372 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:37:17.372 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:37:17.372 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:37:17.372 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:37:17.372 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:17.372 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:37:17.372 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:37:17.372 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:37:17.372 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:17.372 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:17.372 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:37:17.373 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:37:17.373 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:37:17.373 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:37:17.373 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:37:17.373 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:17.373 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:37:17.373 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:37:17.373 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:37:17.373 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:37:17.373 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:37:17.373 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:17.373 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:17.373 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:37:17.374 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:37:17.374 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:37:17.374 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:37:17.374 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:17.374 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:37:17.374 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:37:17.374 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:37:17.374 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:17.374 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:17.374 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:37:17.374 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:37:17.374 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:37:17.375 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:37:17.375 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:37:17.375 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:17.375 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:37:17.375 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:37:17.375 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:37:17.375 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:37:17.375 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:37:17.375 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:17.375 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:17.375 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:37:17.375 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:37:17.375 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:37:17.376 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:37:17.376 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:17.376 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:37:17.376 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:37:17.376 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:37:17.376 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:17.376 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:17.376 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:37:17.376 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:37:17.376 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:37:17.376 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:37:17.376 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:37:17.376 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:17.376 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:37:17.377 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:37:17.377 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:37:17.377 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:37:17.377 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:37:17.377 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:37:17.377 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:37:17.377 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:17.377 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:37:17.377 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:37:17.377 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:17.377 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:37:17.377 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:37:17.378 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:37:17.378 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:37:17.378 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:37:17.378 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:37:17.378 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:17.378 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:37:17.378 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:37:17.378 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:37:17.378 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:37:17.378 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:37:17.378 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:37:17.378 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:17.379 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:37:17.379 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:37:17.379 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:37:17.379 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:37:17.379 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:37:17.379 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:17.379 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:37:17.379 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:37:17.381 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:37:17.381 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:37:17.381 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:37:17.567 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:37:17.567 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:37:17.567 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:37:17.567 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:37:17.567 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 232, 2024-08-24T21:37:17.567 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 518097, 2024-08-24T21:37:17.567 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:37:17.567 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:37:17.568 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:37:17.568 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:37:17.568 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:37:17.568 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:37:17.568 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:37:17.568 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:37:17.568 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:37:17.568 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:37:17.568 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:37:17.568 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:37:17.568 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:37:17.568 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:37:17.568 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:37:17.569 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:37:17.569 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:37:17.569 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:37:17.569 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:37:17.569 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:37:17.569 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:37:17.569 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:37:17.569 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:37:17.569 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:37:17.569 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:37:17.569 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:37:17.569 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:37:17.570 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:37:17.570 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:37:17.570 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:37:17.570 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:37:17.570 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:37:17.570 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:37:17.570 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:37:17.570 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:37:17.570 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:17.570 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:37:17.570 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:37:17.570 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:37:17.570 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:37:17.571 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:37:17.571 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:37:17.571 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:37:17.571 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:37:17.571 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:37:17.571 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:37:17.571 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:37:17.571 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:37:17.571 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:37:17.571 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:37:17.571 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:37:17.572 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:37:17.572 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:37:17.572 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:37:17.572 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:37:17.572 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:37:17.572 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:37:17.572 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:37:17.572 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:37:17.572 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:37:17.572 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:37:17.572 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:37:17.572 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:37:17.572 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:37:17.573 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:37:17.573 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:37:17.573 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:17.573 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:37:17.573 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:17.573 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:37:17.573 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:37:17.573 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:37:17.573 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:37:17.573 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:17.573 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:37:17.573 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:37:17.574 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:37:17.574 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:17.574 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:17.574 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:37:17.574 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:37:17.574 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:37:17.574 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:37:17.574 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:37:17.574 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:17.574 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:37:17.574 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:37:17.574 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:37:17.575 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:37:17.575 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:37:17.575 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:17.575 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:17.575 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:37:17.575 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:37:17.575 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:37:17.575 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:37:17.575 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:17.575 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:37:17.575 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:37:17.575 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:37:17.575 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:17.576 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:17.576 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:37:17.576 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:37:17.576 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:37:17.576 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:37:17.576 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:37:17.576 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:17.576 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:37:17.576 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:37:17.576 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:37:17.576 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:37:17.576 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:37:17.576 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:17.577 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:17.577 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:37:17.577 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:37:17.577 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:37:17.577 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:37:17.577 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:17.577 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:37:17.577 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:37:17.577 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:37:17.577 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:17.577 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:17.577 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:37:17.577 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:37:17.578 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:37:17.578 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:37:17.578 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:37:17.578 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:17.578 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:37:17.578 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:37:17.578 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:37:17.578 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:37:17.578 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:37:17.578 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:37:17.578 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:37:17.578 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:17.579 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:37:17.579 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:37:17.579 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:17.579 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:37:17.579 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:37:17.579 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:37:17.579 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:37:17.579 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:37:17.579 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:37:17.579 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:17.579 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:37:17.579 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:37:17.580 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 6 2024-08-24T21:37:17.580 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:37:17.580 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:37:17.580 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:37:17.580 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:17.580 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:37:17.580 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:37:17.580 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:37:17.580 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:37:17.580 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:37:17.580 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:37:17.580 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:17.580 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:37:17.581 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:37:17.581 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:37:17.581 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:37:17.581 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:37:17.581 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:17.581 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:37:17.581 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:37:17.584 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:37:17.584 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:37:17.584 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:37:17.770 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:37:17.770 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:37:17.770 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:37:17.770 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:37:17.770 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 232, 2024-08-24T21:37:17.770 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 15913, 2024-08-24T21:37:17.770 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:37:17.770 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:37:17.771 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:37:17.771 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:37:17.771 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:37:17.771 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 1, 2024-08-24T21:37:17.771 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:37:17.771 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:37:17.771 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:37:17.771 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:37:17.771 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:37:17.771 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:37:17.771 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:37:17.771 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:37:17.771 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:37:17.772 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:37:17.772 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:37:17.772 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:37:17.772 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:37:17.772 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:37:17.772 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:37:17.772 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:37:17.772 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:37:17.772 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:37:17.772 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:37:17.772 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:37:17.772 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:37:17.772 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:37:17.773 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:37:17.775 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:37:17.775 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:37:17.775 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:37:17.775 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:37:17.775 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:37:17.775 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:37:17.775 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:17.775 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:37:17.775 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:37:17.775 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:37:17.775 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:37:17.776 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:37:17.776 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:37:17.776 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:37:17.776 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:37:17.776 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:37:17.776 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:37:17.776 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:37:17.776 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:37:17.776 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:37:17.776 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:37:17.776 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:37:17.776 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:37:17.776 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:37:17.777 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:37:17.777 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:37:17.777 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:37:17.777 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:37:17.777 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:37:17.777 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:37:17.777 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:37:17.777 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:37:17.777 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:37:17.777 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:37:17.778 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:37:17.778 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:37:17.778 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:37:17.778 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:17.778 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:37:17.778 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:17.778 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:37:17.778 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:37:17.778 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:37:17.778 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:37:17.778 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:17.778 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:37:17.779 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:37:17.779 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:37:17.779 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:17.779 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:17.779 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:37:17.779 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:37:17.779 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:37:17.779 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:37:17.779 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:37:17.779 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:17.779 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:37:17.779 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:37:17.779 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:37:17.779 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:37:17.780 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:37:17.780 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:17.780 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:17.780 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:37:17.780 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:37:17.780 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:37:17.780 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:37:17.780 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:17.780 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:37:17.780 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:37:17.780 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:37:17.780 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:17.780 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:17.781 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:37:17.781 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:37:17.781 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:37:17.781 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:37:17.781 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:37:17.781 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:17.781 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:37:17.781 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:37:17.781 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:37:17.781 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:37:17.781 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:37:17.781 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:17.781 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:17.782 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:37:17.782 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:37:17.782 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:37:17.782 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:37:17.782 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:17.782 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:37:17.782 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:37:17.782 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:37:17.782 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:17.782 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:17.782 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:37:17.782 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:37:17.782 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:37:17.783 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:37:17.783 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:37:17.783 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:17.783 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:37:17.783 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:37:17.783 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:37:17.783 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:37:17.783 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:37:17.783 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:37:17.783 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:37:17.783 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:17.783 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:37:17.783 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:37:17.783 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:17.784 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:37:17.784 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:37:17.784 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:37:17.784 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:37:17.784 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:37:17.784 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:37:17.784 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:17.784 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:37:17.784 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:37:17.784 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:37:17.784 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:37:17.784 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:37:17.784 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:17.784 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:37:17.785 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:37:17.786 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:37:17.786 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-08-24T21:37:17.786 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-08-24T21:37:18.279 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-08-24T21:37:19.280 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:37:19.280 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:37:19.747 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":232,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:37:19.766 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:37:19.766 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-08-24T21:37:19.766 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:37:19.766 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:37:19.953 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:37:19.953 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:37:19.953 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:37:19.954 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:37:19.954 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 232, 2024-08-24T21:37:19.954 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 188269, 2024-08-24T21:37:19.954 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:37:19.954 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:37:19.954 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:37:19.954 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:37:19.954 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:37:19.954 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 3, 2024-08-24T21:37:19.954 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:37:19.954 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:37:19.955 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:37:19.955 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:37:19.955 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:37:19.955 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:37:19.955 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:37:19.955 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:37:19.955 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:37:19.955 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:37:19.955 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:37:19.955 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:37:19.955 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:37:19.955 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:37:19.956 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:37:19.956 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:37:19.956 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:37:19.956 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:37:19.956 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:37:19.956 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:37:19.956 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:37:19.956 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:37:19.956 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:37:19.956 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:37:19.956 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:37:19.956 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:37:19.956 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:37:19.957 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:37:19.957 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:37:19.957 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:19.957 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:37:19.957 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:37:19.957 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:37:19.957 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:37:19.957 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:37:19.957 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:37:19.957 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:37:19.957 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:37:19.957 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:37:19.957 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:37:19.958 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:37:19.958 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:37:19.958 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:37:19.958 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:37:19.958 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:37:19.958 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:37:19.958 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:37:19.958 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:37:19.958 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:37:19.958 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:37:19.958 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:37:19.958 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:37:19.959 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:37:19.959 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:37:19.959 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:37:19.959 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:37:19.959 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:37:19.959 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:37:19.959 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:37:19.959 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:37:19.959 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:19.959 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:37:19.959 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:19.959 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:37:19.959 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:37:19.960 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:37:19.960 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:37:19.960 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:19.960 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:37:19.960 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:37:19.960 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:37:19.960 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:19.960 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:19.960 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:37:19.960 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:37:19.960 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:37:19.960 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:37:19.961 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:37:19.961 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:19.961 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:37:19.961 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:37:19.961 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:37:19.961 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:37:19.961 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:37:19.961 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:19.961 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:19.961 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:37:19.961 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:37:19.961 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:37:19.961 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:37:19.962 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:19.962 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:37:19.962 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:37:19.962 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:37:19.962 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:19.962 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:19.962 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:37:19.962 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:37:19.962 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:37:19.962 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:37:19.962 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:37:19.962 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:19.963 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:37:19.963 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:37:19.963 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:37:19.963 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:37:19.963 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:37:19.963 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:19.963 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:19.963 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:37:19.963 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:37:19.963 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:37:19.963 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:37:19.963 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:19.963 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:37:19.964 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:37:19.964 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:37:19.964 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:19.964 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:19.964 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:37:19.964 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:37:19.964 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:37:19.964 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:37:19.964 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:37:19.964 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:19.964 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:37:19.964 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:37:19.964 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:37:19.965 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:37:19.965 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:37:19.965 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:37:19.965 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:37:19.965 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:19.965 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:37:19.965 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:37:19.965 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:19.965 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:37:19.965 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:37:19.965 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:37:19.965 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:37:19.965 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:37:19.966 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:37:19.966 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:19.966 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:37:19.966 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:37:19.966 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:37:19.966 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:37:19.966 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:37:19.966 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:37:19.966 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:19.966 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:37:19.966 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:37:19.966 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-08-24T21:37:19.966 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:37:19.967 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:37:19.967 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:19.967 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:37:19.967 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:37:19.968 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:37:19.968 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:37:19.969 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:37:20.153 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:37:20.154 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:37:20.154 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:37:20.154 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:37:20.154 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 232, 2024-08-24T21:37:20.154 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 520683, 2024-08-24T21:37:20.154 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:37:20.154 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:37:20.154 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:37:20.154 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:37:20.154 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:37:20.154 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 3, 2024-08-24T21:37:20.155 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:37:20.155 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:37:20.155 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:37:20.155 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:37:20.155 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:37:20.155 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:37:20.155 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:37:20.155 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:37:20.155 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:37:20.155 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:37:20.155 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:37:20.155 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:37:20.156 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:37:20.156 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:37:20.156 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:37:20.156 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:37:20.156 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:37:20.156 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:37:20.156 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:37:20.156 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:37:20.156 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:37:20.156 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:37:20.156 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:37:20.156 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:37:20.156 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:37:20.156 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:37:20.157 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:37:20.157 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:37:20.157 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:37:20.157 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:20.157 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:37:20.157 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:37:20.157 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:37:20.157 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:37:20.157 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:37:20.157 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:37:20.157 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:37:20.157 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:37:20.158 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:37:20.158 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:37:20.158 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:37:20.158 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:37:20.158 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:37:20.158 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:37:20.158 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:37:20.158 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:37:20.158 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:37:20.158 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:37:20.159 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:37:20.159 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:37:20.159 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:37:20.159 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:37:20.159 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:37:20.159 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:37:20.159 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:37:20.159 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:37:20.159 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:37:20.159 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:37:20.159 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:37:20.159 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:37:20.159 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:20.160 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:37:20.160 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:20.160 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:37:20.160 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:37:20.160 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:37:20.160 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:37:20.160 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:20.160 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:37:20.160 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:37:20.160 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:37:20.160 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:20.160 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:20.160 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:37:20.161 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:37:20.161 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:37:20.161 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:37:20.161 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:37:20.161 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:20.161 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:37:20.161 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:37:20.161 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:37:20.161 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:37:20.161 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:37:20.161 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:20.161 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:20.162 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:37:20.162 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:37:20.162 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:37:20.162 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:37:20.162 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:20.162 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:37:20.162 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:37:20.162 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:37:20.162 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:20.162 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:20.162 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:37:20.162 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:37:20.162 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:37:20.163 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:37:20.163 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:37:20.163 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:20.163 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:37:20.163 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:37:20.163 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:37:20.163 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:37:20.163 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:37:20.163 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:20.163 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:20.163 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:37:20.163 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:37:20.164 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:37:20.164 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:37:20.164 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:20.164 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:37:20.164 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:37:20.164 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:37:20.164 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:20.164 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:20.164 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:37:20.164 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:37:20.164 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:37:20.164 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:37:20.164 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:37:20.165 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:20.165 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:37:20.165 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:37:20.165 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:37:20.165 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:37:20.165 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:37:20.165 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:37:20.165 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:37:20.165 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:20.165 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:37:20.165 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:37:20.165 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:20.165 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:37:20.166 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:37:20.166 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:37:20.166 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:37:20.166 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:37:20.166 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:37:20.166 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:20.166 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:37:20.166 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:37:20.166 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 6 2024-08-24T21:37:20.166 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:37:20.166 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:37:20.166 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:37:20.166 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:20.167 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:37:20.167 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:37:20.167 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:37:20.167 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:37:20.167 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:37:20.167 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:37:20.167 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:20.167 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:37:20.167 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:37:20.167 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:37:20.167 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:37:20.167 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:37:20.167 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:20.167 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:37:20.168 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:37:20.169 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:37:20.169 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:37:20.169 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:37:20.359 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:37:20.359 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:37:20.359 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:37:20.359 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:37:20.359 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 232, 2024-08-24T21:37:20.359 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 18502, 2024-08-24T21:37:20.359 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:37:20.359 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:37:20.359 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:37:20.359 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:37:20.360 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:37:20.360 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 3, 2024-08-24T21:37:20.360 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:37:20.360 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:37:20.360 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:37:20.360 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:37:20.360 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:37:20.360 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:37:20.360 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:37:20.360 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:37:20.360 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:37:20.360 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:37:20.361 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:37:20.361 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:37:20.361 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:37:20.361 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:37:20.361 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:37:20.361 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:37:20.361 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:37:20.361 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:37:20.361 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:37:20.361 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:37:20.361 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:37:20.361 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:37:20.361 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:37:20.362 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:37:20.362 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:37:20.362 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:37:20.362 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:37:20.362 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:37:20.362 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:37:20.362 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:20.362 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:37:20.362 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:37:20.362 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:37:20.362 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:37:20.362 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:37:20.362 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:37:20.363 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:37:20.363 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:37:20.363 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:37:20.363 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:37:20.363 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:37:20.363 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:37:20.363 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:37:20.363 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:37:20.363 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:37:20.363 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:37:20.363 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:37:20.363 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:37:20.364 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:37:20.364 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:37:20.364 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:37:20.364 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:37:20.364 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:37:20.364 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:37:20.364 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:37:20.364 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:37:20.364 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:37:20.364 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:37:20.364 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:37:20.364 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:37:20.364 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:20.365 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:37:20.365 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:20.365 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:37:20.365 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:37:20.365 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:37:20.365 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:37:20.365 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:20.365 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:37:20.365 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:37:20.365 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:37:20.365 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:20.365 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:20.365 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:37:20.365 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:37:20.366 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:37:20.366 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:37:20.366 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:37:20.366 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:20.366 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:37:20.366 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:37:20.366 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:37:20.366 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:37:20.366 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:37:20.366 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:20.366 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:20.366 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:37:20.367 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:37:20.367 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:37:20.367 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:37:20.367 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:20.367 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:37:20.367 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:37:20.367 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:37:20.367 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:20.367 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:20.367 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:37:20.367 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:37:20.367 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:37:20.367 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:37:20.367 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:37:20.368 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:20.368 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:37:20.368 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:37:20.368 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:37:20.368 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:37:20.368 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:37:20.368 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:20.368 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:20.368 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:37:20.368 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:37:20.368 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:37:20.368 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:37:20.368 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:20.369 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:37:20.369 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:37:20.369 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:37:20.369 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:20.369 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:20.369 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:37:20.369 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:37:20.369 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:37:20.369 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:37:20.369 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:37:20.369 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:20.369 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:37:20.369 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:37:20.370 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:37:20.370 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:37:20.370 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:37:20.370 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:37:20.370 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:37:20.370 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:20.370 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:37:20.370 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:37:20.370 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:20.370 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:37:20.370 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:37:20.370 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:37:20.370 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:37:20.371 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:37:20.371 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:37:20.371 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:20.371 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:37:20.371 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:37:20.371 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:37:20.371 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:37:20.371 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:37:20.371 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:20.371 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:37:20.371 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:37:20.374 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:37:20.375 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2024-08-24T21:37:20.375 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['a'] 2024-08-24T21:37:20.375 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-08-24T21:37:20.375 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-08-24T21:37:20.375 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-08-24T21:37:20.375 INFO:teuthology.orchestra.run:waiting for 300 2024-08-24T21:37:20.397 INFO:tasks.ceph.mon.c:Stopped 2024-08-24T21:37:20.398 INFO:tasks.mon_thrash:Sending STOP to mon a 2024-08-24T21:37:20.398 INFO:tasks.ceph.mon.a:Sent signal 19 2024-08-24T21:37:20.398 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-08-24T21:37:22.322 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:37:22.332 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=b858851f9cc13df8fa707ef78d8c12e5 2024-08-24T21:37:22.332 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ b858851f9cc13df8fa707ef78d8c12e5 != \b\8\5\8\8\5\1\f\9\c\c\1\3\d\f\8\f\a\7\0\7\e\f\7\8\d\8\c\1\2\e\5 ]] 2024-08-24T21:37:22.332 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap63 2024-08-24T21:37:22.332 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap63 2024-08-24T21:37:22.333 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap63 2024-08-24T21:37:25.461 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:37:25.475 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:37:25.476 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap63 2024-08-24T21:37:25.477 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:37:28.576 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:37:28.576 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:37:28.576 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:37:28.576 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:37:28.576 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:37:28.576 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap64.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:37:35.399 INFO:tasks.mon_thrash:Sending CONT to mon a 2024-08-24T21:37:35.399 INFO:tasks.ceph.mon.a:Sent signal 18 2024-08-24T21:37:35.400 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-08-24T21:37:35.400 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:37:40.714 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":236,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:37:40.743 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-08-24T21:37:40.743 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-08-24T21:37:40.744 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:37:41.058 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:37:41.059 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:37:41.059 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:37:41.059 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:37:41.059 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 236, 2024-08-24T21:37:41.059 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 209374, 2024-08-24T21:37:41.059 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:37:41.059 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:37:41.059 INFO:teuthology.orchestra.run.smithi060.stdout: 1 2024-08-24T21:37:41.059 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:37:41.059 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:37:41.059 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:37:41.059 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:37:41.059 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:37:41.060 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:37:41.060 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:37:41.060 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:37:41.060 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:37:41.060 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:37:41.060 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:37:41.060 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:37:41.060 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:37:41.060 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:37:41.060 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:37:41.060 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:37:41.060 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:37:41.061 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:37:41.061 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:37:41.061 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:37:41.061 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:37:41.061 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:37:41.061 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:37:41.061 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:37:41.061 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:37:41.061 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:37:41.061 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:37:41.061 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:37:41.061 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:37:41.062 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:37:41.062 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:37:41.062 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:41.062 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:37:41.062 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:37:41.062 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:37:41.062 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:37:41.062 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:37:41.062 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:37:41.062 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:37:41.062 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:37:41.062 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:37:41.063 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:37:41.063 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:37:41.063 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:37:41.063 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:37:41.063 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:37:41.063 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:37:41.063 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:37:41.063 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:37:41.063 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:37:41.063 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:37:41.063 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:37:41.063 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:37:41.064 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:37:41.064 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:37:41.064 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:37:41.064 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:37:41.064 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:37:41.064 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:37:41.064 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:37:41.064 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:37:41.064 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:37:41.064 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:41.064 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:37:41.064 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:41.064 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:37:41.065 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:37:41.065 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:37:41.065 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:37:41.065 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:41.065 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:37:41.065 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:37:41.065 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:37:41.065 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:41.066 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:41.066 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:37:41.066 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:37:41.066 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:37:41.066 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:37:41.066 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:37:41.066 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:41.066 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:37:41.066 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:37:41.066 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:37:41.066 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:37:41.066 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:37:41.066 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:41.067 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:41.067 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:37:41.067 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:37:41.067 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:37:41.067 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:37:41.067 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:41.067 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:37:41.067 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:37:41.067 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:37:41.067 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:41.067 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:41.067 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:37:41.068 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:37:41.068 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:37:41.068 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:37:41.068 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:37:41.068 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:41.068 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:37:41.068 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:37:41.068 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:37:41.068 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:37:41.068 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:37:41.068 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:41.068 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:41.069 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:37:41.069 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:37:41.069 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:37:41.069 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:37:41.069 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:41.069 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:37:41.069 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:37:41.069 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:37:41.069 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:41.069 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:41.069 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:37:41.069 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:37:41.069 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:37:41.069 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:37:41.070 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:37:41.070 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:41.070 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:37:41.070 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:37:41.070 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:37:41.070 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:37:41.071 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:37:41.071 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:37:41.071 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:37:41.071 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:41.071 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:37:41.071 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:37:41.071 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:41.071 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:37:41.071 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:37:41.071 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:37:41.071 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:37:41.071 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:37:41.071 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:37:41.072 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:41.072 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:37:41.072 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:37:41.072 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 8 2024-08-24T21:37:41.072 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:37:41.072 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:37:41.072 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:37:41.072 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:41.072 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:37:41.072 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:37:41.072 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:37:41.072 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:37:41.072 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:37:41.073 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:37:41.073 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:41.073 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:37:41.073 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:37:41.073 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:37:41.073 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:37:41.073 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:37:41.073 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:41.073 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:37:41.073 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:37:41.075 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:37:41.075 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-08-24T21:37:41.076 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:37:41.252 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:37:41.252 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:37:41.252 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:37:41.253 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:37:41.253 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 236, 2024-08-24T21:37:41.253 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 39396, 2024-08-24T21:37:41.253 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:37:41.253 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:37:41.253 INFO:teuthology.orchestra.run.smithi060.stdout: 1 2024-08-24T21:37:41.253 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:37:41.253 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:37:41.253 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:37:41.253 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:37:41.253 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:37:41.254 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:37:41.254 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:37:41.254 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:37:41.254 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:37:41.254 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:37:41.254 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:37:41.254 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:37:41.254 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:37:41.254 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:37:41.254 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:37:41.254 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:37:41.254 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:37:41.255 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:37:41.255 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:37:41.255 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:37:41.255 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:37:41.255 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:37:41.255 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:37:41.255 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:37:41.255 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:37:41.255 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:37:41.255 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:37:41.255 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:37:41.255 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:37:41.255 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:37:41.256 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:37:41.256 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:41.256 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:37:41.256 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:37:41.256 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:37:41.256 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:37:41.256 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:37:41.256 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:37:41.256 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:37:41.256 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:37:41.256 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:37:41.256 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:37:41.256 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:37:41.257 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:37:41.257 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:37:41.257 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:37:41.257 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:37:41.257 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:37:41.257 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:37:41.257 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:37:41.257 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:37:41.257 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:37:41.257 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:37:41.257 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:37:41.258 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:37:41.258 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:37:41.258 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:37:41.258 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:37:41.258 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:37:41.258 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:37:41.258 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:37:41.258 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:37:41.258 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:41.258 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:37:41.258 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:41.258 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:37:41.259 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:37:41.259 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:37:41.259 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:37:41.259 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:41.259 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:37:41.259 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:37:41.259 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:37:41.259 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:41.259 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:41.259 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:37:41.259 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:37:41.259 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:37:41.259 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:37:41.260 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:37:41.260 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:41.260 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:37:41.260 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:37:41.260 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:37:41.260 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:37:41.260 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:37:41.260 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:41.260 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:41.260 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:37:41.260 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:37:41.260 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:37:41.260 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:37:41.260 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:41.261 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:37:41.261 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:37:41.261 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:37:41.261 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:41.261 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:41.261 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:37:41.261 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:37:41.261 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:37:41.261 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:37:41.261 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:37:41.261 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:41.261 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:37:41.261 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:37:41.261 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:37:41.262 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:37:41.262 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:37:41.262 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:41.262 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:41.262 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:37:41.262 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:37:41.262 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:37:41.262 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:37:41.262 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:41.262 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:37:41.262 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:37:41.262 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:37:41.263 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:41.263 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:41.263 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:37:41.263 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:37:41.263 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:37:41.263 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:37:41.263 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:37:41.263 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:41.263 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:37:41.263 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:37:41.263 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:37:41.263 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:37:41.263 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:37:41.264 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:37:41.264 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:37:41.264 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:41.264 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:37:41.264 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:37:41.264 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:41.264 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:37:41.264 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:37:41.264 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:37:41.264 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:37:41.264 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:37:41.264 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:37:41.264 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:41.265 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:37:41.265 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:37:41.265 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:37:41.265 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:37:41.265 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:37:41.265 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:37:41.265 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:37:41.265 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:37:41.265 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:37:41.265 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:37:41.265 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:37:41.266 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:37:41.266 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:37:41.266 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:37:41.266 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:37:41.267 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:37:41.267 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-08-24T21:37:41.436 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 33% complete... Importing image diff: 66% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2024-08-24T21:37:41.453 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap64 - 2024-08-24T21:37:41.453 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:37:41.454 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:37:46.669 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:37:46.749 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=e242e25f2f4375c8bd28850bab2fff17 2024-08-24T21:37:46.750 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap64 - 2024-08-24T21:37:46.750 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:37:46.751 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:37:52.190 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:37:52.201 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=e242e25f2f4375c8bd28850bab2fff17 2024-08-24T21:37:52.201 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ e242e25f2f4375c8bd28850bab2fff17 != \e\2\4\2\e\2\5\f\2\f\4\3\7\5\c\8\b\d\2\8\8\5\0\b\a\b\2\f\f\f\1\7 ]] 2024-08-24T21:37:52.201 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap64 2024-08-24T21:37:52.201 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap64 2024-08-24T21:37:52.201 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap64 2024-08-24T21:37:52.308 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:37:52.319 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:37:52.320 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap64 2024-08-24T21:37:52.321 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:37:52.400 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:37:52.400 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:37:52.400 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:37:52.400 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:37:52.400 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:37:52.400 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap65.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:37:53.464 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 52% complete... Importing image diff: 77% complete... Importing image diff: 97% complete... Importing image diff: 100% complete...done. 2024-08-24T21:37:53.486 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap65 - 2024-08-24T21:37:53.486 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:37:53.486 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:37:58.623 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:37:58.708 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=e242e25f2f4375c8bd28850bab2fff17 2024-08-24T21:37:58.709 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap65 - 2024-08-24T21:37:58.709 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:37:58.710 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:38:01.268 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-08-24T21:38:01.268 INFO:tasks.ceph.mon.c:Restarting daemon 2024-08-24T21:38:01.268 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-08-24T21:38:01.273 INFO:tasks.ceph.mon.c:Started 2024-08-24T21:38:01.273 INFO:tasks.mon_thrash:Sending STOP to mon a 2024-08-24T21:38:01.273 INFO:tasks.ceph.mon.a:Sent signal 19 2024-08-24T21:38:01.273 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-08-24T21:38:04.090 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:38:04.100 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=e242e25f2f4375c8bd28850bab2fff17 2024-08-24T21:38:04.100 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ e242e25f2f4375c8bd28850bab2fff17 != \e\2\4\2\e\2\5\f\2\f\4\3\7\5\c\8\b\d\2\8\8\5\0\b\a\b\2\f\f\f\1\7 ]] 2024-08-24T21:38:04.101 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap65 2024-08-24T21:38:04.101 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap65 2024-08-24T21:38:04.101 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap65 2024-08-24T21:38:04.207 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:38:04.218 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:38:04.219 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap65 2024-08-24T21:38:04.220 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:38:04.297 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:38:04.297 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:38:04.297 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:38:04.298 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:38:04.298 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:38:04.298 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap66.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:38:16.274 INFO:tasks.mon_thrash:Sending CONT to mon a 2024-08-24T21:38:16.275 INFO:tasks.ceph.mon.a:Sent signal 18 2024-08-24T21:38:16.275 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:38:16.275 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:38:22.322 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 1% complete... Importing image diff: 3% complete... Importing image diff: 4% complete... Importing image diff: 6% complete... Importing image diff: 7% complete... Importing image diff: 9% complete... Importing image diff: 10% complete... Importing image diff: 12% complete... Importing image diff: 14% complete... Importing image diff: 15% complete... Importing image diff: 17% complete... Importing image diff: 18% complete... Importing image diff: 20% complete... Importing image diff: 21% complete... Importing image diff: 23% complete... Importing image diff: 25% complete... Importing image diff: 26% complete... Importing image diff: 28% complete... Importing image diff: 29% complete... Importing image diff: 31% complete... Importing image diff: 32% complete... Importing image diff: 34% complete... Importing image diff: 35% complete... Importing image diff: 37% complete... Importing image diff: 39% complete... Importing image diff: 40% complete... Importing image diff: 42% complete... Importing image diff: 43% complete... Importing image diff: 45% complete... Importing image diff: 46% complete... Importing image diff: 48% complete... Importing image diff: 50% complete... Importing image diff: 51% complete... Importing image diff: 53% complete... Importing image diff: 54% complete... Importing image diff: 56% complete... Importing image diff: 57% complete... Importing image diff: 59% complete... Importing image diff: 60% complete... Importing image diff: 62% complete... Importing image diff: 64% complete... Importing image diff: 65% complete... Importing image diff: 67% complete... Importing image diff: 68% complete... Importing image diff: 70% complete... Importing image diff: 71% complete... Importing image diff: 73% complete... Importing image diff: 75% complete... Importing image diff: 76% complete... Importing image diff: 78% complete... Importing image diff: 79% complete... Importing image diff: 81% complete... Importing image diff: 82% complete... Importing image diff: 84% complete... Importing image diff: 85% complete... Importing image diff: 87% complete... Importing image diff: 89% complete... Importing image diff: 90% complete... Importing image diff: 92% complete... Importing image diff: 93% complete... Importing image diff: 95% complete... Importing image diff: 96% complete... Importing image diff: 98% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2024-08-24T21:38:22.345 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap66 - 2024-08-24T21:38:22.345 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:38:22.346 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:38:22.762 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":242,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:38:22.780 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:38:22.780 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:38:22.780 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:38:22.956 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:38:22.956 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:38:22.956 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:38:22.956 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:38:22.956 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 242, 2024-08-24T21:38:22.956 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 251270, 2024-08-24T21:38:22.956 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:38:22.956 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:38:22.957 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:38:22.957 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:38:22.957 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:38:22.957 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:38:22.957 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:38:22.957 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:38:22.957 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:38:22.957 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:38:22.957 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:38:22.957 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:38:22.957 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:38:22.958 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:38:22.958 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:38:22.958 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:38:22.958 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:38:22.958 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:38:22.958 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:38:22.958 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:38:22.958 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:38:22.958 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:38:22.958 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:38:22.959 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:38:22.959 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:38:22.959 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:38:22.959 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:38:22.959 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:38:22.959 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:38:22.959 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:38:22.959 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:38:22.959 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:38:22.959 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:38:22.959 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:38:22.959 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:38:22.960 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:22.960 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:38:22.960 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:38:22.960 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:38:22.960 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:38:22.960 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:38:22.960 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:38:22.960 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:38:22.960 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:38:22.960 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:38:22.961 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:38:22.961 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:38:22.961 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:38:22.961 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:38:22.961 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:38:22.961 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:38:22.961 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:38:22.961 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:38:22.961 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:38:22.961 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:38:22.962 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:38:22.962 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:38:22.962 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:38:22.962 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:38:22.962 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:38:22.962 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:38:22.962 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:38:22.962 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:38:22.962 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:38:22.962 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:38:22.963 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:38:22.963 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:22.963 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:38:22.963 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:22.963 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:38:22.963 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:38:22.963 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:38:22.963 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:38:22.963 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:22.963 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:38:22.964 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:38:22.964 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:38:22.964 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:22.964 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:22.964 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:38:22.964 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:38:22.964 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:38:22.964 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:38:22.964 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:38:22.964 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:22.964 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:38:22.965 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:38:22.965 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:38:22.965 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:38:22.965 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:38:22.965 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:22.965 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:22.965 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:38:22.965 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:38:22.965 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:38:22.965 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:38:22.965 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:22.965 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:38:22.965 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:38:22.966 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:38:22.966 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:22.966 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:22.966 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:38:22.966 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:38:22.966 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:38:22.966 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:38:22.966 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:38:22.966 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:22.966 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:38:22.966 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:38:22.966 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:38:22.967 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:38:22.967 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:38:22.967 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:22.967 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:22.967 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:38:22.967 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:38:22.967 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:38:22.967 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:38:22.967 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:22.967 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:38:22.967 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:38:22.967 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:38:22.967 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:22.968 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:22.968 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:38:22.968 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:38:22.968 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:38:22.968 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:38:22.968 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:38:22.968 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:22.968 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:38:22.968 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:38:22.968 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:38:22.968 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:38:22.968 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:38:22.968 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:38:22.968 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:38:22.969 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:22.969 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:38:22.969 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:38:22.969 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:22.969 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:38:22.969 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:38:22.969 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:38:22.969 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:38:22.969 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:38:22.969 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:38:22.969 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:22.969 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:38:22.969 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:38:22.969 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 8 2024-08-24T21:38:22.970 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:38:22.970 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:38:22.970 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:38:22.970 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:22.970 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:38:22.970 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:38:22.970 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:38:22.970 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:38:22.970 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:38:22.970 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:38:22.970 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:22.970 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:38:22.970 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:38:22.971 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:38:22.971 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:38:22.971 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:38:22.971 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:22.971 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:38:22.971 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:38:22.972 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:38:22.972 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:38:22.973 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:38:27.151 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:38:27.151 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:38:27.151 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:38:27.151 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:38:27.151 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 242, 2024-08-24T21:38:27.151 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 25728, 2024-08-24T21:38:27.151 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:38:27.151 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:38:27.151 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:38:27.152 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:38:27.152 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:38:27.152 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 4, 2024-08-24T21:38:27.152 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:38:27.152 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:38:27.152 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:38:27.152 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:38:27.152 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:38:27.152 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:38:27.152 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:38:27.152 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:38:27.152 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:38:27.152 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:38:27.153 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:38:27.153 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:38:27.153 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:38:27.153 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:38:27.153 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:38:27.153 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:38:27.153 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:38:27.153 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:38:27.153 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:38:27.153 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:38:27.153 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:38:27.154 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:38:27.154 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:38:27.154 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:38:27.154 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:38:27.154 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:38:27.154 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:38:27.154 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:38:27.154 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:38:27.154 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:27.154 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:38:27.154 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:38:27.154 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:38:27.155 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:38:27.155 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:38:27.155 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:38:27.155 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:38:27.155 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:38:27.155 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:38:27.155 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:38:27.155 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:38:27.155 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:38:27.155 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:38:27.155 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:38:27.155 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:38:27.155 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:38:27.156 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:38:27.156 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:38:27.156 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:38:27.156 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:38:27.156 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:38:27.156 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:38:27.156 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:38:27.156 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:38:27.156 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:38:27.156 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:38:27.156 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:38:27.156 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:38:27.157 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:38:27.157 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:38:27.157 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:27.157 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:38:27.157 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:27.157 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:38:27.157 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:38:27.157 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:38:27.157 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:38:27.157 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:27.157 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:38:27.157 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:38:27.157 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:38:27.158 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:27.158 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:27.158 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:38:27.158 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:38:27.158 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:38:27.158 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:38:27.158 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:38:27.158 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:27.158 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:38:27.158 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:38:27.158 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:38:27.158 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:38:27.158 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:38:27.159 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:27.159 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:27.159 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:38:27.159 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:38:27.159 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:38:27.159 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:38:27.159 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:27.159 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:38:27.159 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:38:27.159 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:38:27.159 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:27.159 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:27.160 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:38:27.160 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:38:27.160 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:38:27.160 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:38:27.160 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:38:27.160 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:27.160 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:38:27.160 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:38:27.160 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:38:27.160 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:38:27.160 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:38:27.160 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:27.160 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:27.161 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:38:27.161 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:38:27.161 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:38:27.161 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:38:27.161 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:27.161 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:38:27.161 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:38:27.161 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:38:27.161 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:27.161 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:27.161 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:38:27.161 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:38:27.161 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:38:27.162 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:38:27.162 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:38:27.162 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:27.162 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:38:27.162 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:38:27.162 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:38:27.162 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:38:27.162 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:38:27.162 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:38:27.162 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:38:27.162 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:27.162 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:38:27.163 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:38:27.163 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:27.163 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:38:27.163 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:38:27.163 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:38:27.163 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:38:27.163 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:38:27.163 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:38:27.163 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:27.163 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:38:27.163 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:38:27.163 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:38:27.163 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:38:27.164 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:38:27.164 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:27.164 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:38:27.164 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:38:27.166 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:38:27.167 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:38:27.167 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:38:27.368 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:38:27.369 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:38:27.369 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:38:27.369 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:38:27.369 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 242, 2024-08-24T21:38:27.369 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 85512, 2024-08-24T21:38:27.369 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:38:27.369 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:38:27.369 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:38:27.369 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:38:27.369 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:38:27.369 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 5, 2024-08-24T21:38:27.370 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:38:27.370 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:38:27.370 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:38:27.370 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:38:27.370 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:38:27.370 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:38:27.370 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:38:27.370 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:38:27.370 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:38:27.370 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:38:27.370 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:38:27.370 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:38:27.371 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:38:27.371 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:38:27.371 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:38:27.371 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:38:27.371 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:38:27.371 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:38:27.371 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:38:27.371 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:38:27.371 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:38:27.371 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:38:27.371 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:38:27.371 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:38:27.371 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:38:27.371 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:38:27.372 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:38:27.372 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:38:27.372 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:38:27.372 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:27.372 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:38:27.372 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:38:27.372 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:38:27.372 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:38:27.372 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:38:27.372 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:38:27.372 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:38:27.372 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:38:27.373 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:38:27.373 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:38:27.373 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:38:27.373 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:38:27.373 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:38:27.373 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:38:27.373 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:38:27.373 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:38:27.373 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:38:27.373 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:38:27.373 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:38:27.373 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:38:27.373 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:38:27.374 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:38:27.374 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:38:27.374 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:38:27.374 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:38:27.374 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:38:27.374 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:38:27.374 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:38:27.374 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:38:27.374 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:38:27.374 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:27.374 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:38:27.374 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:27.374 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:38:27.374 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:38:27.375 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:38:27.375 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:38:27.375 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:27.375 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:38:27.375 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:38:27.375 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:38:27.375 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:27.375 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:27.375 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:38:27.375 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:38:27.375 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:38:27.375 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:38:27.375 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:38:27.375 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:27.376 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:38:27.376 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:38:27.376 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:38:27.376 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:38:27.376 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:38:27.376 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:27.376 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:27.376 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:38:27.376 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:38:27.376 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:38:27.376 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:38:27.376 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:27.376 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:38:27.376 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:38:27.377 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:38:27.377 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:27.377 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:27.377 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:38:27.377 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:38:27.377 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:38:27.377 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:38:27.377 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:38:27.377 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:27.377 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:38:27.377 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:38:27.377 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:38:27.378 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:38:27.378 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:38:27.378 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:27.378 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:27.378 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:38:27.378 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:38:27.378 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:38:27.378 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:38:27.378 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:27.378 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:38:27.378 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:38:27.378 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:38:27.378 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:27.379 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:27.379 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:38:27.379 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:38:27.379 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:38:27.379 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:38:27.379 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:38:27.379 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:27.379 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:38:27.379 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:38:27.379 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:38:27.379 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:38:27.379 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:38:27.379 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:38:27.380 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:38:27.380 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:27.380 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:38:27.380 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:38:27.380 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:27.380 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:38:27.380 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:38:27.380 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:38:27.380 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:38:27.380 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:38:27.380 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:38:27.380 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:27.380 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:38:27.381 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:38:27.381 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:38:27.381 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:38:27.381 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:38:27.381 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:38:27.381 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:27.381 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:38:27.381 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:38:27.381 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:38:27.381 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:38:27.381 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:38:27.381 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:27.381 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:38:27.382 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:38:27.383 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:38:27.383 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-08-24T21:38:27.383 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-08-24T21:38:27.554 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:38:27.628 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=5cd2713b94a36921fda6bea3bc26a2ba 2024-08-24T21:38:27.629 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap66 - 2024-08-24T21:38:27.629 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:38:27.630 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:38:27.851 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-08-24T21:38:28.852 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:38:28.852 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:38:29.320 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":242,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:38:29.339 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:38:29.340 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-08-24T21:38:29.340 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:38:29.340 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:38:29.527 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:38:29.527 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:38:29.527 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:38:29.527 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:38:29.527 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 242, 2024-08-24T21:38:29.528 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 257842, 2024-08-24T21:38:29.528 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:38:29.528 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:38:29.528 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:38:29.528 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:38:29.528 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:38:29.528 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 7, 2024-08-24T21:38:29.528 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:38:29.528 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:38:29.528 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:38:29.528 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:38:29.528 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:38:29.529 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:38:29.529 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:38:29.529 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:38:29.529 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:38:29.529 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:38:29.529 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:38:29.529 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:38:29.529 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:38:29.529 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:38:29.529 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:38:29.529 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:38:29.529 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:38:29.530 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:38:29.530 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:38:29.530 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:38:29.530 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:38:29.530 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:38:29.530 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:38:29.530 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:38:29.530 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:38:29.530 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:38:29.530 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:38:29.530 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:38:29.530 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:38:29.531 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:29.531 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:38:29.531 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:38:29.531 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:38:29.531 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:38:29.531 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:38:29.531 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:38:29.531 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:38:29.531 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:38:29.531 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:38:29.531 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:38:29.531 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:38:29.531 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:38:29.532 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:38:29.532 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:38:29.532 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:38:29.532 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:38:29.532 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:38:29.532 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:38:29.532 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:38:29.532 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:38:29.532 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:38:29.532 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:38:29.532 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:38:29.532 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:38:29.532 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:38:29.533 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:38:29.533 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:38:29.533 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:38:29.533 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:38:29.533 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:38:29.533 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:29.533 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:38:29.533 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:29.533 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:38:29.533 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:38:29.533 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:38:29.533 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:38:29.533 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:29.534 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:38:29.534 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:38:29.534 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:38:29.534 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:29.534 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:29.534 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:38:29.534 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:38:29.534 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:38:29.534 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:38:29.534 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:38:29.534 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:29.534 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:38:29.535 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:38:29.535 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:38:29.535 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:38:29.535 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:38:29.535 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:29.535 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:29.535 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:38:29.535 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:38:29.535 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:38:29.535 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:38:29.535 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:29.535 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:38:29.535 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:38:29.535 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:38:29.536 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:29.536 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:29.536 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:38:29.536 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:38:29.536 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:38:29.536 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:38:29.536 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:38:29.536 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:29.536 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:38:29.536 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:38:29.536 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:38:29.536 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:38:29.536 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:38:29.537 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:29.537 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:29.537 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:38:29.537 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:38:29.537 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:38:29.537 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:38:29.537 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:29.537 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:38:29.537 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:38:29.537 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:38:29.537 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:29.537 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:29.537 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:38:29.538 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:38:29.538 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:38:29.538 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:38:29.538 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:38:29.538 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:29.538 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:38:29.538 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:38:29.538 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:38:29.538 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:38:29.538 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:38:29.538 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:38:29.538 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:38:29.538 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:29.539 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:38:29.539 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:38:29.539 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:29.539 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:38:29.539 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:38:29.539 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:38:29.539 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:38:29.539 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:38:29.539 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:38:29.539 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:29.539 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:38:29.539 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:38:29.539 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 8 2024-08-24T21:38:29.540 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:38:29.540 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:38:29.540 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:38:29.540 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:29.540 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:38:29.540 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:38:29.540 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:38:29.540 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:38:29.540 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:38:29.540 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:38:29.540 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:29.540 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:38:29.540 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:38:29.541 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:38:29.541 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:38:29.541 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:38:29.541 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:29.541 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:38:29.541 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:38:29.543 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:38:29.543 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:38:29.543 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:38:29.732 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:38:29.732 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:38:29.732 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:38:29.732 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:38:29.732 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 242, 2024-08-24T21:38:29.733 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 28310, 2024-08-24T21:38:29.733 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:38:29.733 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:38:29.733 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:38:29.733 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:38:29.733 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:38:29.733 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 7, 2024-08-24T21:38:29.733 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:38:29.733 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:38:29.733 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:38:29.733 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:38:29.733 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:38:29.734 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:38:29.734 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:38:29.734 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:38:29.734 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:38:29.734 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:38:29.734 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:38:29.734 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:38:29.734 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:38:29.734 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:38:29.734 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:38:29.734 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:38:29.734 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:38:29.735 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:38:29.735 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:38:29.735 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:38:29.735 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:38:29.735 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:38:29.735 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:38:29.735 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:38:29.735 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:38:29.735 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:38:29.735 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:38:29.735 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:38:29.735 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:38:29.735 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:29.736 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:38:29.736 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:38:29.736 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:38:29.736 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:38:29.736 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:38:29.736 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:38:29.736 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:38:29.736 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:38:29.736 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:38:29.736 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:38:29.736 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:38:29.736 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:38:29.737 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:38:29.737 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:38:29.737 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:38:29.737 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:38:29.737 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:38:29.737 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:38:29.737 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:38:29.737 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:38:29.737 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:38:29.737 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:38:29.737 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:38:29.737 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:38:29.738 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:38:29.738 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:38:29.738 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:38:29.738 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:38:29.738 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:38:29.738 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:38:29.738 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:29.738 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:38:29.738 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:29.738 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:38:29.738 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:38:29.738 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:38:29.738 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:38:29.739 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:29.739 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:38:29.739 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:38:29.739 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:38:29.739 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:29.739 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:29.739 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:38:29.739 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:38:29.739 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:38:29.739 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:38:29.739 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:38:29.739 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:29.740 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:38:29.740 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:38:29.740 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:38:29.740 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:38:29.740 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:38:29.740 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:29.740 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:29.740 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:38:29.740 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:38:29.740 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:38:29.740 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:38:29.740 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:29.740 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:38:29.741 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:38:29.741 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:38:29.741 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:29.741 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:29.741 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:38:29.741 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:38:29.741 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:38:29.741 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:38:29.741 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:38:29.741 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:29.741 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:38:29.741 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:38:29.741 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:38:29.742 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:38:29.742 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:38:29.742 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:29.742 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:29.742 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:38:29.742 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:38:29.742 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:38:29.742 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:38:29.742 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:29.742 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:38:29.742 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:38:29.742 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:38:29.743 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:29.743 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:29.743 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:38:29.743 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:38:29.743 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:38:29.743 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:38:29.743 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:38:29.743 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:29.743 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:38:29.743 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:38:29.743 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:38:29.743 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:38:29.743 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:38:29.744 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:38:29.744 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:38:29.744 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:29.744 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:38:29.744 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:38:29.744 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:29.744 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:38:29.744 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:38:29.744 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:38:29.744 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:38:29.744 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:38:29.744 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:38:29.744 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:29.744 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:38:29.745 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:38:29.745 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:38:29.745 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:38:29.745 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:38:29.745 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:29.745 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:38:29.745 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:38:29.747 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:38:29.747 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:38:29.748 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:38:29.935 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:38:29.935 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:38:29.935 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:38:29.935 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:38:29.935 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 242, 2024-08-24T21:38:29.936 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 88078, 2024-08-24T21:38:29.936 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:38:29.936 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:38:29.936 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:38:29.936 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:38:29.936 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:38:29.936 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 7, 2024-08-24T21:38:29.936 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:38:29.936 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:38:29.936 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:38:29.936 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:38:29.936 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:38:29.936 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:38:29.937 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:38:29.937 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:38:29.937 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:38:29.937 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:38:29.937 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:38:29.937 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:38:29.937 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:38:29.937 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:38:29.937 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:38:29.937 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:38:29.937 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:38:29.937 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:38:29.938 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:38:29.938 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:38:29.938 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:38:29.938 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:38:29.938 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:38:29.938 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:38:29.938 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:38:29.938 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:38:29.938 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:38:29.938 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:38:29.938 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:38:29.938 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:29.939 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:38:29.939 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:38:29.939 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:38:29.939 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:38:29.939 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:38:29.939 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:38:29.939 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:38:29.939 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:38:29.939 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:38:29.939 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:38:29.939 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:38:29.939 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:38:29.939 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:38:29.940 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:38:29.940 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:38:29.940 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:38:29.940 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:38:29.940 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:38:29.940 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:38:29.940 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:38:29.940 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:38:29.940 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:38:29.940 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:38:29.940 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:38:29.940 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:38:29.940 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:38:29.940 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:38:29.941 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:38:29.941 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:38:29.941 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:38:29.941 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:29.941 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:38:29.941 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:29.941 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:38:29.941 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:38:29.941 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:38:29.941 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:38:29.941 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:29.941 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:38:29.941 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:38:29.942 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:38:29.942 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:29.942 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:29.942 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:38:29.942 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:38:29.942 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:38:29.942 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:38:29.942 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:38:29.942 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:29.942 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:38:29.942 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:38:29.942 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:38:29.942 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:38:29.943 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:38:29.943 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:29.943 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:29.943 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:38:29.943 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:38:29.943 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:38:29.943 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:38:29.943 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:29.943 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:38:29.943 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:38:29.943 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:38:29.943 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:29.943 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:29.943 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:38:29.944 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:38:29.944 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:38:29.944 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:38:29.944 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:38:29.944 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:29.944 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:38:29.944 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:38:29.944 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:38:29.944 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:38:29.944 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:38:29.944 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:29.944 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:29.944 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:38:29.944 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:38:29.945 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:38:29.945 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:38:29.945 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:29.945 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:38:29.945 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:38:29.945 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:38:29.945 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:29.945 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:29.945 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:38:29.945 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:38:29.945 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:38:29.945 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:38:29.945 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:38:29.946 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:29.946 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:38:29.946 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:38:29.946 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:38:29.946 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:38:29.946 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:38:29.946 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:38:29.946 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:38:29.946 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:29.946 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:38:29.946 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:38:29.946 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:29.946 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:38:29.947 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:38:29.947 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:38:29.947 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:38:29.947 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:38:29.947 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:38:29.947 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:29.947 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:38:29.947 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:38:29.947 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-08-24T21:38:29.947 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:38:29.947 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:38:29.947 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:38:29.947 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:29.947 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:38:29.948 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:38:29.948 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:38:29.948 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:38:29.948 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:38:29.948 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:29.948 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:38:29.948 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:38:29.951 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:38:29.951 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2024-08-24T21:38:29.951 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['a'] 2024-08-24T21:38:29.951 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-08-24T21:38:29.951 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-08-24T21:38:29.952 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-08-24T21:38:29.952 INFO:teuthology.orchestra.run:waiting for 300 2024-08-24T21:38:29.968 INFO:tasks.ceph.mon.c:Stopped 2024-08-24T21:38:29.968 INFO:tasks.mon_thrash:Sending STOP to mon a 2024-08-24T21:38:29.969 INFO:tasks.ceph.mon.a:Sent signal 19 2024-08-24T21:38:29.969 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-08-24T21:38:32.966 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:38:32.976 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=5cd2713b94a36921fda6bea3bc26a2ba 2024-08-24T21:38:32.976 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ 5cd2713b94a36921fda6bea3bc26a2ba != \5\c\d\2\7\1\3\b\9\4\a\3\6\9\2\1\f\d\a\6\b\e\a\3\b\c\2\6\a\2\b\a ]] 2024-08-24T21:38:32.976 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap66 2024-08-24T21:38:32.977 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap66 2024-08-24T21:38:32.977 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap66 2024-08-24T21:38:33.084 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:38:33.096 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:38:33.097 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap66 2024-08-24T21:38:33.098 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:38:33.177 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:38:33.177 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:38:33.177 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:38:33.177 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:38:33.177 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:38:33.177 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap67.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:38:44.970 INFO:tasks.mon_thrash:Sending CONT to mon a 2024-08-24T21:38:44.971 INFO:tasks.ceph.mon.a:Sent signal 18 2024-08-24T21:38:44.972 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-08-24T21:38:44.972 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:38:50.283 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":246,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:38:50.302 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-08-24T21:38:50.302 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-08-24T21:38:50.302 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:38:50.477 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:38:50.477 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:38:50.478 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:38:50.478 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:38:50.478 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 246, 2024-08-24T21:38:50.478 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 278792, 2024-08-24T21:38:50.478 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:38:50.478 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:38:50.478 INFO:teuthology.orchestra.run.smithi060.stdout: 1 2024-08-24T21:38:50.478 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:38:50.478 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:38:50.478 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:38:50.479 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:38:50.479 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:38:50.479 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:38:50.479 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:38:50.479 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:38:50.479 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:38:50.479 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:38:50.479 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:38:50.479 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:38:50.479 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:38:50.479 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:38:50.479 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:38:50.480 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:38:50.480 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:38:50.480 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:38:50.480 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:38:50.480 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:38:50.480 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:38:50.480 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:38:50.480 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:38:50.480 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:38:50.480 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:38:50.480 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:38:50.480 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:38:50.481 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:38:50.481 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:38:50.481 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:38:50.481 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:38:50.481 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:50.481 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:38:50.481 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:38:50.481 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:38:50.481 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:38:50.481 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:38:50.481 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:38:50.481 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:38:50.481 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:38:50.482 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:38:50.482 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:38:50.482 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:38:50.482 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:38:50.482 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:38:50.482 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:38:50.482 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:38:50.482 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:38:50.482 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:38:50.482 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:38:50.483 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:38:50.483 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:38:50.483 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:38:50.483 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:38:50.483 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:38:50.483 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:38:50.483 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:38:50.483 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:38:50.483 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:38:50.483 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:38:50.483 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:38:50.483 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:38:50.483 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:50.484 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:38:50.484 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:50.484 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:38:50.484 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:38:50.484 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:38:50.484 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:38:50.484 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:50.484 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:38:50.484 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:38:50.484 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:38:50.484 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:50.484 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:50.485 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:38:50.485 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:38:50.485 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:38:50.485 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:38:50.485 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:38:50.485 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:50.485 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:38:50.485 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:38:50.486 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:38:50.486 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:38:50.486 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:38:50.486 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:50.486 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:50.486 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:38:50.486 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:38:50.486 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:38:50.486 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:38:50.486 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:50.486 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:38:50.486 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:38:50.487 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:38:50.487 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:50.487 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:50.487 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:38:50.487 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:38:50.487 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:38:50.487 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:38:50.487 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:38:50.487 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:50.487 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:38:50.487 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:38:50.487 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:38:50.487 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:38:50.488 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:38:50.488 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:50.488 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:50.488 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:38:50.488 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:38:50.488 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:38:50.488 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:38:50.488 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:50.488 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:38:50.488 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:38:50.488 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:38:50.488 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:50.488 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:50.489 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:38:50.489 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:38:50.489 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:38:50.489 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:38:50.489 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:38:50.489 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:50.489 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:38:50.489 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:38:50.489 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:38:50.489 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:38:50.489 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:38:50.489 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:38:50.489 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:38:50.490 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:50.490 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:38:50.490 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:38:50.490 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:50.490 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:38:50.490 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:38:50.490 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:38:50.490 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:38:50.490 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:38:50.490 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:38:50.490 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:50.490 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:38:50.491 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:38:50.491 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 8 2024-08-24T21:38:50.491 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:38:50.491 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:38:50.491 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:38:50.491 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:50.491 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:38:50.491 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:38:50.491 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-08-24T21:38:50.491 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:38:50.491 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:38:50.491 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:38:50.492 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:50.492 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:38:50.492 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:38:50.492 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:38:50.492 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:38:50.492 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:38:50.492 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:50.492 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:38:50.492 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:38:50.493 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:38:50.493 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-08-24T21:38:50.494 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:38:50.672 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:38:50.672 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:38:50.672 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:38:50.672 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:38:50.672 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 246, 2024-08-24T21:38:50.672 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 108815, 2024-08-24T21:38:50.672 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:38:50.672 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:38:50.672 INFO:teuthology.orchestra.run.smithi060.stdout: 1 2024-08-24T21:38:50.673 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:38:50.673 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:38:50.673 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:38:50.673 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:38:50.673 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:38:50.673 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:38:50.673 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:38:50.673 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:38:50.673 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:38:50.673 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:38:50.673 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:38:50.673 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:38:50.673 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:38:50.673 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:38:50.674 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:38:50.674 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:38:50.674 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:38:50.674 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:38:50.674 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:38:50.674 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:38:50.674 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:38:50.674 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:38:50.674 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:38:50.674 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:38:50.674 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:38:50.674 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:38:50.674 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:38:50.674 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:38:50.675 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:38:50.675 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:38:50.675 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:38:50.675 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:50.675 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:38:50.675 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:38:50.675 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:38:50.675 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:38:50.675 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:38:50.675 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:38:50.675 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:38:50.675 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:38:50.675 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:38:50.675 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:38:50.676 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:38:50.676 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:38:50.676 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:38:50.676 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:38:50.676 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:38:50.676 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:38:50.676 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:38:50.676 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:38:50.676 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:38:50.676 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:38:50.676 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:38:50.676 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:38:50.677 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:38:50.677 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:38:50.677 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:38:50.677 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:38:50.677 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:38:50.677 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:38:50.677 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:38:50.677 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:38:50.677 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:50.677 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:38:50.677 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:50.677 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:38:50.677 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:38:50.677 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:38:50.678 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:38:50.678 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:50.678 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:38:50.678 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:38:50.678 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:38:50.678 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:50.678 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:50.678 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:38:50.678 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:38:50.678 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:38:50.678 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:38:50.678 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:38:50.678 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:50.678 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:38:50.678 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:38:50.679 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:38:50.679 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:38:50.679 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:38:50.679 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:50.679 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:50.679 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:38:50.679 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:38:50.679 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:38:50.679 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:38:50.679 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:50.679 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:38:50.679 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:38:50.679 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:38:50.679 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:50.680 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:50.680 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:38:50.680 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:38:50.680 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:38:50.680 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:38:50.680 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:38:50.680 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:50.680 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:38:50.680 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:38:50.680 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:38:50.680 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:38:50.680 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:38:50.680 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:50.680 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:50.681 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:38:50.681 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:38:50.681 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:38:50.681 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:38:50.681 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:50.681 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:38:50.681 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:38:50.681 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:38:50.681 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:50.681 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:50.681 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:38:50.681 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:38:50.681 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:38:50.681 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:38:50.682 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:38:50.682 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:50.682 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:38:50.682 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:38:50.682 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:38:50.682 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:38:50.682 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:38:50.682 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:38:50.682 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:38:50.682 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:50.682 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:38:50.682 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:38:50.682 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:50.682 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:38:50.683 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:38:50.683 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:38:50.683 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:38:50.683 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:38:50.683 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:38:50.683 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:50.683 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:38:50.683 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:38:50.683 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-08-24T21:38:50.683 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:38:50.683 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:38:50.683 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:38:50.683 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:38:50.683 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:38:50.683 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:38:50.684 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:38:50.684 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:38:50.684 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:38:50.684 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:38:50.684 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:38:50.684 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:38:50.687 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:38:50.687 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-08-24T21:38:51.009 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 52% complete... Importing image diff: 77% complete... Importing image diff: 97% complete... Importing image diff: 100% complete...done. 2024-08-24T21:38:51.032 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap67 - 2024-08-24T21:38:51.032 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:38:51.032 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:38:56.282 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:38:56.369 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=5cd2713b94a36921fda6bea3bc26a2ba 2024-08-24T21:38:56.370 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap67 - 2024-08-24T21:38:56.371 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:38:56.371 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:39:01.635 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:39:01.645 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=5cd2713b94a36921fda6bea3bc26a2ba 2024-08-24T21:39:01.645 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ 5cd2713b94a36921fda6bea3bc26a2ba != \5\c\d\2\7\1\3\b\9\4\a\3\6\9\2\1\f\d\a\6\b\e\a\3\b\c\2\6\a\2\b\a ]] 2024-08-24T21:39:01.645 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap67 2024-08-24T21:39:01.645 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap67 2024-08-24T21:39:01.645 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap67 2024-08-24T21:39:01.755 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:39:01.767 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:39:01.768 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap67 2024-08-24T21:39:01.769 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:39:01.846 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:39:01.847 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:39:01.847 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:39:01.847 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:39:01.847 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:39:01.847 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap68.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:39:02.092 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 1% complete... Importing image diff: 3% complete... Importing image diff: 4% complete... Importing image diff: 6% complete... Importing image diff: 7% complete... Importing image diff: 9% complete... Importing image diff: 10% complete... Importing image diff: 12% complete... Importing image diff: 14% complete... Importing image diff: 15% complete... Importing image diff: 17% complete... Importing image diff: 18% complete... Importing image diff: 20% complete... Importing image diff: 21% complete... Importing image diff: 23% complete... Importing image diff: 25% complete... Importing image diff: 26% complete... Importing image diff: 28% complete... Importing image diff: 29% complete... Importing image diff: 31% complete... Importing image diff: 32% complete... Importing image diff: 34% complete... Importing image diff: 35% complete... Importing image diff: 37% complete... Importing image diff: 39% complete... Importing image diff: 40% complete... Importing image diff: 42% complete... Importing image diff: 43% complete... Importing image diff: 45% complete... Importing image diff: 46% complete... Importing image diff: 48% complete... Importing image diff: 50% complete... Importing image diff: 51% complete... Importing image diff: 53% complete... Importing image diff: 54% complete... Importing image diff: 56% complete... Importing image diff: 57% complete... Importing image diff: 59% complete... Importing image diff: 60% complete... Importing image diff: 62% complete... Importing image diff: 64% complete... Importing image diff: 65% complete... Importing image diff: 67% complete... Importing image diff: 68% complete... Importing image diff: 70% complete... Importing image diff: 71% complete... Importing image diff: 73% complete... Importing image diff: 75% complete... Importing image diff: 76% complete... Importing image diff: 78% complete... Importing image diff: 79% complete... Importing image diff: 81% complete... Importing image diff: 82% complete... Importing image diff: 84% complete... Importing image diff: 85% complete... Importing image diff: 87% complete... Importing image diff: 89% complete... Importing image diff: 90% complete... Importing image diff: 92% complete... Importing image diff: 93% complete... Importing image diff: 95% complete... Importing image diff: 96% complete... Importing image diff: 98% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2024-08-24T21:39:02.111 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap68 - 2024-08-24T21:39:02.111 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:39:02.112 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:39:07.279 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:39:07.353 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=f65fd83903bb4597e945ef76b5dccc3d 2024-08-24T21:39:07.354 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap68 - 2024-08-24T21:39:07.355 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:39:07.355 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:39:10.687 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-08-24T21:39:10.688 INFO:tasks.ceph.mon.c:Restarting daemon 2024-08-24T21:39:10.688 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-08-24T21:39:10.692 INFO:tasks.ceph.mon.c:Started 2024-08-24T21:39:10.692 INFO:tasks.mon_thrash:Sending STOP to mon a 2024-08-24T21:39:10.693 INFO:tasks.ceph.mon.a:Sent signal 19 2024-08-24T21:39:10.693 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-08-24T21:39:12.752 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:39:12.763 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=f65fd83903bb4597e945ef76b5dccc3d 2024-08-24T21:39:12.763 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ f65fd83903bb4597e945ef76b5dccc3d != \f\6\5\f\d\8\3\9\0\3\b\b\4\5\9\7\e\9\4\5\e\f\7\6\b\5\d\c\c\c\3\d ]] 2024-08-24T21:39:12.763 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap68 2024-08-24T21:39:12.763 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap68 2024-08-24T21:39:12.763 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap68 2024-08-24T21:39:12.878 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:39:12.891 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:39:12.893 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap68 2024-08-24T21:39:12.893 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:39:15.984 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:39:15.985 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:39:15.985 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:39:15.985 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:39:15.985 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:39:15.985 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap69.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:39:25.693 INFO:tasks.mon_thrash:Sending CONT to mon a 2024-08-24T21:39:25.694 INFO:tasks.ceph.mon.a:Sent signal 18 2024-08-24T21:39:25.694 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:39:25.695 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:39:30.783 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 15% complete... Importing image diff: 30% complete... Importing image diff: 31% complete... Importing image diff: 32% complete... Importing image diff: 33% complete... Importing image diff: 34% complete... Importing image diff: 35% complete... Importing image diff: 36% complete... Importing image diff: 37% complete... Importing image diff: 52% complete... Importing image diff: 67% complete... Importing image diff: 68% complete... Importing image diff: 69% complete... Importing image diff: 84% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2024-08-24T21:39:30.807 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap69 - 2024-08-24T21:39:30.807 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:39:30.808 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:39:31.022 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":250,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:39:34.041 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:39:34.523 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":252,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:39:34.540 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:39:34.541 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:39:34.541 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:39:34.717 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:39:34.717 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:39:34.717 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:39:34.717 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:39:34.717 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 252, 2024-08-24T21:39:34.717 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 323031, 2024-08-24T21:39:34.717 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:39:34.717 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:39:34.717 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:39:34.718 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:39:34.718 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:39:34.718 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 3, 2024-08-24T21:39:34.718 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:39:34.718 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:39:34.718 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:39:34.718 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:39:34.718 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:39:34.718 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:39:34.719 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:39:34.719 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:39:34.719 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:39:34.719 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:39:34.719 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:39:34.719 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:39:34.719 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:39:34.719 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:39:34.719 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:39:34.719 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:39:34.719 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:39:34.719 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:39:34.719 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:39:34.720 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:39:34.720 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:39:34.720 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:39:34.720 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:39:34.720 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:39:34.720 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:39:34.720 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:39:34.720 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:39:34.720 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:39:34.720 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:39:34.720 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:34.720 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:39:34.720 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:39:34.721 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:39:34.721 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:39:34.721 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:39:34.721 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:39:34.721 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:39:34.721 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:39:34.721 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:39:34.721 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:39:34.721 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:39:34.721 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:39:34.721 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:39:34.722 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:39:34.722 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:39:34.722 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:39:34.722 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:39:34.722 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:39:34.722 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:39:34.722 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:39:34.722 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:39:34.722 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:39:34.722 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:39:34.722 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:39:34.722 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:39:34.723 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:39:34.723 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:39:34.723 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:39:34.723 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:39:34.723 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:39:34.723 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:34.723 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:39:34.723 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:34.723 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:39:34.723 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:39:34.723 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:39:34.723 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:39:34.723 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:34.724 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:39:34.724 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:39:34.724 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:39:34.724 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:34.724 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:34.724 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:39:34.724 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:39:34.724 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:39:34.724 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:39:34.724 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:39:34.724 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:34.724 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:39:34.725 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:39:34.725 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:39:34.725 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:39:34.725 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:39:34.725 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:34.725 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:34.725 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:39:34.725 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:39:34.725 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:39:34.725 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:39:34.725 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:34.725 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:39:34.725 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:39:34.725 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:39:34.726 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:34.726 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:34.726 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:39:34.726 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:39:34.726 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:39:34.726 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:39:34.726 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:39:34.726 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:34.726 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:39:34.726 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:39:34.726 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:39:34.727 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:39:34.727 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:39:34.727 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:34.727 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:34.727 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:39:34.727 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:39:34.727 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:39:34.727 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:39:34.727 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:34.727 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:39:34.727 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:39:34.727 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:39:34.727 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:34.728 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:34.728 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:39:34.728 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:39:34.728 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:39:34.728 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:39:34.728 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:39:34.728 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:34.728 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:39:34.728 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:39:34.728 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:39:34.728 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:39:34.728 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:39:34.728 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:39:34.729 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:39:34.729 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:34.729 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:39:34.729 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:39:34.729 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:34.729 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:39:34.729 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:39:34.729 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:39:34.729 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:39:34.729 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:39:34.729 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:39:34.729 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:34.729 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:39:34.730 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:39:34.730 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 8 2024-08-24T21:39:34.730 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:39:34.730 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:39:34.730 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:39:34.730 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:34.730 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:39:34.730 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:39:34.730 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-08-24T21:39:34.730 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:39:34.730 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:39:34.730 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:39:34.731 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:34.731 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:39:34.731 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:39:34.731 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:39:34.731 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:39:34.731 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:39:34.731 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:34.731 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:39:34.731 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:39:34.732 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:39:34.732 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:39:34.733 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:39:35.956 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:39:36.043 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=0a1475e18062b5a535217e99c93748ca 2024-08-24T21:39:36.045 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap69 - 2024-08-24T21:39:36.045 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:39:36.045 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:39:36.333 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:39:36.333 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:39:36.333 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:39:36.333 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:39:36.333 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 252, 2024-08-24T21:39:36.333 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 25497, 2024-08-24T21:39:36.334 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:39:36.334 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:39:36.334 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:39:36.334 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:39:36.334 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:39:36.334 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 4, 2024-08-24T21:39:36.334 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:39:36.334 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:39:36.334 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:39:36.334 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:39:36.334 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:39:36.334 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:39:36.334 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:39:36.335 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:39:36.335 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:39:36.335 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:39:36.335 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:39:36.335 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:39:36.335 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:39:36.335 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:39:36.335 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:39:36.335 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:39:36.335 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:39:36.335 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:39:36.335 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:39:36.336 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:39:36.336 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:39:36.336 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:39:36.336 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:39:36.336 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:39:36.336 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:39:36.336 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:39:36.336 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:39:36.336 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:39:36.336 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:39:36.336 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:36.336 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:39:36.337 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:39:36.337 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:39:36.337 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:39:36.337 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:39:36.337 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:39:36.337 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:39:36.337 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:39:36.337 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:39:36.337 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:39:36.337 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:39:36.337 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:39:36.337 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:39:36.337 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:39:36.338 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:39:36.338 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:39:36.338 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:39:36.338 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:39:36.338 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:39:36.338 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:39:36.338 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:39:36.338 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:39:36.338 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:39:36.338 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:39:36.338 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:39:36.338 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:39:36.338 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:39:36.339 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:39:36.339 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:39:36.339 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:39:36.339 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:36.339 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:39:36.339 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:36.340 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:39:36.340 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:39:36.340 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:39:36.340 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:39:36.340 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:36.340 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:39:36.340 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:39:36.340 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:39:36.340 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:36.340 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:36.340 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:39:36.340 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:39:36.340 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:39:36.341 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:39:36.341 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:39:36.341 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:36.341 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:39:36.341 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:39:36.341 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:39:36.341 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:39:36.341 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:39:36.341 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:36.341 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:36.341 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:39:36.341 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:39:36.341 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:39:36.341 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:39:36.342 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:36.342 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:39:36.342 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:39:36.342 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:39:36.342 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:36.342 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:36.342 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:39:36.342 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:39:36.342 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:39:36.342 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:39:36.343 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:39:36.343 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:36.343 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:39:36.343 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:39:36.343 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:39:36.343 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:39:36.343 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:39:36.343 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:36.343 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:36.343 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:39:36.344 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:39:36.344 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:39:36.344 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:39:36.344 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:36.344 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:39:36.344 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:39:36.344 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:39:36.344 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:36.344 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:36.344 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:39:36.344 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:39:36.344 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:39:36.344 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:39:36.345 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:39:36.345 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:36.345 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:39:36.345 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:39:36.345 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:39:36.345 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:39:36.345 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:39:36.345 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:39:36.345 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:39:36.345 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:36.345 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:39:36.345 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:39:36.345 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:36.346 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:39:36.346 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:39:36.346 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:39:36.346 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:39:36.346 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:39:36.346 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:39:36.346 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:36.346 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:39:36.346 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:39:36.346 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:39:36.346 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:39:36.346 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:39:36.346 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:36.346 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:39:36.347 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:39:36.351 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:39:36.351 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:39:36.352 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:39:36.544 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:39:36.551 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:39:36.551 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:39:36.551 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:39:36.551 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 252, 2024-08-24T21:39:36.552 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 154687, 2024-08-24T21:39:36.552 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:39:36.552 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:39:36.552 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:39:36.552 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:39:36.552 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:39:36.552 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 4, 2024-08-24T21:39:36.552 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:39:36.552 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:39:36.552 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:39:36.552 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:39:36.552 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:39:36.552 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:39:36.553 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:39:36.553 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:39:36.553 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:39:36.553 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:39:36.553 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:39:36.553 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:39:36.553 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:39:36.553 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:39:36.553 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:39:36.553 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:39:36.553 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:39:36.553 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:39:36.553 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:39:36.554 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:39:36.554 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:39:36.554 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:39:36.554 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:39:36.554 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:39:36.554 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:39:36.554 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:39:36.554 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:39:36.554 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:39:36.555 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:39:36.555 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:36.555 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:39:36.555 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:39:36.555 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:39:36.555 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:39:36.555 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:39:36.555 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:39:36.555 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:39:36.555 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:39:36.555 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:39:36.555 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:39:36.556 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:39:36.556 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:39:36.556 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:39:36.556 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:39:36.556 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:39:36.556 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:39:36.556 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:39:36.556 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:39:36.556 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:39:36.556 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:39:36.556 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:39:36.557 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:39:36.557 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:39:36.557 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:39:36.557 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:39:36.557 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:39:36.557 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:39:36.557 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:39:36.557 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:39:36.557 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:39:36.557 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:36.557 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:39:36.557 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:36.557 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:39:36.558 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:39:36.558 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:39:36.558 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:39:36.558 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:36.558 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:39:36.558 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:39:36.558 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:39:36.558 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:36.558 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:36.558 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:39:36.558 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:39:36.558 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:39:36.559 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:39:36.559 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:39:36.559 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:36.559 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:39:36.559 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:39:36.559 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:39:36.559 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:39:36.559 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:39:36.559 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:36.559 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:36.560 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:39:36.560 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:39:36.560 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:39:36.560 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:39:36.560 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:36.560 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:39:36.560 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:39:36.560 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:39:36.560 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:36.560 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:36.560 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:39:36.560 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:39:36.561 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:39:36.561 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:39:36.561 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:39:36.561 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:36.561 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:39:36.561 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:39:36.561 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:39:36.561 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:39:36.561 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:39:36.561 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:36.562 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:36.562 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:39:36.562 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:39:36.562 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:39:36.562 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:39:36.562 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:36.562 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:39:36.562 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:39:36.562 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:39:36.562 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:36.562 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:36.562 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:39:36.562 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:39:36.563 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:39:36.563 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:39:36.563 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:39:36.563 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:36.563 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:39:36.563 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:39:36.563 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:39:36.563 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:39:36.563 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:39:36.563 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:39:36.563 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:39:36.563 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:36.563 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:39:36.563 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:39:36.564 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:36.564 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:39:36.564 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:39:36.564 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:39:36.564 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:39:36.564 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:39:36.564 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:39:36.564 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:36.564 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:39:36.564 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:39:36.564 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-08-24T21:39:36.565 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:39:36.565 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:39:36.565 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:39:36.565 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:36.565 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:39:36.565 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:39:36.565 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:39:36.565 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:39:36.565 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:39:36.565 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:36.565 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:39:36.565 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:39:36.567 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:39:36.567 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-08-24T21:39:36.567 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-08-24T21:39:37.059 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-08-24T21:39:38.060 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:39:38.061 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:39:38.517 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":252,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":6,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:39:38.537 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:39:38.537 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-08-24T21:39:38.537 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:39:38.537 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:39:38.725 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:39:38.726 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:39:38.726 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:39:38.726 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:39:38.726 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 252, 2024-08-24T21:39:38.726 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 327040, 2024-08-24T21:39:38.726 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:39:38.726 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:39:38.726 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:39:38.726 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:39:38.727 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:39:38.727 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 7, 2024-08-24T21:39:38.727 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:39:38.727 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:39:38.727 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:39:38.727 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:39:38.727 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:39:38.727 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:39:38.727 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:39:38.727 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:39:38.727 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:39:38.727 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:39:38.728 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:39:38.728 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:39:38.728 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:39:38.728 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:39:38.728 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:39:38.728 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:39:38.728 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:39:38.728 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:39:38.728 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:39:38.728 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:39:38.728 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:39:38.728 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:39:38.728 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:39:38.729 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:39:38.729 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:39:38.729 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:39:38.729 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:39:38.729 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:39:38.729 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:39:38.729 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:38.729 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:39:38.729 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:39:38.729 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:39:38.729 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:39:38.729 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:39:38.729 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:39:38.729 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:39:38.730 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:39:38.730 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:39:38.730 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:39:38.730 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:39:38.730 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:39:38.730 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:39:38.730 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:39:38.730 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:39:38.730 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:39:38.730 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:39:38.730 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:39:38.730 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:39:38.731 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:39:38.731 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:39:38.731 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:39:38.731 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:39:38.731 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:39:38.731 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:39:38.731 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:39:38.731 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:39:38.731 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:39:38.731 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:39:38.731 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:39:38.731 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:38.731 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:39:38.732 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:38.732 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:39:38.732 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:39:38.732 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:39:38.732 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:39:38.732 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:38.732 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:39:38.732 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:39:38.732 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:39:38.732 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:38.732 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:38.732 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:39:38.732 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:39:38.733 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:39:38.733 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:39:38.733 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:39:38.733 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:38.733 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:39:38.733 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:39:38.733 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:39:38.733 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:39:38.733 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:39:38.733 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:38.733 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:38.733 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:39:38.733 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:39:38.733 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:39:38.734 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:39:38.734 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:38.734 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:39:38.734 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:39:38.734 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:39:38.734 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:38.734 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:38.734 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:39:38.734 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:39:38.734 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:39:38.734 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:39:38.734 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:39:38.735 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:38.735 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:39:38.735 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:39:38.735 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:39:38.735 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:39:38.735 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:39:38.735 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:38.735 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:38.735 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:39:38.735 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:39:38.735 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:39:38.735 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:39:38.735 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:38.736 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:39:38.736 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:39:38.736 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:39:38.736 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:38.736 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:38.736 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:39:38.736 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:39:38.736 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:39:38.736 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:39:38.736 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:39:38.736 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:38.736 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:39:38.736 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:39:38.736 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:39:38.737 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:39:38.737 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:39:38.737 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:39:38.737 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:39:38.737 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:38.737 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:39:38.737 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:39:38.737 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:38.737 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:39:38.737 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:39:38.737 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:39:38.737 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:39:38.738 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:39:38.738 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:39:38.738 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:38.738 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:39:38.738 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:39:38.738 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 8 2024-08-24T21:39:38.738 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:39:38.738 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:39:38.738 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:39:38.738 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:38.738 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:39:38.738 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:39:38.738 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-08-24T21:39:38.739 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:39:38.739 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:39:38.739 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:39:38.739 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:38.739 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:39:38.739 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:39:38.739 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:39:38.739 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:39:38.739 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:39:38.739 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:38.739 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:39:38.739 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:39:38.741 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:39:38.741 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:39:38.741 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:39:38.931 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:39:38.931 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:39:38.932 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:39:38.932 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:39:38.932 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 252, 2024-08-24T21:39:38.932 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 28095, 2024-08-24T21:39:38.932 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:39:38.932 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:39:38.932 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:39:38.932 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:39:38.932 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:39:38.932 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 7, 2024-08-24T21:39:38.932 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:39:38.932 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:39:38.932 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:39:38.933 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:39:38.933 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:39:38.933 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:39:38.933 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:39:38.933 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:39:38.933 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:39:38.933 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:39:38.933 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:39:38.933 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:39:38.933 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:39:38.933 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:39:38.933 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:39:38.934 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:39:38.934 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:39:38.934 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:39:38.934 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:39:38.934 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:39:38.934 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:39:38.934 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:39:38.934 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:39:38.934 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:39:38.934 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:39:38.934 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:39:38.934 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:39:38.935 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:39:38.935 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:39:38.935 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:38.935 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:39:38.935 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:39:38.935 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:39:38.935 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:39:38.935 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:39:38.935 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:39:38.935 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:39:38.935 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:39:38.935 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:39:38.936 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:39:38.936 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:39:38.936 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:39:38.936 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:39:38.936 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:39:38.936 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:39:38.936 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:39:38.936 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:39:38.936 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:39:38.936 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:39:38.936 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:39:38.936 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:39:38.936 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:39:38.936 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:39:38.937 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:39:38.937 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:39:38.937 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:39:38.937 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:39:38.937 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:39:38.937 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:39:38.937 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:39:38.937 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:38.937 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:39:38.937 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:38.937 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:39:38.937 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:39:38.937 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:39:38.937 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:39:38.938 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:38.938 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:39:38.938 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:39:38.938 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:39:38.938 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:38.938 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:38.938 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:39:38.938 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:39:38.938 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:39:38.938 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:39:38.938 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:39:38.938 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:38.938 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:39:38.938 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:39:38.939 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:39:38.939 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:39:38.939 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:39:38.939 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:38.939 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:38.939 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:39:38.939 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:39:38.939 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:39:38.939 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:39:38.939 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:38.939 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:39:38.939 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:39:38.940 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:39:38.940 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:38.940 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:38.940 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:39:38.940 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:39:38.940 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:39:38.940 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:39:38.940 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:39:38.940 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:38.940 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:39:38.941 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:39:38.941 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:39:38.941 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:39:38.941 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:39:38.941 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:38.941 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:38.941 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:39:38.941 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:39:38.941 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:39:38.941 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:39:38.941 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:38.941 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:39:38.942 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:39:38.942 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:39:38.942 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:38.942 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:38.942 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:39:38.942 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:39:38.942 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:39:38.942 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:39:38.942 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:39:38.942 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:38.942 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:39:38.942 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:39:38.942 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:39:38.942 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:39:38.943 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:39:38.943 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:39:38.943 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:39:38.943 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:38.943 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:39:38.943 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:39:38.943 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:38.943 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:39:38.943 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:39:38.943 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:39:38.943 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:39:38.943 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:39:38.943 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:39:38.944 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:38.944 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:39:38.944 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:39:38.944 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:39:38.944 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:39:38.944 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:39:38.944 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:38.944 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:39:38.944 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:39:38.947 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:39:38.947 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:39:38.947 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:39:39.134 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:39:39.134 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:39:39.134 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:39:39.134 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:39:39.134 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 252, 2024-08-24T21:39:39.134 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 157277, 2024-08-24T21:39:39.134 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:39:39.134 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:39:39.134 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:39:39.135 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:39:39.135 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:39:39.135 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 7, 2024-08-24T21:39:39.135 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:39:39.135 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:39:39.135 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:39:39.135 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:39:39.135 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:39:39.135 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:39:39.136 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:39:39.136 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:39:39.136 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:39:39.136 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:39:39.136 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:39:39.136 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:39:39.136 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:39:39.136 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:39:39.136 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:39:39.136 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:39:39.136 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:39:39.136 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:39:39.136 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:39:39.137 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:39:39.137 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:39:39.137 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:39:39.137 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:39:39.137 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:39:39.137 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:39:39.137 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:39:39.137 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:39:39.137 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:39:39.137 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:39:39.137 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:39.137 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:39:39.138 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:39:39.138 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:39:39.138 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:39:39.138 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:39:39.138 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:39:39.138 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:39:39.138 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:39:39.138 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:39:39.138 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:39:39.138 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:39:39.138 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:39:39.138 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:39:39.138 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:39:39.139 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:39:39.139 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:39:39.139 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:39:39.139 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:39:39.139 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:39:39.139 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:39:39.139 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:39:39.139 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:39:39.139 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:39:39.139 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:39:39.139 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:39:39.139 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:39:39.139 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:39:39.140 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:39:39.140 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:39:39.140 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:39:39.140 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:39.140 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:39:39.140 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:39.140 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:39:39.140 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:39:39.140 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:39:39.140 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:39:39.140 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:39.140 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:39:39.140 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:39:39.141 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:39:39.141 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:39.141 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:39.141 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:39:39.141 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:39:39.141 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:39:39.141 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:39:39.141 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:39:39.141 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:39.141 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:39:39.141 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:39:39.141 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:39:39.142 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:39:39.142 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:39:39.142 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:39.142 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:39.142 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:39:39.142 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:39:39.142 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:39:39.142 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:39:39.142 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:39.142 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:39:39.142 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:39:39.142 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:39:39.142 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:39.143 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:39.143 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:39:39.143 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:39:39.143 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:39:39.143 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:39:39.143 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:39:39.143 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:39.143 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:39:39.143 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:39:39.143 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:39:39.143 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:39:39.143 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:39:39.143 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:39.144 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:39.144 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:39:39.144 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:39:39.144 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:39:39.144 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:39:39.144 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:39.144 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:39:39.144 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:39:39.144 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:39:39.144 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:39.144 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:39.144 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:39:39.144 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:39:39.145 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:39:39.145 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:39:39.145 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:39:39.145 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:39.145 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:39:39.145 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:39:39.145 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:39:39.145 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:39:39.145 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:39:39.145 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:39:39.145 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:39:39.145 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:39.146 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:39:39.146 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:39:39.146 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:39.146 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:39:39.146 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:39:39.146 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:39:39.146 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:39:39.146 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:39:39.146 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:39:39.146 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:39.146 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:39:39.146 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:39:39.146 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-08-24T21:39:39.147 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:39:39.147 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:39:39.147 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:39:39.147 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:39.147 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:39:39.147 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:39:39.147 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:39:39.147 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:39:39.147 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:39:39.147 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:39.147 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:39:39.147 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:39:39.149 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:39:39.150 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-08-24T21:39:39.150 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-08-24T21:39:39.150 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-08-24T21:39:39.150 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-08-24T21:39:39.150 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-08-24T21:39:39.150 INFO:teuthology.orchestra.run:waiting for 300 2024-08-24T21:39:39.173 INFO:tasks.ceph.mon.a:Stopped 2024-08-24T21:39:39.173 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-08-24T21:39:39.173 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:39:39.671 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":252,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:39:41.442 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:39:41.452 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=0a1475e18062b5a535217e99c93748ca 2024-08-24T21:39:41.453 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ 0a1475e18062b5a535217e99c93748ca != \0\a\1\4\7\5\e\1\8\0\6\2\b\5\a\5\3\5\2\1\7\e\9\9\c\9\3\7\4\8\c\a ]] 2024-08-24T21:39:41.453 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap69 2024-08-24T21:39:41.453 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap69 2024-08-24T21:39:41.453 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap69 2024-08-24T21:39:41.560 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:39:41.571 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:39:41.572 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap69 2024-08-24T21:39:41.573 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:39:41.657 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:39:41.657 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:39:41.658 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:39:41.658 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:39:41.658 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:39:41.658 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap70.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:39:42.692 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:39:43.512 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":252,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:39:46.545 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:39:46.993 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":252,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:39:50.012 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:39:53.944 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 5% complete... Importing image diff: 10% complete... Importing image diff: 16% complete... Importing image diff: 21% complete... Importing image diff: 27% complete... Importing image diff: 32% complete... Importing image diff: 38% complete... Importing image diff: 43% complete... Importing image diff: 48% complete... Importing image diff: 54% complete... Importing image diff: 59% complete... Importing image diff: 65% complete... Importing image diff: 70% complete... Importing image diff: 76% complete... Importing image diff: 81% complete... Importing image diff: 82% complete... Importing image diff: 83% complete... Importing image diff: 89% complete... Importing image diff: 94% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2024-08-24T21:39:53.967 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap70 - 2024-08-24T21:39:53.967 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:39:53.968 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:39:54.871 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":254,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:39:54.892 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-08-24T21:39:54.892 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-08-24T21:39:54.892 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:39:55.090 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:39:55.090 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:39:55.090 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:39:55.090 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:39:55.090 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 254, 2024-08-24T21:39:55.090 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 44254, 2024-08-24T21:39:55.090 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:39:55.091 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:39:55.091 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:39:55.091 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:39:55.091 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 1, 2024-08-24T21:39:55.091 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:39:55.091 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:39:55.091 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:39:55.091 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:39:55.091 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:39:55.091 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:39:55.091 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:39:55.091 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:39:55.092 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:39:55.092 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:39:55.092 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:39:55.092 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:39:55.092 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:39:55.092 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:39:55.092 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:39:55.092 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:39:55.092 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:39:55.092 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:39:55.092 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:39:55.092 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:39:55.092 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:39:55.093 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:39:55.093 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:39:55.093 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:39:55.093 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:39:55.093 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:39:55.093 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:39:55.093 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:39:55.093 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:39:55.093 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:55.093 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:39:55.093 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:39:55.093 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:39:55.093 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:39:55.094 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:39:55.094 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:39:55.094 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:39:55.094 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:39:55.094 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:39:55.094 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:39:55.094 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:39:55.094 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:39:55.094 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:39:55.094 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:39:55.094 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:39:55.094 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:39:55.095 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:39:55.095 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:39:55.095 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:39:55.095 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:39:55.095 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:39:55.095 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:39:55.095 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:39:55.095 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:39:55.095 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:39:55.095 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:39:55.095 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:39:55.095 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:39:55.095 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:39:55.096 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:39:55.096 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:55.096 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:39:55.096 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:55.096 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:39:55.096 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:39:55.096 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:39:55.096 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:39:55.096 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:55.096 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:39:55.096 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:39:55.096 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:39:55.096 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:55.097 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:55.097 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:39:55.097 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:39:55.097 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:39:55.097 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:39:55.097 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:39:55.097 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:55.097 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:39:55.097 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:39:55.097 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:39:55.097 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:39:55.097 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:39:55.097 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:55.098 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:55.098 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:39:55.098 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:39:55.098 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:39:55.098 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:39:55.098 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:55.098 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:39:55.098 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:39:55.098 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:39:55.098 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:55.098 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:55.098 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:39:55.098 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:39:55.099 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:39:55.099 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:39:55.099 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:39:55.099 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:55.099 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:39:55.099 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:39:55.099 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:39:55.099 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:39:55.099 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:39:55.099 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:55.099 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:55.099 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:39:55.099 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:39:55.100 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:39:55.100 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:39:55.100 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:55.100 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:39:55.100 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:39:55.100 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:39:55.100 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:55.100 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:55.100 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:39:55.100 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:39:55.100 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:39:55.100 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:39:55.100 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:39:55.101 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:55.101 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:39:55.101 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:39:55.101 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:39:55.101 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:39:55.101 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:39:55.101 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:39:55.101 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:39:55.101 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:55.101 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:39:55.101 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:39:55.101 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:55.101 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:39:55.102 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:39:55.102 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:39:55.102 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:39:55.102 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:39:55.102 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:39:55.102 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:55.102 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:39:55.102 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:39:55.102 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:39:55.102 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:39:55.102 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:39:55.102 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:39:55.102 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:55.103 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:39:55.103 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:39:55.103 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:39:55.103 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:39:55.103 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:39:55.103 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:39:55.103 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:55.103 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:39:55.103 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:39:55.103 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:39:55.103 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:39:55.103 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:39:55.103 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:55.104 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:39:55.104 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:39:55.105 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:39:55.105 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-08-24T21:39:55.105 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:39:55.282 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:39:55.282 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:39:55.283 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:39:55.283 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:39:55.283 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 254, 2024-08-24T21:39:55.283 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 173426, 2024-08-24T21:39:55.283 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:39:55.283 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:39:55.283 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:39:55.283 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:39:55.283 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 1, 2024-08-24T21:39:55.283 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:39:55.283 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:39:55.283 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:39:55.284 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:39:55.284 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:39:55.284 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:39:55.284 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:39:55.284 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:39:55.284 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:39:55.284 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:39:55.284 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:39:55.284 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:39:55.284 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:39:55.284 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:39:55.284 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:39:55.284 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:39:55.285 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:39:55.285 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:39:55.285 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:39:55.285 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:39:55.285 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:39:55.285 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:39:55.285 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:39:55.285 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:39:55.285 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:39:55.285 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:39:55.285 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:39:55.285 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:39:55.285 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:39:55.286 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:55.286 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:39:55.286 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:39:55.286 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:39:55.286 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:39:55.286 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:39:55.286 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:39:55.286 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:39:55.286 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:39:55.286 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:39:55.286 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:39:55.286 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:39:55.287 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:39:55.287 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:39:55.287 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:39:55.287 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:39:55.287 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:39:55.287 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:39:55.287 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:39:55.287 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:39:55.287 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:39:55.287 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:39:55.287 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:39:55.287 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:39:55.287 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:39:55.288 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:39:55.288 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:39:55.288 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:39:55.288 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:39:55.288 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:39:55.288 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:39:55.288 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:55.288 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:39:55.288 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:55.288 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:39:55.288 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:39:55.288 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:39:55.288 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:39:55.289 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:55.289 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:39:55.289 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:39:55.289 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:39:55.289 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:55.289 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:55.289 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:39:55.289 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:39:55.289 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:39:55.289 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:39:55.289 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:39:55.289 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:55.289 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:39:55.290 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:39:55.290 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:39:55.290 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:39:55.290 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:39:55.290 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:55.290 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:55.290 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:39:55.290 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:39:55.290 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:39:55.290 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:39:55.290 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:55.290 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:39:55.290 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:39:55.291 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:39:55.291 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:55.291 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:55.291 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:39:55.291 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:39:55.291 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:39:55.291 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:39:55.291 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:39:55.291 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:55.291 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:39:55.291 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:39:55.291 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:39:55.292 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:39:55.292 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:39:55.292 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:55.292 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:55.292 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:39:55.292 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:39:55.292 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:39:55.292 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:39:55.292 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:55.292 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:39:55.292 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:39:55.292 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:39:55.292 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:55.293 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:55.293 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:39:55.293 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:39:55.293 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:39:55.293 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:39:55.293 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:39:55.293 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:55.293 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:39:55.293 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:39:55.293 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:39:55.293 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:39:55.293 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:39:55.293 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:39:55.294 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:39:55.294 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:55.294 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:39:55.294 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:39:55.294 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:55.294 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:39:55.294 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:39:55.294 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:39:55.294 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:39:55.294 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:39:55.294 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:39:55.294 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:55.294 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:39:55.295 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:39:55.295 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:39:55.295 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:39:55.295 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:39:55.295 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:39:55.295 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:55.295 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:39:55.295 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:39:55.295 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:39:55.295 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:39:55.295 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:39:55.295 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:39:55.295 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:39:55.295 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:39:55.296 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:39:55.296 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:39:55.296 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:39:55.296 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:39:55.296 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:39:55.296 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:39:55.296 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:39:55.297 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:39:55.297 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-08-24T21:39:59.224 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:39:59.300 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=c6fcf882f04563db0707084f0c5c3bca 2024-08-24T21:39:59.301 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap70 - 2024-08-24T21:39:59.301 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:39:59.301 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:40:04.691 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:40:04.701 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=c6fcf882f04563db0707084f0c5c3bca 2024-08-24T21:40:04.701 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ c6fcf882f04563db0707084f0c5c3bca != \c\6\f\c\f\8\8\2\f\0\4\5\6\3\d\b\0\7\0\7\0\8\4\f\0\c\5\c\3\b\c\a ]] 2024-08-24T21:40:04.701 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap70 2024-08-24T21:40:04.701 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap70 2024-08-24T21:40:04.701 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap70 2024-08-24T21:40:04.808 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:40:04.820 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:40:04.821 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap70 2024-08-24T21:40:04.821 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:40:04.900 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:40:04.900 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:40:04.900 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:40:04.900 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:40:04.901 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:40:04.901 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd import-diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe@snap71.diff ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst 2024-08-24T21:40:08.979 INFO:tasks.workunit.client.0.smithi179.stderr: Importing image diff: 2% complete... Importing image diff: 5% complete... Importing image diff: 8% complete... Importing image diff: 11% complete... Importing image diff: 14% complete... Importing image diff: 17% complete... Importing image diff: 20% complete... Importing image diff: 22% complete... Importing image diff: 25% complete... Importing image diff: 28% complete... Importing image diff: 31% complete... Importing image diff: 34% complete... Importing image diff: 37% complete... Importing image diff: 40% complete... Importing image diff: 42% complete... Importing image diff: 45% complete... Importing image diff: 48% complete... Importing image diff: 51% complete... Importing image diff: 54% complete... Importing image diff: 57% complete... Importing image diff: 60% complete... Importing image diff: 62% complete... Importing image diff: 65% complete... Importing image diff: 68% complete... Importing image diff: 71% complete... Importing image diff: 74% complete... Importing image diff: 77% complete... Importing image diff: 80% complete... Importing image diff: 82% complete... Importing image diff: 85% complete... Importing image diff: 88% complete... Importing image diff: 91% complete... Importing image diff: 94% complete... Importing image diff: 97% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2024-08-24T21:40:08.998 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap71 - 2024-08-24T21:40:08.999 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:40:08.999 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:40:14.201 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-08-24T21:40:14.293 INFO:tasks.workunit.client.0.smithi179.stderr:+ src_sum=3a49c246962f6cf388da49f215fd8fb9 2024-08-24T21:40:14.294 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd export ac6341a6-6d9d-4017-bb38-7eb07f2860fe-dst@snap71 - 2024-08-24T21:40:14.294 INFO:tasks.workunit.client.0.smithi179.stderr:++ md5sum 2024-08-24T21:40:14.295 INFO:tasks.workunit.client.0.smithi179.stderr:++ awk '{print $1}' 2024-08-24T21:40:15.298 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-08-24T21:40:15.298 INFO:tasks.ceph.mon.a:Restarting daemon 2024-08-24T21:40:15.299 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-08-24T21:40:15.303 INFO:tasks.ceph.mon.a:Started 2024-08-24T21:40:15.303 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:40:15.303 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:40:15.786 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":254,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":21,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:40:18.806 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:40:19.267 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":254,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":25,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:40:19.675 INFO:tasks.workunit.client.0.smithi179.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-08-24T21:40:19.685 INFO:tasks.workunit.client.0.smithi179.stderr:+ dst_sum=3a49c246962f6cf388da49f215fd8fb9 2024-08-24T21:40:19.685 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ 3a49c246962f6cf388da49f215fd8fb9 != \3\a\4\9\c\2\4\6\9\6\2\f\6\c\f\3\8\8\d\a\4\9\f\2\1\5\f\d\8\f\b\9 ]] 2024-08-24T21:40:19.685 INFO:tasks.workunit.client.0.smithi179.stderr:+ check_object_map ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap71 2024-08-24T21:40:19.685 INFO:tasks.workunit.client.0.smithi179.stderr:+ local spec=ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap71 2024-08-24T21:40:19.685 INFO:tasks.workunit.client.0.smithi179.stderr:+ rbd object-map check ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap71 2024-08-24T21:40:19.795 INFO:tasks.workunit.client.0.smithi179.stderr: Object Map Check: 1% complete... Object Map Check: 2% complete... Object Map Check: 3% complete... Object Map Check: 4% complete... Object Map Check: 5% complete... Object Map Check: 6% complete... Object Map Check: 7% complete... Object Map Check: 8% complete... Object Map Check: 9% complete... Object Map Check: 10% complete... Object Map Check: 11% complete... Object Map Check: 12% complete... Object Map Check: 13% complete... Object Map Check: 14% complete... Object Map Check: 15% complete... Object Map Check: 16% complete... Object Map Check: 17% complete... Object Map Check: 18% complete... Object Map Check: 19% complete... Object Map Check: 20% complete... Object Map Check: 21% complete... Object Map Check: 22% complete... Object Map Check: 23% complete... Object Map Check: 24% complete... Object Map Check: 25% complete... Object Map Check: 26% complete... Object Map Check: 27% complete... Object Map Check: 28% complete... Object Map Check: 29% complete... Object Map Check: 30% complete... Object Map Check: 31% complete... Object Map Check: 32% complete... Object Map Check: 33% complete... Object Map Check: 34% complete... Object Map Check: 35% complete... Object Map Check: 36% complete... Object Map Check: 37% complete... Object Map Check: 38% complete... Object Map Check: 39% complete... Object Map Check: 40% complete... Object Map Check: 41% complete... Object Map Check: 42% complete... Object Map Check: 43% complete... Object Map Check: 44% complete... Object Map Check: 45% complete... Object Map Check: 46% complete... Object Map Check: 47% complete... Object Map Check: 48% complete... Object Map Check: 49% complete... Object Map Check: 50% complete... Object Map Check: 51% complete... Object Map Check: 52% complete... Object Map Check: 53% complete... Object Map Check: 54% complete... Object Map Check: 55% complete... Object Map Check: 56% complete... Object Map Check: 57% complete... Object Map Check: 58% complete... Object Map Check: 59% complete... Object Map Check: 60% complete... Object Map Check: 61% complete... Object Map Check: 62% complete... Object Map Check: 63% complete... Object Map Check: 64% complete... Object Map Check: 65% complete... Object Map Check: 66% complete... Object Map Check: 67% complete... Object Map Check: 68% complete... Object Map Check: 69% complete... Object Map Check: 70% complete... Object Map Check: 71% complete... Object Map Check: 72% complete... Object Map Check: 73% complete... Object Map Check: 74% complete... Object Map Check: 75% complete... Object Map Check: 76% complete... Object Map Check: 77% complete... Object Map Check: 78% complete... Object Map Check: 79% complete... Object Map Check: 80% complete... Object Map Check: 81% complete... Object Map Check: 82% complete... Object Map Check: 83% complete... Object Map Check: 84% complete... Object Map Check: 85% complete... Object Map Check: 86% complete... Object Map Check: 87% complete... Object Map Check: 88% complete... Object Map Check: 89% complete... Object Map Check: 90% complete... Object Map Check: 91% complete... Object Map Check: 92% complete... Object Map Check: 93% complete... Object Map Check: 94% complete... Object Map Check: 95% complete... Object Map Check: 96% complete... Object Map Check: 97% complete... Object Map Check: 98% complete... Object Map Check: 99% complete... Object Map Check: 100% complete...done. 2024-08-24T21:40:19.806 INFO:tasks.workunit.client.0.smithi179.stderr:+ local flags 2024-08-24T21:40:19.808 INFO:tasks.workunit.client.0.smithi179.stderr:++ rbd info ac6341a6-6d9d-4017-bb38-7eb07f2860fe-src@snap71 2024-08-24T21:40:19.808 INFO:tasks.workunit.client.0.smithi179.stderr:++ grep 'flags: ' 2024-08-24T21:40:19.886 INFO:tasks.workunit.client.0.smithi179.stderr:+ flags=' flags: ' 2024-08-24T21:40:19.886 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ object map invalid ]] 2024-08-24T21:40:19.886 INFO:tasks.workunit.client.0.smithi179.stderr:+ [[ flags: =~ fast diff invalid ]] 2024-08-24T21:40:19.886 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i++ )) 2024-08-24T21:40:19.886 INFO:tasks.workunit.client.0.smithi179.stderr:+ (( i <= snap_num )) 2024-08-24T21:40:19.886 INFO:tasks.workunit.client.0.smithi179.stderr:+ echo OK 2024-08-24T21:40:19.887 INFO:tasks.workunit.client.0.smithi179.stdout:OK 2024-08-24T21:40:19.888 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-24T21:40:19.888 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-24T21:40:22.287 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:40:22.741 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":258,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:40:22.759 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:40:22.759 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:40:22.760 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:40:22.936 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:40:22.937 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:40:22.937 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:40:22.937 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:40:22.937 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 258, 2024-08-24T21:40:22.937 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 7468, 2024-08-24T21:40:22.937 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:40:22.937 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:40:22.937 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:40:22.937 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:40:22.937 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:40:22.937 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 1, 2024-08-24T21:40:22.937 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:40:22.938 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:40:22.938 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:40:22.938 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:40:22.938 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:40:22.938 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:40:22.938 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:40:22.938 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:40:22.938 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:40:22.938 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:40:22.938 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:40:22.938 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:40:22.938 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:40:22.939 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:40:22.939 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:40:22.939 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:40:22.939 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:40:22.939 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:40:22.939 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:40:22.939 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:40:22.939 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:40:22.939 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:40:22.939 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:40:22.939 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:40:22.939 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:40:22.940 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:40:22.940 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:40:22.940 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:40:22.940 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:40:22.940 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:22.940 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:40:22.940 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:40:22.940 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:40:22.940 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:40:22.940 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:40:22.940 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:40:22.940 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:40:22.941 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:40:22.941 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:40:22.941 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:40:22.941 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:40:22.941 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:40:22.941 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:40:22.941 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:40:22.941 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:40:22.941 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:40:22.941 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:40:22.941 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:40:22.941 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:40:22.942 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:40:22.942 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:40:22.942 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:40:22.942 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:40:22.942 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:40:22.942 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:40:22.942 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:40:22.942 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:40:22.942 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:40:22.942 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:40:22.942 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:40:22.942 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:22.943 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:40:22.943 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:22.943 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:40:22.943 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:40:22.943 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:40:22.943 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:40:22.943 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:22.943 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:40:22.943 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:40:22.943 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:40:22.943 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:22.943 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:22.944 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:40:22.944 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:40:22.944 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:40:22.944 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:40:22.944 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:40:22.944 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:22.944 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:40:22.944 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:40:22.944 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:40:22.944 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:40:22.945 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:40:22.945 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:22.945 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:22.945 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:40:22.945 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:40:22.945 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:40:22.945 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:40:22.945 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:22.945 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:40:22.945 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:40:22.945 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:40:22.945 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:22.945 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:22.946 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:40:22.946 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:40:22.946 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:40:22.946 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:40:22.946 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:40:22.946 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:22.946 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:40:22.946 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:40:22.946 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:40:22.946 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:40:22.946 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:40:22.946 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:22.946 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:22.947 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:40:22.947 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:40:22.947 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:40:22.947 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:40:22.947 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:22.947 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:40:22.947 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:40:22.947 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:40:22.947 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:22.947 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:22.947 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:40:22.947 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:40:22.947 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:40:22.948 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:40:22.948 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:40:22.948 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:22.948 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:40:22.948 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:40:22.948 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:40:22.948 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:40:22.948 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:40:22.948 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:40:22.948 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:40:22.948 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:22.948 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:40:22.948 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:40:22.948 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:22.949 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:40:22.949 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:40:22.949 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:40:22.949 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:40:22.949 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:40:22.949 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:40:22.949 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:22.949 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:40:22.949 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:40:22.949 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:40:22.949 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:40:22.949 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:40:22.949 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:22.949 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:40:22.950 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:40:22.951 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:40:22.951 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:40:22.951 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:40:23.126 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:40:23.126 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:40:23.126 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:40:23.126 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:40:23.126 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 258, 2024-08-24T21:40:23.126 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 72289, 2024-08-24T21:40:23.126 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:40:23.126 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:40:23.126 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:40:23.127 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:40:23.127 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:40:23.127 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 1, 2024-08-24T21:40:23.127 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:40:23.127 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:40:23.127 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:40:23.127 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:40:23.127 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:40:23.127 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:40:23.127 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:40:23.127 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:40:23.127 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:40:23.128 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:40:23.128 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:40:23.128 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:40:23.128 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:40:23.128 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:40:23.128 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:40:23.128 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:40:23.128 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:40:23.128 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:40:23.128 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:40:23.128 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:40:23.128 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:40:23.129 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:40:23.129 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:40:23.129 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:40:23.129 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:40:23.129 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:40:23.129 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:40:23.129 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:40:23.129 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:40:23.129 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:23.129 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:40:23.129 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:40:23.129 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:40:23.129 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:40:23.130 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:40:23.130 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:40:23.130 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:40:23.130 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:40:23.130 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:40:23.130 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:40:23.130 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:40:23.130 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:40:23.130 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:40:23.130 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:40:23.130 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:40:23.130 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:40:23.131 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:40:23.131 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:40:23.131 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:40:23.131 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:40:23.131 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:40:23.131 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:40:23.131 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:40:23.131 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:40:23.131 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:40:23.131 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:40:23.131 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:40:23.131 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:40:23.131 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:40:23.132 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:40:23.132 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:23.132 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:40:23.132 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:23.132 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:40:23.132 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:40:23.132 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:40:23.132 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:40:23.132 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:23.132 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:40:23.132 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:40:23.132 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:40:23.132 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:23.133 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:23.133 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:40:23.133 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:40:23.133 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:40:23.133 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:40:23.133 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:40:23.133 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:23.133 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:40:23.133 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:40:23.133 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:40:23.133 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:40:23.133 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:40:23.133 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:23.134 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:23.134 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:40:23.134 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:40:23.134 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:40:23.134 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:40:23.134 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:23.134 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:40:23.134 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:40:23.134 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:40:23.134 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:23.134 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:23.134 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:40:23.134 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:40:23.135 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:40:23.135 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:40:23.135 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:40:23.135 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:23.135 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:40:23.135 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:40:23.135 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:40:23.135 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:40:23.135 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:40:23.135 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:23.135 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:23.135 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:40:23.135 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:40:23.136 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:40:23.136 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:40:23.136 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:23.136 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:40:23.136 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:40:23.136 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:40:23.136 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:23.136 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:23.136 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:40:23.136 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:40:23.136 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:40:23.136 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:40:23.136 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:40:23.137 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:23.137 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:40:23.137 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:40:23.137 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:40:23.137 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:40:23.137 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:40:23.137 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:40:23.137 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:40:23.137 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:23.137 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:40:23.137 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:40:23.137 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:23.137 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:40:23.137 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:40:23.138 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:40:23.138 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:40:23.138 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:40:23.138 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:40:23.138 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:23.138 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:40:23.138 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:40:23.138 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:40:23.138 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:40:23.138 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:40:23.138 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:40:23.138 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:23.138 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:40:23.139 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:40:23.139 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:40:23.139 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:40:23.139 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:40:23.139 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:40:23.139 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:23.139 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:40:23.139 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:40:23.139 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:40:23.139 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:40:23.139 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:40:23.139 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:23.139 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:40:23.140 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:40:23.141 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:40:23.141 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:40:23.141 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:40:23.317 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:40:23.317 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:40:23.318 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:40:23.318 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:40:23.318 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 258, 2024-08-24T21:40:23.318 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 201462, 2024-08-24T21:40:23.318 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:40:23.318 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:40:23.318 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:40:23.318 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:40:23.318 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:40:23.318 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 1, 2024-08-24T21:40:23.318 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:40:23.319 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:40:23.319 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:40:23.319 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:40:23.319 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:40:23.319 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:40:23.319 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:40:23.319 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:40:23.319 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:40:23.319 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:40:23.319 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:40:23.319 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:40:23.320 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:40:23.320 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:40:23.320 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:40:23.320 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:40:23.320 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:40:23.320 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:40:23.320 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:40:23.320 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:40:23.320 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:40:23.321 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:40:23.321 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:40:23.321 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:40:23.321 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:40:23.321 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:40:23.321 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:40:23.321 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:40:23.321 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:40:23.321 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:23.321 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:40:23.322 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:40:23.322 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:40:23.322 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:40:23.322 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:40:23.322 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:40:23.322 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:40:23.322 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:40:23.322 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:40:23.322 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:40:23.322 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:40:23.323 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:40:23.323 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:40:23.323 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:40:23.323 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:40:23.323 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:40:23.323 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:40:23.323 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:40:23.323 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:40:23.323 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:40:23.323 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:40:23.323 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:40:23.324 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:40:23.324 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:40:23.324 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:40:23.324 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:40:23.324 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:40:23.324 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:40:23.324 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:40:23.324 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:40:23.324 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:23.324 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:40:23.324 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:23.325 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:40:23.325 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:40:23.325 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:40:23.325 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:40:23.325 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:23.325 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:40:23.325 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:40:23.325 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:40:23.326 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:23.326 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:23.326 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:40:23.326 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:40:23.326 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:40:23.326 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:40:23.326 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:40:23.326 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:23.326 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:40:23.326 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:40:23.326 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:40:23.327 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:40:23.327 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:40:23.327 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:23.327 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:23.327 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:40:23.327 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:40:23.327 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:40:23.327 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:40:23.327 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:23.327 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:40:23.327 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:40:23.328 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:40:23.328 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:23.328 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:23.328 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:40:23.328 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:40:23.328 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:40:23.328 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:40:23.328 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:40:23.328 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:23.328 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:40:23.328 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:40:23.328 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:40:23.329 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:40:23.329 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:40:23.329 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:23.329 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:23.329 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:40:23.329 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:40:23.329 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:40:23.329 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:40:23.329 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:23.329 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:40:23.330 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:40:23.330 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:40:23.330 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:23.330 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:23.330 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:40:23.330 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:40:23.330 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:40:23.330 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:40:23.330 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:40:23.330 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:23.331 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:40:23.331 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:40:23.331 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:40:23.331 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:40:23.331 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:40:23.331 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:40:23.331 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:40:23.331 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:23.331 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:40:23.331 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:40:23.331 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:23.331 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:40:23.332 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:40:23.332 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:40:23.332 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:40:23.332 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:40:23.332 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:40:23.332 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:23.332 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:40:23.332 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:40:23.332 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:40:23.332 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:40:23.332 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:40:23.332 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:40:23.333 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:23.333 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:40:23.333 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:40:23.333 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:40:23.333 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:40:23.333 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:40:23.333 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:40:23.333 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:23.333 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:40:23.333 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:40:23.333 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:40:23.333 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:40:23.334 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:40:23.334 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:23.334 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:40:23.334 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:40:23.335 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:40:23.335 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-08-24T21:40:23.335 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-08-24T21:40:23.800 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-08-24T21:40:24.800 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:40:24.801 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:40:25.247 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":258,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:40:25.264 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:40:25.264 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-08-24T21:40:25.264 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:40:25.265 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:40:25.439 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:40:25.439 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:40:25.439 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:40:25.439 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:40:25.439 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 258, 2024-08-24T21:40:25.440 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 9971, 2024-08-24T21:40:25.440 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:40:25.440 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:40:25.440 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:40:25.440 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:40:25.440 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:40:25.440 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 3, 2024-08-24T21:40:25.440 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:40:25.440 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:40:25.440 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:40:25.440 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:40:25.440 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:40:25.440 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:40:25.441 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:40:25.441 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:40:25.441 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:40:25.441 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:40:25.441 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:40:25.441 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:40:25.441 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:40:25.441 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:40:25.441 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:40:25.441 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:40:25.441 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:40:25.441 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:40:25.441 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:40:25.442 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:40:25.442 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:40:25.442 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:40:25.442 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:40:25.442 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:40:25.442 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:40:25.442 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:40:25.442 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:40:25.442 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:40:25.442 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:40:25.442 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:25.442 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:40:25.443 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:40:25.443 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:40:25.443 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:40:25.443 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:40:25.443 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:40:25.443 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:40:25.443 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:40:25.443 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:40:25.443 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:40:25.443 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:40:25.443 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:40:25.443 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:40:25.443 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:40:25.444 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:40:25.444 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:40:25.444 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:40:25.444 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:40:25.444 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:40:25.444 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:40:25.444 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:40:25.444 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:40:25.444 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:40:25.444 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:40:25.444 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:40:25.444 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:40:25.444 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:40:25.445 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:40:25.445 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:40:25.445 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:40:25.445 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:25.445 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:40:25.445 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:25.445 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:40:25.445 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:40:25.445 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:40:25.445 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:40:25.445 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:25.445 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:40:25.445 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:40:25.446 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:40:25.446 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:25.446 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:25.446 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:40:25.446 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:40:25.446 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:40:25.446 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:40:25.446 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:40:25.446 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:25.446 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:40:25.446 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:40:25.446 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:40:25.447 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:40:25.447 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:40:25.447 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:25.447 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:25.447 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:40:25.447 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:40:25.447 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:40:25.447 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:40:25.447 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:25.447 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:40:25.448 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:40:25.448 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:40:25.448 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:25.448 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:25.448 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:40:25.448 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:40:25.448 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:40:25.448 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:40:25.448 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:40:25.448 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:25.449 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:40:25.449 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:40:25.449 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:40:25.449 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:40:25.449 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:40:25.449 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:25.449 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:25.449 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:40:25.449 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:40:25.449 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:40:25.449 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:40:25.449 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:25.449 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:40:25.450 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:40:25.450 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:40:25.450 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:25.450 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:25.450 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:40:25.450 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:40:25.450 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:40:25.450 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:40:25.450 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:40:25.450 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:25.450 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:40:25.450 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:40:25.450 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:40:25.451 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:40:25.451 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:40:25.451 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:40:25.451 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:40:25.451 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:25.451 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:40:25.451 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:40:25.451 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:25.451 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:40:25.451 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:40:25.452 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:40:25.452 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:40:25.452 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:40:25.452 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:40:25.452 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:25.452 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:40:25.452 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:40:25.452 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:40:25.452 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:40:25.452 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:40:25.452 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:25.453 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:40:25.453 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:40:25.454 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:40:25.454 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:40:25.454 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:40:25.560 INFO:tasks.workunit:Stopping ['rbd/diff_continuous.sh'] on client.0... 2024-08-24T21:40:25.561 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-08-24T21:40:25.629 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:40:25.630 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:40:25.630 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:40:25.630 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:40:25.630 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 258, 2024-08-24T21:40:25.630 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 74793, 2024-08-24T21:40:25.630 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:40:25.630 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:40:25.630 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:40:25.631 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:40:25.631 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:40:25.631 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 3, 2024-08-24T21:40:25.631 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:40:25.631 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:40:25.631 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:40:25.631 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:40:25.631 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:40:25.631 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:40:25.631 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:40:25.631 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:40:25.631 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:40:25.632 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:40:25.632 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:40:25.632 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:40:25.632 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:40:25.632 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:40:25.632 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:40:25.632 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:40:25.632 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:40:25.632 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:40:25.632 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:40:25.632 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:40:25.632 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:40:25.632 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:40:25.633 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:40:25.633 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:40:25.633 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:40:25.633 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:40:25.633 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:40:25.633 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:40:25.633 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:40:25.633 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:25.633 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:40:25.633 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:40:25.633 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:40:25.633 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:40:25.634 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:40:25.634 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:40:25.634 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:40:25.634 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:40:25.634 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:40:25.634 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:40:25.634 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:40:25.634 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:40:25.634 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:40:25.634 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:40:25.634 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:40:25.634 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:40:25.634 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:40:25.635 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:40:25.635 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:40:25.635 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:40:25.635 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:40:25.635 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:40:25.635 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:40:25.635 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:40:25.635 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:40:25.635 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:40:25.635 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:40:25.635 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:40:25.635 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:40:25.635 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:40:25.636 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:25.636 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:40:25.636 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:25.636 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:40:25.636 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:40:25.636 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:40:25.636 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:40:25.636 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:25.636 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:40:25.636 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:40:25.636 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:40:25.636 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:25.636 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:25.637 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:40:25.637 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:40:25.637 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:40:25.637 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:40:25.637 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:40:25.637 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:25.637 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:40:25.637 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:40:25.637 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:40:25.637 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:40:25.637 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:40:25.637 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:25.637 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:25.638 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:40:25.638 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:40:25.638 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:40:25.638 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:40:25.638 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:25.638 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:40:25.638 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:40:25.638 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:40:25.638 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:25.638 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:25.638 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:40:25.638 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:40:25.638 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:40:25.639 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:40:25.639 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:40:25.639 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:25.639 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:40:25.639 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:40:25.639 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:40:25.639 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:40:25.639 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:40:25.639 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:25.639 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:25.639 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:40:25.639 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:40:25.640 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:40:25.640 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:40:25.640 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:25.640 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:40:25.640 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:40:25.640 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:40:25.640 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:25.640 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:25.640 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:40:25.640 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:40:25.640 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:40:25.640 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:40:25.641 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:40:25.641 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:25.641 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:40:25.641 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:40:25.641 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:40:25.641 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:40:25.641 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:40:25.641 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:40:25.641 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:40:25.641 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:25.641 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:40:25.641 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:40:25.641 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:25.641 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:40:25.642 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:40:25.642 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:40:25.642 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:40:25.642 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:40:25.642 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:40:25.642 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:25.642 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:40:25.642 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:40:25.642 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:40:25.642 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:40:25.642 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:40:25.642 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:40:25.643 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:25.643 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:40:25.643 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:40:25.643 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:40:25.643 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:40:25.643 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:40:25.643 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:40:25.643 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:25.643 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:40:25.643 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:40:25.643 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:40:25.643 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:40:25.643 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:40:25.644 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:25.644 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:40:25.644 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:40:25.645 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:40:25.645 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:40:25.645 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:40:25.823 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:40:25.823 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:40:25.823 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:40:25.823 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:40:25.823 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 258, 2024-08-24T21:40:25.823 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 203967, 2024-08-24T21:40:25.823 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:40:25.823 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:40:25.823 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:40:25.824 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:40:25.824 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:40:25.824 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 4, 2024-08-24T21:40:25.824 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:40:25.824 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:40:25.824 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:40:25.824 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:40:25.824 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:40:25.824 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:40:25.824 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:40:25.824 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:40:25.824 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:40:25.825 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:40:25.825 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:40:25.825 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:40:25.825 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:40:25.825 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:40:25.825 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:40:25.825 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:40:25.825 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:40:25.825 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:40:25.825 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:40:25.825 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:40:25.826 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:40:25.826 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:40:25.826 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:40:25.826 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:40:25.826 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:40:25.826 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:40:25.826 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:40:25.826 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:40:25.826 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:40:25.826 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:25.826 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:40:25.826 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:40:25.826 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:40:25.827 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:40:25.827 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:40:25.827 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:40:25.827 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:40:25.827 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:40:25.827 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:40:25.827 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:40:25.827 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:40:25.827 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:40:25.827 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:40:25.827 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:40:25.827 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:40:25.828 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:40:25.828 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:40:25.828 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:40:25.828 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:40:25.828 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:40:25.828 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:40:25.828 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:40:25.828 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:40:25.828 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:40:25.828 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:40:25.828 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:40:25.828 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:40:25.829 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:40:25.829 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:40:25.829 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:40:25.829 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:25.829 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:40:25.829 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:25.829 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:40:25.829 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:40:25.829 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:40:25.829 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:40:25.829 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:25.829 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:40:25.829 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:40:25.830 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:40:25.830 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:25.830 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:25.830 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:40:25.830 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:40:25.830 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:40:25.830 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:40:25.830 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:40:25.830 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:25.830 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:40:25.830 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:40:25.830 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:40:25.831 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:40:25.831 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:40:25.831 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:25.831 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:25.831 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:40:25.831 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:40:25.831 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:40:25.831 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:40:25.831 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:25.831 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:40:25.831 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:40:25.832 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:40:25.832 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:25.832 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:25.832 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:40:25.832 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:40:25.832 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:40:25.832 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:40:25.832 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:40:25.832 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:25.832 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:40:25.832 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:40:25.832 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:40:25.832 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:40:25.833 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:40:25.833 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:25.833 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:25.833 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:40:25.833 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:40:25.833 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:40:25.833 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:40:25.833 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:25.833 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:40:25.833 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:40:25.833 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:40:25.833 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:25.833 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:25.834 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:40:25.834 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:40:25.834 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:40:25.834 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:40:25.834 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:40:25.834 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:25.834 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:40:25.834 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:40:25.834 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:40:25.834 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:40:25.834 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:40:25.834 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:40:25.835 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:40:25.835 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:25.835 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:40:25.835 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:40:25.835 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:25.835 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:40:25.835 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:40:25.835 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:40:25.835 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:40:25.835 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:40:25.835 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:40:25.835 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:25.836 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:40:25.836 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:40:25.836 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:40:25.836 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:40:25.836 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:40:25.836 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:40:25.836 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:25.836 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:40:25.836 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:40:25.836 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:40:25.836 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:40:25.837 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:40:25.837 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:40:25.837 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:25.837 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:40:25.837 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:40:25.837 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:40:25.837 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:40:25.837 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:40:25.837 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:25.837 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:40:25.837 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:40:25.841 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:40:25.841 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2024-08-24T21:40:25.841 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-08-24T21:40:25.841 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-08-24T21:40:25.841 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-08-24T21:40:25.841 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-08-24T21:40:25.841 INFO:teuthology.orchestra.run:waiting for 300 2024-08-24T21:40:25.868 INFO:tasks.ceph.mon.b:Stopped 2024-08-24T21:40:25.868 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-08-24T21:40:25.868 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:40:26.307 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":258,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:40:26.607 DEBUG:teuthology.parallel:result is None 2024-08-24T21:40:26.608 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-08-24T21:40:26.662 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-08-24T21:40:26.663 DEBUG:teuthology.orchestra.run.smithi179:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-08-24T21:40:26.707 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-08-24T21:40:26.708 DEBUG:teuthology.run_tasks:Unwinding manager mon_thrash 2024-08-24T21:40:26.717 INFO:tasks.mon_thrash:joining mon_thrasher 2024-08-24T21:40:26.717 ERROR:teuthology.run_tasks:Manager failed: mon_thrash Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_797669399b32d2915e64eb6d4b1257ae3c50f80b/qa/tasks/mon_thrash.py", line 466, in task thrash_proc.stop_and_join() File "/home/teuthworker/src/git.ceph.com_ceph_797669399b32d2915e64eb6d4b1257ae3c50f80b/qa/tasks/mon_thrash.py", line 178, in stop_and_join return self.join() File "/home/teuthworker/src/git.ceph.com_ceph_797669399b32d2915e64eb6d4b1257ae3c50f80b/qa/tasks/mon_thrash.py", line 170, in join self.stopping.set() AttributeError: 'bool' object has no attribute 'set' 2024-08-24T21:40:26.735 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-08-24T21:40:26.761 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-24T21:40:26.762 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-24T21:40:27.137 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-08-24T21:40:27.138 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-08-24T21:40:27.155 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":1048,"stamp":"2024-08-24T21:40:27.026773+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23859654627,"num_objects":36317,"num_object_clones":31842,"num_object_copies":72634,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36317,"num_whiteouts":0,"num_read":558422,"num_read_kb":241182654,"num_write":158283,"num_write_kb":23266563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80516,"ondisk_log_size":80516,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":48430264,"kb_used_data":46529504,"kb_used_omap":12,"kb_used_meta":1900595,"kb_avail":706544456,"statfs":{"total":773094113280,"available":723501522944,"internally_reserved":0,"allocated":47646212096,"data_stored":64462396822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1946209841},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5921,"num_read_kb":2333279,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002113"},"pg_stats":[{"pgid":"2.7","version":"165'23851","reported_seq":61060,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-24T21:40:19.793775+0000","last_change":"2024-08-24T21:10:56.934834+0000","last_active":"2024-08-24T21:40:19.793775+0000","last_peered":"2024-08-24T21:40:19.793775+0000","last_clean":"2024-08-24T21:40:19.793775+0000","last_became_active":"2024-08-24T21:10:54.740448+0000","last_became_peered":"2024-08-24T21:10:54.740448+0000","last_unstale":"2024-08-24T21:40:19.793775+0000","last_undegraded":"2024-08-24T21:40:19.793775+0000","last_fullsized":"2024-08-24T21:40:19.793775+0000","mapping_epoch":17,"log_start":"92'13824","ondisk_log_start":"92'13824","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":0,"log_size":10027,"log_dups_size":0,"ondisk_log_size":10027,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T01:28:15.280592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063699500000000001,"stat_sum":{"num_bytes":3058996982,"num_objects":4709,"num_object_clones":4119,"num_object_copies":9418,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4709,"num_whiteouts":0,"num_read":78231,"num_read_kb":31399812,"num_write":19230,"num_write_kb":2986515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"164'19794","reported_seq":51268,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-24T21:40:19.793814+0000","last_change":"2024-08-24T21:10:56.746217+0000","last_active":"2024-08-24T21:40:19.793814+0000","last_peered":"2024-08-24T21:40:19.793814+0000","last_clean":"2024-08-24T21:40:19.793814+0000","last_became_active":"2024-08-24T21:10:54.740255+0000","last_became_peered":"2024-08-24T21:10:54.740255+0000","last_unstale":"2024-08-24T21:40:19.793814+0000","last_undegraded":"2024-08-24T21:40:19.793814+0000","last_fullsized":"2024-08-24T21:40:19.793814+0000","mapping_epoch":17,"log_start":"78'9720","ondisk_log_start":"78'9720","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":0,"log_size":10074,"log_dups_size":0,"ondisk_log_size":10074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T04:55:03.692111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065658299999999997,"stat_sum":{"num_bytes":2766190002,"num_objects":4332,"num_object_clones":3794,"num_object_copies":8664,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4332,"num_whiteouts":0,"num_read":34855,"num_read_kb":27515762,"num_write":15521,"num_write_kb":2696713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"164'39397","reported_seq":72814,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-24T21:40:19.793998+0000","last_change":"2024-08-24T21:10:56.908791+0000","last_active":"2024-08-24T21:40:19.793998+0000","last_peered":"2024-08-24T21:40:19.793998+0000","last_clean":"2024-08-24T21:40:19.793998+0000","last_became_active":"2024-08-24T21:10:55.004842+0000","last_became_peered":"2024-08-24T21:10:55.004842+0000","last_unstale":"2024-08-24T21:40:19.793998+0000","last_undegraded":"2024-08-24T21:40:19.793998+0000","last_fullsized":"2024-08-24T21:40:19.793998+0000","mapping_epoch":17,"log_start":"92'29331","ondisk_log_start":"92'29331","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":0,"log_size":10066,"log_dups_size":0,"ondisk_log_size":10066,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T04:55:03.692111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039021900000000003,"stat_sum":{"num_bytes":3013331164,"num_objects":4518,"num_object_clones":3976,"num_object_copies":9036,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4518,"num_whiteouts":0,"num_read":122735,"num_read_kb":30694751,"num_write":29066,"num_write_kb":2942932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"164'23077","reported_seq":55452,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-24T21:40:19.794427+0000","last_change":"2024-08-24T21:10:56.746203+0000","last_active":"2024-08-24T21:40:19.794427+0000","last_peered":"2024-08-24T21:40:19.794427+0000","last_clean":"2024-08-24T21:40:19.794427+0000","last_became_active":"2024-08-24T21:10:55.004437+0000","last_became_peered":"2024-08-24T21:10:55.004437+0000","last_unstale":"2024-08-24T21:40:19.794427+0000","last_undegraded":"2024-08-24T21:40:19.794427+0000","last_fullsized":"2024-08-24T21:40:19.794427+0000","mapping_epoch":17,"log_start":"91'13021","ondisk_log_start":"91'13021","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":0,"log_size":10056,"log_dups_size":0,"ondisk_log_size":10056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T00:15:23.483421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000725513,"stat_sum":{"num_bytes":2932036880,"num_objects":4426,"num_object_clones":3878,"num_object_copies":8852,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4426,"num_whiteouts":0,"num_read":35836,"num_read_kb":29684996,"num_write":18753,"num_write_kb":2857790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"164'21396","reported_seq":53998,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-24T21:40:19.856760+0000","last_change":"2024-08-24T21:10:56.750634+0000","last_active":"2024-08-24T21:40:19.856760+0000","last_peered":"2024-08-24T21:40:19.856760+0000","last_clean":"2024-08-24T21:40:19.856760+0000","last_became_active":"2024-08-24T21:10:54.740821+0000","last_became_peered":"2024-08-24T21:10:54.740821+0000","last_unstale":"2024-08-24T21:40:19.856760+0000","last_undegraded":"2024-08-24T21:40:19.856760+0000","last_fullsized":"2024-08-24T21:40:19.856760+0000","mapping_epoch":17,"log_start":"78'11320","ondisk_log_start":"78'11320","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":0,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T03:48:00.497375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096400900000000005,"stat_sum":{"num_bytes":2659980271,"num_objects":4067,"num_object_clones":3542,"num_object_copies":8134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4067,"num_whiteouts":0,"num_read":36071,"num_read_kb":27990304,"num_write":17504,"num_write_kb":2596261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"165'29475","reported_seq":75915,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-24T21:40:19.876023+0000","last_change":"2024-08-24T21:10:57.267485+0000","last_active":"2024-08-24T21:40:19.876023+0000","last_peered":"2024-08-24T21:40:19.876023+0000","last_clean":"2024-08-24T21:40:19.876023+0000","last_became_active":"2024-08-24T21:10:54.739867+0000","last_became_peered":"2024-08-24T21:10:54.739867+0000","last_unstale":"2024-08-24T21:40:19.876023+0000","last_undegraded":"2024-08-24T21:40:19.876023+0000","last_fullsized":"2024-08-24T21:40:19.876023+0000","mapping_epoch":17,"log_start":"92'19428","ondisk_log_start":"92'19428","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":0,"log_size":10047,"log_dups_size":0,"ondisk_log_size":10047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T08:42:14.599997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032487299999999999,"stat_sum":{"num_bytes":3343910484,"num_objects":4629,"num_object_clones":4068,"num_object_copies":9258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4629,"num_whiteouts":0,"num_read":174392,"num_read_kb":34621705,"num_write":23960,"num_write_kb":3248477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"164'22604","reported_seq":59105,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-24T21:40:19.793289+0000","last_change":"2024-08-24T21:10:56.908772+0000","last_active":"2024-08-24T21:40:19.793289+0000","last_peered":"2024-08-24T21:40:19.793289+0000","last_clean":"2024-08-24T21:40:19.793289+0000","last_became_active":"2024-08-24T21:10:54.739290+0000","last_became_peered":"2024-08-24T21:10:54.739290+0000","last_unstale":"2024-08-24T21:40:19.793289+0000","last_undegraded":"2024-08-24T21:40:19.793289+0000","last_fullsized":"2024-08-24T21:40:19.793289+0000","mapping_epoch":17,"log_start":"92'12530","ondisk_log_start":"92'12530","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":0,"log_size":10074,"log_dups_size":0,"ondisk_log_size":10074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T00:15:23.483421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041195799999999997,"stat_sum":{"num_bytes":3333325934,"num_objects":5308,"num_object_clones":4686,"num_object_copies":10616,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5308,"num_whiteouts":0,"num_read":40760,"num_read_kb":32068269,"num_write":17460,"num_write_kb":3254135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"164'20837","reported_seq":52816,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-24T21:40:19.793107+0000","last_change":"2024-08-24T21:10:56.750104+0000","last_active":"2024-08-24T21:40:19.793107+0000","last_peered":"2024-08-24T21:40:19.793107+0000","last_clean":"2024-08-24T21:40:19.793107+0000","last_became_active":"2024-08-24T21:10:54.741763+0000","last_became_peered":"2024-08-24T21:10:54.741763+0000","last_unstale":"2024-08-24T21:40:19.793107+0000","last_undegraded":"2024-08-24T21:40:19.793107+0000","last_fullsized":"2024-08-24T21:40:19.793107+0000","mapping_epoch":17,"log_start":"78'10813","ondisk_log_start":"78'10813","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":0,"log_size":10024,"log_dups_size":0,"ondisk_log_size":10024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-25T22:06:03.893682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044521900000000001,"stat_sum":{"num_bytes":2751292542,"num_objects":4326,"num_object_clones":3779,"num_object_copies":8652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4326,"num_whiteouts":0,"num_read":35476,"num_read_kb":27207000,"num_write":16688,"num_write_kb":2682112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":415,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-24T21:40:08.969043+0000","last_change":"2024-08-24T21:10:48.523941+0000","last_active":"2024-08-24T21:40:08.969043+0000","last_peered":"2024-08-24T21:40:08.969043+0000","last_clean":"2024-08-24T21:40:08.969043+0000","last_became_active":"2024-08-24T21:10:48.522968+0000","last_became_peered":"2024-08-24T21:10:48.522968+0000","last_unstale":"2024-08-24T21:40:08.969043+0000","last_undegraded":"2024-08-24T21:40:08.969043+0000","last_fullsized":"2024-08-24T21:40:08.969043+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:47.498247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:47.498247+0000","last_clean_scrub_stamp":"2024-08-24T21:10:47.498247+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T07:03:32.558304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":23859064259,"num_objects":36315,"num_object_clones":31842,"num_object_copies":72630,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36315,"num_whiteouts":0,"num_read":558356,"num_read_kb":241182599,"num_write":158182,"num_write_kb":23264935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":47629131776,"data_stored":64453999494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80444,"ondisk_log_size":80444,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575205,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9578200,"kb_used_data":9177860,"kb_used_omap":1,"kb_used_meta":400318,"kb_avail":84793640,"statfs":{"total":96636764160,"available":86828687360,"internally_reserved":0,"allocated":9398128640,"data_stored":12597758490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":409926091},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575206,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5878516,"kb_used_data":5685024,"kb_used_omap":1,"kb_used_meta":193470,"kb_avail":88493324,"statfs":{"total":96636764160,"available":90617163776,"internally_reserved":0,"allocated":5821464576,"data_stored":7669968994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":198113734},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575206,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5486276,"kb_used_data":5280304,"kb_used_omap":1,"kb_used_meta":205950,"kb_avail":88885564,"statfs":{"total":96636764160,"available":91018817536,"internally_reserved":0,"allocated":5407031296,"data_stored":7168891943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":210893253},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575207,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28968,"kb_used_data":1940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342872,"statfs":{"total":96636764160,"available":96607100928,"internally_reserved":0,"allocated":1986560,"data_stored":902074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575206,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3393688,"kb_used_data":3250120,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":90978152,"statfs":{"total":96636764160,"available":93161627648,"internally_reserved":0,"allocated":3328122880,"data_stored":4869306894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":146995655},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575207,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6188152,"kb_used_data":5932200,"kb_used_omap":1,"kb_used_meta":255934,"kb_avail":88183688,"statfs":{"total":96636764160,"available":90300096512,"internally_reserved":0,"allocated":6074572800,"data_stored":8657632908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":262076869},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575206,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11789264,"kb_used_data":11406908,"kb_used_omap":1,"kb_used_meta":382334,"kb_avail":82582576,"statfs":{"total":96636764160,"available":84564557824,"internally_reserved":0,"allocated":11680673792,"data_stored":15434675929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":391510469},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575206,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6087200,"kb_used_data":5795148,"kb_used_omap":1,"kb_used_meta":292030,"kb_avail":88284640,"statfs":{"total":96636764160,"available":90403471360,"internally_reserved":0,"allocated":5934231552,"data_stored":8063259590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":299039173},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5931651072,"data_stored":8061767148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11678687232,"data_stored":15433773855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6072586240,"data_stored":8656730834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3326136320,"data_stored":4868404820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5405044736,"data_stored":7167989869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5819478016,"data_stored":7669066920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9395548160,"data_stored":12596266048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-24T21:40:27.156 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-24T21:40:27.523 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-08-24T21:40:27.524 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-08-24T21:40:27.537 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":1048,"stamp":"2024-08-24T21:40:27.026773+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23859654627,"num_objects":36317,"num_object_clones":31842,"num_object_copies":72634,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36317,"num_whiteouts":0,"num_read":558422,"num_read_kb":241182654,"num_write":158283,"num_write_kb":23266563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80516,"ondisk_log_size":80516,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":48430264,"kb_used_data":46529504,"kb_used_omap":12,"kb_used_meta":1900595,"kb_avail":706544456,"statfs":{"total":773094113280,"available":723501522944,"internally_reserved":0,"allocated":47646212096,"data_stored":64462396822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1946209841},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5921,"num_read_kb":2333279,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002113"},"pg_stats":[{"pgid":"2.7","version":"165'23851","reported_seq":61060,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-24T21:40:19.793775+0000","last_change":"2024-08-24T21:10:56.934834+0000","last_active":"2024-08-24T21:40:19.793775+0000","last_peered":"2024-08-24T21:40:19.793775+0000","last_clean":"2024-08-24T21:40:19.793775+0000","last_became_active":"2024-08-24T21:10:54.740448+0000","last_became_peered":"2024-08-24T21:10:54.740448+0000","last_unstale":"2024-08-24T21:40:19.793775+0000","last_undegraded":"2024-08-24T21:40:19.793775+0000","last_fullsized":"2024-08-24T21:40:19.793775+0000","mapping_epoch":17,"log_start":"92'13824","ondisk_log_start":"92'13824","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":0,"log_size":10027,"log_dups_size":0,"ondisk_log_size":10027,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T01:28:15.280592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063699500000000001,"stat_sum":{"num_bytes":3058996982,"num_objects":4709,"num_object_clones":4119,"num_object_copies":9418,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4709,"num_whiteouts":0,"num_read":78231,"num_read_kb":31399812,"num_write":19230,"num_write_kb":2986515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"164'19794","reported_seq":51268,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-24T21:40:19.793814+0000","last_change":"2024-08-24T21:10:56.746217+0000","last_active":"2024-08-24T21:40:19.793814+0000","last_peered":"2024-08-24T21:40:19.793814+0000","last_clean":"2024-08-24T21:40:19.793814+0000","last_became_active":"2024-08-24T21:10:54.740255+0000","last_became_peered":"2024-08-24T21:10:54.740255+0000","last_unstale":"2024-08-24T21:40:19.793814+0000","last_undegraded":"2024-08-24T21:40:19.793814+0000","last_fullsized":"2024-08-24T21:40:19.793814+0000","mapping_epoch":17,"log_start":"78'9720","ondisk_log_start":"78'9720","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":0,"log_size":10074,"log_dups_size":0,"ondisk_log_size":10074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T04:55:03.692111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065658299999999997,"stat_sum":{"num_bytes":2766190002,"num_objects":4332,"num_object_clones":3794,"num_object_copies":8664,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4332,"num_whiteouts":0,"num_read":34855,"num_read_kb":27515762,"num_write":15521,"num_write_kb":2696713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"164'39397","reported_seq":72814,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-24T21:40:19.793998+0000","last_change":"2024-08-24T21:10:56.908791+0000","last_active":"2024-08-24T21:40:19.793998+0000","last_peered":"2024-08-24T21:40:19.793998+0000","last_clean":"2024-08-24T21:40:19.793998+0000","last_became_active":"2024-08-24T21:10:55.004842+0000","last_became_peered":"2024-08-24T21:10:55.004842+0000","last_unstale":"2024-08-24T21:40:19.793998+0000","last_undegraded":"2024-08-24T21:40:19.793998+0000","last_fullsized":"2024-08-24T21:40:19.793998+0000","mapping_epoch":17,"log_start":"92'29331","ondisk_log_start":"92'29331","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":0,"log_size":10066,"log_dups_size":0,"ondisk_log_size":10066,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T04:55:03.692111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039021900000000003,"stat_sum":{"num_bytes":3013331164,"num_objects":4518,"num_object_clones":3976,"num_object_copies":9036,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4518,"num_whiteouts":0,"num_read":122735,"num_read_kb":30694751,"num_write":29066,"num_write_kb":2942932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"164'23077","reported_seq":55452,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-24T21:40:19.794427+0000","last_change":"2024-08-24T21:10:56.746203+0000","last_active":"2024-08-24T21:40:19.794427+0000","last_peered":"2024-08-24T21:40:19.794427+0000","last_clean":"2024-08-24T21:40:19.794427+0000","last_became_active":"2024-08-24T21:10:55.004437+0000","last_became_peered":"2024-08-24T21:10:55.004437+0000","last_unstale":"2024-08-24T21:40:19.794427+0000","last_undegraded":"2024-08-24T21:40:19.794427+0000","last_fullsized":"2024-08-24T21:40:19.794427+0000","mapping_epoch":17,"log_start":"91'13021","ondisk_log_start":"91'13021","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":0,"log_size":10056,"log_dups_size":0,"ondisk_log_size":10056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T00:15:23.483421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000725513,"stat_sum":{"num_bytes":2932036880,"num_objects":4426,"num_object_clones":3878,"num_object_copies":8852,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4426,"num_whiteouts":0,"num_read":35836,"num_read_kb":29684996,"num_write":18753,"num_write_kb":2857790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"164'21396","reported_seq":53998,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-24T21:40:19.856760+0000","last_change":"2024-08-24T21:10:56.750634+0000","last_active":"2024-08-24T21:40:19.856760+0000","last_peered":"2024-08-24T21:40:19.856760+0000","last_clean":"2024-08-24T21:40:19.856760+0000","last_became_active":"2024-08-24T21:10:54.740821+0000","last_became_peered":"2024-08-24T21:10:54.740821+0000","last_unstale":"2024-08-24T21:40:19.856760+0000","last_undegraded":"2024-08-24T21:40:19.856760+0000","last_fullsized":"2024-08-24T21:40:19.856760+0000","mapping_epoch":17,"log_start":"78'11320","ondisk_log_start":"78'11320","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":0,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T03:48:00.497375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096400900000000005,"stat_sum":{"num_bytes":2659980271,"num_objects":4067,"num_object_clones":3542,"num_object_copies":8134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4067,"num_whiteouts":0,"num_read":36071,"num_read_kb":27990304,"num_write":17504,"num_write_kb":2596261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"165'29475","reported_seq":75915,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-24T21:40:19.876023+0000","last_change":"2024-08-24T21:10:57.267485+0000","last_active":"2024-08-24T21:40:19.876023+0000","last_peered":"2024-08-24T21:40:19.876023+0000","last_clean":"2024-08-24T21:40:19.876023+0000","last_became_active":"2024-08-24T21:10:54.739867+0000","last_became_peered":"2024-08-24T21:10:54.739867+0000","last_unstale":"2024-08-24T21:40:19.876023+0000","last_undegraded":"2024-08-24T21:40:19.876023+0000","last_fullsized":"2024-08-24T21:40:19.876023+0000","mapping_epoch":17,"log_start":"92'19428","ondisk_log_start":"92'19428","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":0,"log_size":10047,"log_dups_size":0,"ondisk_log_size":10047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T08:42:14.599997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032487299999999999,"stat_sum":{"num_bytes":3343910484,"num_objects":4629,"num_object_clones":4068,"num_object_copies":9258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4629,"num_whiteouts":0,"num_read":174392,"num_read_kb":34621705,"num_write":23960,"num_write_kb":3248477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"164'22604","reported_seq":59105,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-24T21:40:19.793289+0000","last_change":"2024-08-24T21:10:56.908772+0000","last_active":"2024-08-24T21:40:19.793289+0000","last_peered":"2024-08-24T21:40:19.793289+0000","last_clean":"2024-08-24T21:40:19.793289+0000","last_became_active":"2024-08-24T21:10:54.739290+0000","last_became_peered":"2024-08-24T21:10:54.739290+0000","last_unstale":"2024-08-24T21:40:19.793289+0000","last_undegraded":"2024-08-24T21:40:19.793289+0000","last_fullsized":"2024-08-24T21:40:19.793289+0000","mapping_epoch":17,"log_start":"92'12530","ondisk_log_start":"92'12530","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":0,"log_size":10074,"log_dups_size":0,"ondisk_log_size":10074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T00:15:23.483421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041195799999999997,"stat_sum":{"num_bytes":3333325934,"num_objects":5308,"num_object_clones":4686,"num_object_copies":10616,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5308,"num_whiteouts":0,"num_read":40760,"num_read_kb":32068269,"num_write":17460,"num_write_kb":3254135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"164'20837","reported_seq":52816,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-24T21:40:19.793107+0000","last_change":"2024-08-24T21:10:56.750104+0000","last_active":"2024-08-24T21:40:19.793107+0000","last_peered":"2024-08-24T21:40:19.793107+0000","last_clean":"2024-08-24T21:40:19.793107+0000","last_became_active":"2024-08-24T21:10:54.741763+0000","last_became_peered":"2024-08-24T21:10:54.741763+0000","last_unstale":"2024-08-24T21:40:19.793107+0000","last_undegraded":"2024-08-24T21:40:19.793107+0000","last_fullsized":"2024-08-24T21:40:19.793107+0000","mapping_epoch":17,"log_start":"78'10813","ondisk_log_start":"78'10813","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":0,"log_size":10024,"log_dups_size":0,"ondisk_log_size":10024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-25T22:06:03.893682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044521900000000001,"stat_sum":{"num_bytes":2751292542,"num_objects":4326,"num_object_clones":3779,"num_object_copies":8652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4326,"num_whiteouts":0,"num_read":35476,"num_read_kb":27207000,"num_write":16688,"num_write_kb":2682112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":415,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-24T21:40:08.969043+0000","last_change":"2024-08-24T21:10:48.523941+0000","last_active":"2024-08-24T21:40:08.969043+0000","last_peered":"2024-08-24T21:40:08.969043+0000","last_clean":"2024-08-24T21:40:08.969043+0000","last_became_active":"2024-08-24T21:10:48.522968+0000","last_became_peered":"2024-08-24T21:10:48.522968+0000","last_unstale":"2024-08-24T21:40:08.969043+0000","last_undegraded":"2024-08-24T21:40:08.969043+0000","last_fullsized":"2024-08-24T21:40:08.969043+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:47.498247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:47.498247+0000","last_clean_scrub_stamp":"2024-08-24T21:10:47.498247+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T07:03:32.558304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":23859064259,"num_objects":36315,"num_object_clones":31842,"num_object_copies":72630,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36315,"num_whiteouts":0,"num_read":558356,"num_read_kb":241182599,"num_write":158182,"num_write_kb":23264935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":47629131776,"data_stored":64453999494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80444,"ondisk_log_size":80444,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575205,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9578200,"kb_used_data":9177860,"kb_used_omap":1,"kb_used_meta":400318,"kb_avail":84793640,"statfs":{"total":96636764160,"available":86828687360,"internally_reserved":0,"allocated":9398128640,"data_stored":12597758490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":409926091},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575206,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5878516,"kb_used_data":5685024,"kb_used_omap":1,"kb_used_meta":193470,"kb_avail":88493324,"statfs":{"total":96636764160,"available":90617163776,"internally_reserved":0,"allocated":5821464576,"data_stored":7669968994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":198113734},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575206,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5486276,"kb_used_data":5280304,"kb_used_omap":1,"kb_used_meta":205950,"kb_avail":88885564,"statfs":{"total":96636764160,"available":91018817536,"internally_reserved":0,"allocated":5407031296,"data_stored":7168891943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":210893253},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575207,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28968,"kb_used_data":1940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342872,"statfs":{"total":96636764160,"available":96607100928,"internally_reserved":0,"allocated":1986560,"data_stored":902074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575206,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3393688,"kb_used_data":3250120,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":90978152,"statfs":{"total":96636764160,"available":93161627648,"internally_reserved":0,"allocated":3328122880,"data_stored":4869306894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":146995655},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575207,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6188152,"kb_used_data":5932200,"kb_used_omap":1,"kb_used_meta":255934,"kb_avail":88183688,"statfs":{"total":96636764160,"available":90300096512,"internally_reserved":0,"allocated":6074572800,"data_stored":8657632908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":262076869},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575206,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11789264,"kb_used_data":11406908,"kb_used_omap":1,"kb_used_meta":382334,"kb_avail":82582576,"statfs":{"total":96636764160,"available":84564557824,"internally_reserved":0,"allocated":11680673792,"data_stored":15434675929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":391510469},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575206,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6087200,"kb_used_data":5795148,"kb_used_omap":1,"kb_used_meta":292030,"kb_avail":88284640,"statfs":{"total":96636764160,"available":90403471360,"internally_reserved":0,"allocated":5934231552,"data_stored":8063259590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":299039173},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5931651072,"data_stored":8061767148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11678687232,"data_stored":15433773855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6072586240,"data_stored":8656730834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3326136320,"data_stored":4868404820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5405044736,"data_stored":7167989869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5819478016,"data_stored":7669066920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9395548160,"data_stored":12596266048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-24T21:40:27.538 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-24T21:40:27.538 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-24T21:40:27.903 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-08-24T21:40:27.904 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-08-24T21:40:27.920 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":1048,"stamp":"2024-08-24T21:40:27.026773+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23859654627,"num_objects":36317,"num_object_clones":31842,"num_object_copies":72634,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36317,"num_whiteouts":0,"num_read":558422,"num_read_kb":241182654,"num_write":158283,"num_write_kb":23266563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80516,"ondisk_log_size":80516,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":48430264,"kb_used_data":46529504,"kb_used_omap":12,"kb_used_meta":1900595,"kb_avail":706544456,"statfs":{"total":773094113280,"available":723501522944,"internally_reserved":0,"allocated":47646212096,"data_stored":64462396822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1946209841},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5921,"num_read_kb":2333279,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002113"},"pg_stats":[{"pgid":"2.7","version":"165'23851","reported_seq":61060,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-24T21:40:19.793775+0000","last_change":"2024-08-24T21:10:56.934834+0000","last_active":"2024-08-24T21:40:19.793775+0000","last_peered":"2024-08-24T21:40:19.793775+0000","last_clean":"2024-08-24T21:40:19.793775+0000","last_became_active":"2024-08-24T21:10:54.740448+0000","last_became_peered":"2024-08-24T21:10:54.740448+0000","last_unstale":"2024-08-24T21:40:19.793775+0000","last_undegraded":"2024-08-24T21:40:19.793775+0000","last_fullsized":"2024-08-24T21:40:19.793775+0000","mapping_epoch":17,"log_start":"92'13824","ondisk_log_start":"92'13824","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":0,"log_size":10027,"log_dups_size":0,"ondisk_log_size":10027,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T01:28:15.280592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063699500000000001,"stat_sum":{"num_bytes":3058996982,"num_objects":4709,"num_object_clones":4119,"num_object_copies":9418,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4709,"num_whiteouts":0,"num_read":78231,"num_read_kb":31399812,"num_write":19230,"num_write_kb":2986515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"164'19794","reported_seq":51268,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-24T21:40:19.793814+0000","last_change":"2024-08-24T21:10:56.746217+0000","last_active":"2024-08-24T21:40:19.793814+0000","last_peered":"2024-08-24T21:40:19.793814+0000","last_clean":"2024-08-24T21:40:19.793814+0000","last_became_active":"2024-08-24T21:10:54.740255+0000","last_became_peered":"2024-08-24T21:10:54.740255+0000","last_unstale":"2024-08-24T21:40:19.793814+0000","last_undegraded":"2024-08-24T21:40:19.793814+0000","last_fullsized":"2024-08-24T21:40:19.793814+0000","mapping_epoch":17,"log_start":"78'9720","ondisk_log_start":"78'9720","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":0,"log_size":10074,"log_dups_size":0,"ondisk_log_size":10074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T04:55:03.692111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065658299999999997,"stat_sum":{"num_bytes":2766190002,"num_objects":4332,"num_object_clones":3794,"num_object_copies":8664,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4332,"num_whiteouts":0,"num_read":34855,"num_read_kb":27515762,"num_write":15521,"num_write_kb":2696713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"164'39397","reported_seq":72814,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-24T21:40:19.793998+0000","last_change":"2024-08-24T21:10:56.908791+0000","last_active":"2024-08-24T21:40:19.793998+0000","last_peered":"2024-08-24T21:40:19.793998+0000","last_clean":"2024-08-24T21:40:19.793998+0000","last_became_active":"2024-08-24T21:10:55.004842+0000","last_became_peered":"2024-08-24T21:10:55.004842+0000","last_unstale":"2024-08-24T21:40:19.793998+0000","last_undegraded":"2024-08-24T21:40:19.793998+0000","last_fullsized":"2024-08-24T21:40:19.793998+0000","mapping_epoch":17,"log_start":"92'29331","ondisk_log_start":"92'29331","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":0,"log_size":10066,"log_dups_size":0,"ondisk_log_size":10066,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T04:55:03.692111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039021900000000003,"stat_sum":{"num_bytes":3013331164,"num_objects":4518,"num_object_clones":3976,"num_object_copies":9036,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4518,"num_whiteouts":0,"num_read":122735,"num_read_kb":30694751,"num_write":29066,"num_write_kb":2942932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"164'23077","reported_seq":55452,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-24T21:40:19.794427+0000","last_change":"2024-08-24T21:10:56.746203+0000","last_active":"2024-08-24T21:40:19.794427+0000","last_peered":"2024-08-24T21:40:19.794427+0000","last_clean":"2024-08-24T21:40:19.794427+0000","last_became_active":"2024-08-24T21:10:55.004437+0000","last_became_peered":"2024-08-24T21:10:55.004437+0000","last_unstale":"2024-08-24T21:40:19.794427+0000","last_undegraded":"2024-08-24T21:40:19.794427+0000","last_fullsized":"2024-08-24T21:40:19.794427+0000","mapping_epoch":17,"log_start":"91'13021","ondisk_log_start":"91'13021","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":0,"log_size":10056,"log_dups_size":0,"ondisk_log_size":10056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T00:15:23.483421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000725513,"stat_sum":{"num_bytes":2932036880,"num_objects":4426,"num_object_clones":3878,"num_object_copies":8852,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4426,"num_whiteouts":0,"num_read":35836,"num_read_kb":29684996,"num_write":18753,"num_write_kb":2857790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"164'21396","reported_seq":53998,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-24T21:40:19.856760+0000","last_change":"2024-08-24T21:10:56.750634+0000","last_active":"2024-08-24T21:40:19.856760+0000","last_peered":"2024-08-24T21:40:19.856760+0000","last_clean":"2024-08-24T21:40:19.856760+0000","last_became_active":"2024-08-24T21:10:54.740821+0000","last_became_peered":"2024-08-24T21:10:54.740821+0000","last_unstale":"2024-08-24T21:40:19.856760+0000","last_undegraded":"2024-08-24T21:40:19.856760+0000","last_fullsized":"2024-08-24T21:40:19.856760+0000","mapping_epoch":17,"log_start":"78'11320","ondisk_log_start":"78'11320","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":0,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T03:48:00.497375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096400900000000005,"stat_sum":{"num_bytes":2659980271,"num_objects":4067,"num_object_clones":3542,"num_object_copies":8134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4067,"num_whiteouts":0,"num_read":36071,"num_read_kb":27990304,"num_write":17504,"num_write_kb":2596261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"165'29475","reported_seq":75915,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-24T21:40:19.876023+0000","last_change":"2024-08-24T21:10:57.267485+0000","last_active":"2024-08-24T21:40:19.876023+0000","last_peered":"2024-08-24T21:40:19.876023+0000","last_clean":"2024-08-24T21:40:19.876023+0000","last_became_active":"2024-08-24T21:10:54.739867+0000","last_became_peered":"2024-08-24T21:10:54.739867+0000","last_unstale":"2024-08-24T21:40:19.876023+0000","last_undegraded":"2024-08-24T21:40:19.876023+0000","last_fullsized":"2024-08-24T21:40:19.876023+0000","mapping_epoch":17,"log_start":"92'19428","ondisk_log_start":"92'19428","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":0,"log_size":10047,"log_dups_size":0,"ondisk_log_size":10047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T08:42:14.599997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032487299999999999,"stat_sum":{"num_bytes":3343910484,"num_objects":4629,"num_object_clones":4068,"num_object_copies":9258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4629,"num_whiteouts":0,"num_read":174392,"num_read_kb":34621705,"num_write":23960,"num_write_kb":3248477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"164'22604","reported_seq":59105,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-24T21:40:19.793289+0000","last_change":"2024-08-24T21:10:56.908772+0000","last_active":"2024-08-24T21:40:19.793289+0000","last_peered":"2024-08-24T21:40:19.793289+0000","last_clean":"2024-08-24T21:40:19.793289+0000","last_became_active":"2024-08-24T21:10:54.739290+0000","last_became_peered":"2024-08-24T21:10:54.739290+0000","last_unstale":"2024-08-24T21:40:19.793289+0000","last_undegraded":"2024-08-24T21:40:19.793289+0000","last_fullsized":"2024-08-24T21:40:19.793289+0000","mapping_epoch":17,"log_start":"92'12530","ondisk_log_start":"92'12530","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":0,"log_size":10074,"log_dups_size":0,"ondisk_log_size":10074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T00:15:23.483421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041195799999999997,"stat_sum":{"num_bytes":3333325934,"num_objects":5308,"num_object_clones":4686,"num_object_copies":10616,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5308,"num_whiteouts":0,"num_read":40760,"num_read_kb":32068269,"num_write":17460,"num_write_kb":3254135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"164'20837","reported_seq":52816,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-24T21:40:19.793107+0000","last_change":"2024-08-24T21:10:56.750104+0000","last_active":"2024-08-24T21:40:19.793107+0000","last_peered":"2024-08-24T21:40:19.793107+0000","last_clean":"2024-08-24T21:40:19.793107+0000","last_became_active":"2024-08-24T21:10:54.741763+0000","last_became_peered":"2024-08-24T21:10:54.741763+0000","last_unstale":"2024-08-24T21:40:19.793107+0000","last_undegraded":"2024-08-24T21:40:19.793107+0000","last_fullsized":"2024-08-24T21:40:19.793107+0000","mapping_epoch":17,"log_start":"78'10813","ondisk_log_start":"78'10813","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":0,"log_size":10024,"log_dups_size":0,"ondisk_log_size":10024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-25T22:06:03.893682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044521900000000001,"stat_sum":{"num_bytes":2751292542,"num_objects":4326,"num_object_clones":3779,"num_object_copies":8652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4326,"num_whiteouts":0,"num_read":35476,"num_read_kb":27207000,"num_write":16688,"num_write_kb":2682112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":415,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-24T21:40:08.969043+0000","last_change":"2024-08-24T21:10:48.523941+0000","last_active":"2024-08-24T21:40:08.969043+0000","last_peered":"2024-08-24T21:40:08.969043+0000","last_clean":"2024-08-24T21:40:08.969043+0000","last_became_active":"2024-08-24T21:10:48.522968+0000","last_became_peered":"2024-08-24T21:10:48.522968+0000","last_unstale":"2024-08-24T21:40:08.969043+0000","last_undegraded":"2024-08-24T21:40:08.969043+0000","last_fullsized":"2024-08-24T21:40:08.969043+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:47.498247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:47.498247+0000","last_clean_scrub_stamp":"2024-08-24T21:10:47.498247+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T07:03:32.558304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":23859064259,"num_objects":36315,"num_object_clones":31842,"num_object_copies":72630,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36315,"num_whiteouts":0,"num_read":558356,"num_read_kb":241182599,"num_write":158182,"num_write_kb":23264935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":47629131776,"data_stored":64453999494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80444,"ondisk_log_size":80444,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575205,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9578200,"kb_used_data":9177860,"kb_used_omap":1,"kb_used_meta":400318,"kb_avail":84793640,"statfs":{"total":96636764160,"available":86828687360,"internally_reserved":0,"allocated":9398128640,"data_stored":12597758490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":409926091},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575206,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5878516,"kb_used_data":5685024,"kb_used_omap":1,"kb_used_meta":193470,"kb_avail":88493324,"statfs":{"total":96636764160,"available":90617163776,"internally_reserved":0,"allocated":5821464576,"data_stored":7669968994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":198113734},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575206,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5486276,"kb_used_data":5280304,"kb_used_omap":1,"kb_used_meta":205950,"kb_avail":88885564,"statfs":{"total":96636764160,"available":91018817536,"internally_reserved":0,"allocated":5407031296,"data_stored":7168891943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":210893253},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575207,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28968,"kb_used_data":1940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342872,"statfs":{"total":96636764160,"available":96607100928,"internally_reserved":0,"allocated":1986560,"data_stored":902074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575206,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3393688,"kb_used_data":3250120,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":90978152,"statfs":{"total":96636764160,"available":93161627648,"internally_reserved":0,"allocated":3328122880,"data_stored":4869306894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":146995655},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575207,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6188152,"kb_used_data":5932200,"kb_used_omap":1,"kb_used_meta":255934,"kb_avail":88183688,"statfs":{"total":96636764160,"available":90300096512,"internally_reserved":0,"allocated":6074572800,"data_stored":8657632908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":262076869},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575206,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11789264,"kb_used_data":11406908,"kb_used_omap":1,"kb_used_meta":382334,"kb_avail":82582576,"statfs":{"total":96636764160,"available":84564557824,"internally_reserved":0,"allocated":11680673792,"data_stored":15434675929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":391510469},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575206,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6087200,"kb_used_data":5795148,"kb_used_omap":1,"kb_used_meta":292030,"kb_avail":88284640,"statfs":{"total":96636764160,"available":90403471360,"internally_reserved":0,"allocated":5934231552,"data_stored":8063259590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":299039173},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5931651072,"data_stored":8061767148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11678687232,"data_stored":15433773855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6072586240,"data_stored":8656730834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3326136320,"data_stored":4868404820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5405044736,"data_stored":7167989869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5819478016,"data_stored":7669066920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9395548160,"data_stored":12596266048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-24T21:40:27.921 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-24T21:40:28.287 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-08-24T21:40:28.287 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":165,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","created":"2024-08-24T21:10:33.650756+0000","modified":"2024-08-24T21:40:08.964680+0000","last_up_change":"2024-08-24T21:10:46.496096+0000","last_in_change":"2024-08-24T21:10:36.528636+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-24T21:10:46.693216+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-08-24T21:10:53.031382+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":146,"snap_epoch":165,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"81276562-69e6-4a19-87ab-4278ccca38d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":4066438574},{"type":"v1","addr":"172.21.15.60:6825","nonce":4066438574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":4066438574},{"type":"v1","addr":"172.21.15.60:6827","nonce":4066438574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":4066438574},{"type":"v1","addr":"172.21.15.60:6831","nonce":4066438574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":4066438574},{"type":"v1","addr":"172.21.15.60:6829","nonce":4066438574}]},"public_addr":"172.21.15.60:6825/4066438574","cluster_addr":"172.21.15.60:6827/4066438574","heartbeat_back_addr":"172.21.15.60:6831/4066438574","heartbeat_front_addr":"172.21.15.60:6829/4066438574","state":["exists","up"]},{"osd":1,"uuid":"baa87752-ecc7-4bca-9bad-4b9c3e0d5ada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":584732176},{"type":"v1","addr":"172.21.15.60:6817","nonce":584732176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":584732176},{"type":"v1","addr":"172.21.15.60:6819","nonce":584732176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":584732176},{"type":"v1","addr":"172.21.15.60:6823","nonce":584732176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":584732176},{"type":"v1","addr":"172.21.15.60:6821","nonce":584732176}]},"public_addr":"172.21.15.60:6817/584732176","cluster_addr":"172.21.15.60:6819/584732176","heartbeat_back_addr":"172.21.15.60:6823/584732176","heartbeat_front_addr":"172.21.15.60:6821/584732176","state":["exists","up"]},{"osd":2,"uuid":"1a98131d-c3ba-41e3-8a85-82343060113c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":258042578},{"type":"v1","addr":"172.21.15.60:6809","nonce":258042578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":258042578},{"type":"v1","addr":"172.21.15.60:6811","nonce":258042578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":258042578},{"type":"v1","addr":"172.21.15.60:6815","nonce":258042578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":258042578},{"type":"v1","addr":"172.21.15.60:6813","nonce":258042578}]},"public_addr":"172.21.15.60:6809/258042578","cluster_addr":"172.21.15.60:6811/258042578","heartbeat_back_addr":"172.21.15.60:6815/258042578","heartbeat_front_addr":"172.21.15.60:6813/258042578","state":["exists","up"]},{"osd":3,"uuid":"51fff59f-3a70-43e0-984b-f312ae046631","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":3146668690},{"type":"v1","addr":"172.21.15.60:6801","nonce":3146668690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":3146668690},{"type":"v1","addr":"172.21.15.60:6803","nonce":3146668690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":3146668690},{"type":"v1","addr":"172.21.15.60:6807","nonce":3146668690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":3146668690},{"type":"v1","addr":"172.21.15.60:6805","nonce":3146668690}]},"public_addr":"172.21.15.60:6801/3146668690","cluster_addr":"172.21.15.60:6803/3146668690","heartbeat_back_addr":"172.21.15.60:6807/3146668690","heartbeat_front_addr":"172.21.15.60:6805/3146668690","state":["exists","up"]},{"osd":4,"uuid":"bcf54633-a99b-4e7c-8721-157871e97b4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2066252957},{"type":"v1","addr":"172.21.15.119:6801","nonce":2066252957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2066252957},{"type":"v1","addr":"172.21.15.119:6803","nonce":2066252957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2066252957},{"type":"v1","addr":"172.21.15.119:6807","nonce":2066252957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2066252957},{"type":"v1","addr":"172.21.15.119:6805","nonce":2066252957}]},"public_addr":"172.21.15.119:6801/2066252957","cluster_addr":"172.21.15.119:6803/2066252957","heartbeat_back_addr":"172.21.15.119:6807/2066252957","heartbeat_front_addr":"172.21.15.119:6805/2066252957","state":["exists","up"]},{"osd":5,"uuid":"40d4b6f4-afff-4c16-9210-5e1e2bc79d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2312604438},{"type":"v1","addr":"172.21.15.119:6809","nonce":2312604438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2312604438},{"type":"v1","addr":"172.21.15.119:6811","nonce":2312604438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2312604438},{"type":"v1","addr":"172.21.15.119:6815","nonce":2312604438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2312604438},{"type":"v1","addr":"172.21.15.119:6813","nonce":2312604438}]},"public_addr":"172.21.15.119:6809/2312604438","cluster_addr":"172.21.15.119:6811/2312604438","heartbeat_back_addr":"172.21.15.119:6815/2312604438","heartbeat_front_addr":"172.21.15.119:6813/2312604438","state":["exists","up"]},{"osd":6,"uuid":"a22db233-efee-485a-92f9-e1bc9fabb0b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2997150625},{"type":"v1","addr":"172.21.15.119:6817","nonce":2997150625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":2997150625},{"type":"v1","addr":"172.21.15.119:6819","nonce":2997150625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2997150625},{"type":"v1","addr":"172.21.15.119:6823","nonce":2997150625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2997150625},{"type":"v1","addr":"172.21.15.119:6821","nonce":2997150625}]},"public_addr":"172.21.15.119:6817/2997150625","cluster_addr":"172.21.15.119:6819/2997150625","heartbeat_back_addr":"172.21.15.119:6823/2997150625","heartbeat_front_addr":"172.21.15.119:6821/2997150625","state":["exists","up"]},{"osd":7,"uuid":"04c4911c-349f-40c6-9537-bddfb4401f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2893412933},{"type":"v1","addr":"172.21.15.119:6825","nonce":2893412933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2893412933},{"type":"v1","addr":"172.21.15.119:6827","nonce":2893412933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2893412933},{"type":"v1","addr":"172.21.15.119:6831","nonce":2893412933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2893412933},{"type":"v1","addr":"172.21.15.119:6829","nonce":2893412933}]},"public_addr":"172.21.15.119:6825/2893412933","cluster_addr":"172.21.15.119:6827/2893412933","heartbeat_back_addr":"172.21.15.119:6831/2893412933","heartbeat_front_addr":"172.21.15.119:6829/2893412933","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-24T21:10:43.531698+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-24T21:10:42.914156+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-24T21:10:43.356140+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-24T21:10:42.832390+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-24T21:10:42.981659+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-24T21:10:43.310045+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-24T21:10:42.930814+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-24T21:10:43.611225+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-24T21:40:29.306 INFO:tasks.ceph:Scrubbing osd.0 2024-08-24T21:40:29.307 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-08-24T21:40:29.326 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:40:29.508 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:40:29.508 INFO:teuthology.orchestra.run.smithi060.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-24T21:40:29.508 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:40:29.523 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-08-24T21:40:29.801 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":258,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":8,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:40:29.896 INFO:teuthology.orchestra.run.smithi060.stderr:instructed osd(s) 0 to deep-scrub 2024-08-24T21:40:29.914 INFO:tasks.ceph:Scrubbing osd.1 2024-08-24T21:40:29.914 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-08-24T21:40:30.100 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:40:30.100 INFO:teuthology.orchestra.run.smithi060.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-24T21:40:30.100 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:40:30.115 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-08-24T21:40:30.481 INFO:teuthology.orchestra.run.smithi060.stderr:instructed osd(s) 1 to deep-scrub 2024-08-24T21:40:30.499 INFO:tasks.ceph:Scrubbing osd.2 2024-08-24T21:40:30.499 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-08-24T21:40:30.687 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:40:30.688 INFO:teuthology.orchestra.run.smithi060.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-24T21:40:30.688 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:40:30.702 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-08-24T21:40:31.070 INFO:teuthology.orchestra.run.smithi060.stderr:instructed osd(s) 2 to deep-scrub 2024-08-24T21:40:31.088 INFO:tasks.ceph:Scrubbing osd.3 2024-08-24T21:40:31.088 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-08-24T21:40:31.302 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:40:31.303 INFO:teuthology.orchestra.run.smithi060.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-24T21:40:31.303 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:40:31.320 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-08-24T21:40:31.810 INFO:teuthology.orchestra.run.smithi060.stderr:instructed osd(s) 3 to deep-scrub 2024-08-24T21:40:31.834 INFO:tasks.ceph:Scrubbing osd.4 2024-08-24T21:40:31.834 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-08-24T21:40:32.114 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:40:32.115 INFO:teuthology.orchestra.run.smithi060.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-24T21:40:32.115 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:40:32.141 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-08-24T21:40:32.780 INFO:teuthology.orchestra.run.smithi060.stderr:instructed osd(s) 4 to deep-scrub 2024-08-24T21:40:32.811 INFO:tasks.ceph:Scrubbing osd.5 2024-08-24T21:40:32.811 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-08-24T21:40:32.820 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:40:33.137 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:40:33.138 INFO:teuthology.orchestra.run.smithi060.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-24T21:40:33.138 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:40:33.166 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-08-24T21:40:33.695 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":258,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:40:33.805 INFO:teuthology.orchestra.run.smithi060.stderr:instructed osd(s) 5 to deep-scrub 2024-08-24T21:40:33.834 INFO:tasks.ceph:Scrubbing osd.6 2024-08-24T21:40:33.834 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-08-24T21:40:34.154 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:40:34.154 INFO:teuthology.orchestra.run.smithi060.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-24T21:40:34.155 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:40:34.178 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-08-24T21:40:34.801 INFO:teuthology.orchestra.run.smithi060.stderr:instructed osd(s) 6 to deep-scrub 2024-08-24T21:40:34.828 INFO:tasks.ceph:Scrubbing osd.7 2024-08-24T21:40:34.829 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-08-24T21:40:35.158 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:40:35.158 INFO:teuthology.orchestra.run.smithi060.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-24T21:40:35.158 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:40:35.187 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-08-24T21:40:35.869 INFO:teuthology.orchestra.run.smithi060.stderr:instructed osd(s) 7 to deep-scrub 2024-08-24T21:40:35.904 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-24T21:40:36.727 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:40:41.268 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-08-24T21:40:41.269 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-08-24T21:40:41.308 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":1055,"stamp":"2024-08-24T21:40:41.029948+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23859654627,"num_objects":36317,"num_object_clones":31842,"num_object_copies":72634,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36317,"num_whiteouts":0,"num_read":558422,"num_read_kb":241182654,"num_write":158283,"num_write_kb":23266563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80546,"ondisk_log_size":80546,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":48431588,"kb_used_data":46529504,"kb_used_omap":12,"kb_used_meta":1901939,"kb_avail":706543132,"statfs":{"total":773094113280,"available":723500167168,"internally_reserved":0,"allocated":47646212096,"data_stored":64462396822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1947586097},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,2,0,6,4,10,8,5],"upper_bound":256},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002822"},"pg_stats":[{"pgid":"2.7","version":"165'24085","reported_seq":61286,"reported_epoch":165,"state":"active+clean+scrubbing+deep","last_fresh":"2024-08-24T21:40:36.960166+0000","last_change":"2024-08-24T21:40:35.186924+0000","last_active":"2024-08-24T21:40:36.960166+0000","last_peered":"2024-08-24T21:40:36.960166+0000","last_clean":"2024-08-24T21:40:36.960166+0000","last_became_active":"2024-08-24T21:10:54.740448+0000","last_became_peered":"2024-08-24T21:10:54.740448+0000","last_unstale":"2024-08-24T21:40:36.960166+0000","last_undegraded":"2024-08-24T21:40:36.960166+0000","last_fullsized":"2024-08-24T21:40:36.960166+0000","mapping_epoch":17,"log_start":"92'14024","ondisk_log_start":"92'14024","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":249,"log_size":10061,"log_dups_size":0,"ondisk_log_size":10061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 1s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063699500000000001,"stat_sum":{"num_bytes":3058996982,"num_objects":4709,"num_object_clones":4119,"num_object_copies":9418,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4709,"num_whiteouts":0,"num_read":78231,"num_read_kb":31399812,"num_write":19230,"num_write_kb":2986515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"165'20646","reported_seq":52161,"reported_epoch":165,"state":"active+clean+scrubbing+deep","last_fresh":"2024-08-24T21:40:39.369157+0000","last_change":"2024-08-24T21:40:32.089330+0000","last_active":"2024-08-24T21:40:39.369157+0000","last_peered":"2024-08-24T21:40:39.369157+0000","last_clean":"2024-08-24T21:40:39.369157+0000","last_became_active":"2024-08-24T21:10:54.740255+0000","last_became_peered":"2024-08-24T21:10:54.740255+0000","last_unstale":"2024-08-24T21:40:39.369157+0000","last_undegraded":"2024-08-24T21:40:39.369157+0000","last_fullsized":"2024-08-24T21:40:39.369157+0000","mapping_epoch":17,"log_start":"91'10620","ondisk_log_start":"91'10620","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":896,"log_size":10026,"log_dups_size":0,"ondisk_log_size":10026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 7s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065658299999999997,"stat_sum":{"num_bytes":2766190002,"num_objects":4332,"num_object_clones":3794,"num_object_copies":8664,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4332,"num_whiteouts":0,"num_read":34855,"num_read_kb":27515762,"num_write":15521,"num_write_kb":2696713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"165'39471","reported_seq":72871,"reported_epoch":165,"state":"active+clean+scrubbing+deep","last_fresh":"2024-08-24T21:40:38.501204+0000","last_change":"2024-08-24T21:40:37.963520+0000","last_active":"2024-08-24T21:40:38.501204+0000","last_peered":"2024-08-24T21:40:38.501204+0000","last_clean":"2024-08-24T21:40:38.501204+0000","last_became_active":"2024-08-24T21:10:55.004842+0000","last_became_peered":"2024-08-24T21:10:55.004842+0000","last_unstale":"2024-08-24T21:40:38.501204+0000","last_undegraded":"2024-08-24T21:40:38.501204+0000","last_fullsized":"2024-08-24T21:40:38.501204+0000","mapping_epoch":17,"log_start":"92'29431","ondisk_log_start":"92'29431","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":74,"log_size":10040,"log_dups_size":0,"ondisk_log_size":10040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 0s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039021900000000003,"stat_sum":{"num_bytes":3013331164,"num_objects":4518,"num_object_clones":3976,"num_object_copies":9036,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4518,"num_whiteouts":0,"num_read":122735,"num_read_kb":30694751,"num_write":29066,"num_write_kb":2942932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"165'24071","reported_seq":56494,"reported_epoch":165,"state":"active+clean+scrubbing+deep","last_fresh":"2024-08-24T21:40:39.159040+0000","last_change":"2024-08-24T21:40:31.085828+0000","last_active":"2024-08-24T21:40:39.159040+0000","last_peered":"2024-08-24T21:40:39.159040+0000","last_clean":"2024-08-24T21:40:39.159040+0000","last_became_active":"2024-08-24T21:10:55.004437+0000","last_became_peered":"2024-08-24T21:10:55.004437+0000","last_unstale":"2024-08-24T21:40:39.159040+0000","last_undegraded":"2024-08-24T21:40:39.159040+0000","last_fullsized":"2024-08-24T21:40:39.159040+0000","mapping_epoch":17,"log_start":"92'14021","ondisk_log_start":"92'14021","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":1067,"log_size":10050,"log_dups_size":0,"ondisk_log_size":10050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 8s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000725513,"stat_sum":{"num_bytes":2932036880,"num_objects":4426,"num_object_clones":3878,"num_object_copies":8852,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4426,"num_whiteouts":0,"num_read":35836,"num_read_kb":29684996,"num_write":18753,"num_write_kb":2857790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"165'21789","reported_seq":54402,"reported_epoch":165,"state":"active+clean+scrubbing+deep","last_fresh":"2024-08-24T21:40:37.417700+0000","last_change":"2024-08-24T21:40:33.956233+0000","last_active":"2024-08-24T21:40:37.417700+0000","last_peered":"2024-08-24T21:40:37.417700+0000","last_clean":"2024-08-24T21:40:37.417700+0000","last_became_active":"2024-08-24T21:10:54.740821+0000","last_became_peered":"2024-08-24T21:10:54.740821+0000","last_unstale":"2024-08-24T21:40:37.417700+0000","last_undegraded":"2024-08-24T21:40:37.417700+0000","last_fullsized":"2024-08-24T21:40:37.417700+0000","mapping_epoch":17,"log_start":"91'11720","ondisk_log_start":"91'11720","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":419,"log_size":10069,"log_dups_size":0,"ondisk_log_size":10069,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 3s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096400900000000005,"stat_sum":{"num_bytes":2659980271,"num_objects":4067,"num_object_clones":3542,"num_object_copies":8134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4067,"num_whiteouts":0,"num_read":36071,"num_read_kb":27990304,"num_write":17504,"num_write_kb":2596261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"165'30225","reported_seq":76702,"reported_epoch":165,"state":"active+clean+scrubbing+deep","last_fresh":"2024-08-24T21:40:37.834242+0000","last_change":"2024-08-24T21:40:31.707767+0000","last_active":"2024-08-24T21:40:37.834242+0000","last_peered":"2024-08-24T21:40:37.834242+0000","last_clean":"2024-08-24T21:40:37.834242+0000","last_became_active":"2024-08-24T21:10:54.739867+0000","last_became_peered":"2024-08-24T21:10:54.739867+0000","last_unstale":"2024-08-24T21:40:37.834242+0000","last_undegraded":"2024-08-24T21:40:37.834242+0000","last_fullsized":"2024-08-24T21:40:37.834242+0000","mapping_epoch":17,"log_start":"92'20128","ondisk_log_start":"92'20128","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":796,"log_size":10097,"log_dups_size":0,"ondisk_log_size":10097,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 6s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032487299999999999,"stat_sum":{"num_bytes":3343910484,"num_objects":4629,"num_object_clones":4068,"num_object_copies":9258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4629,"num_whiteouts":0,"num_read":174392,"num_read_kb":34621705,"num_write":23960,"num_write_kb":3248477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"165'22777","reported_seq":59265,"reported_epoch":165,"state":"active+clean+scrubbing+deep","last_fresh":"2024-08-24T21:40:38.423888+0000","last_change":"2024-08-24T21:40:36.974002+0000","last_active":"2024-08-24T21:40:38.423888+0000","last_peered":"2024-08-24T21:40:38.423888+0000","last_clean":"2024-08-24T21:40:38.423888+0000","last_became_active":"2024-08-24T21:10:54.739290+0000","last_became_peered":"2024-08-24T21:10:54.739290+0000","last_unstale":"2024-08-24T21:40:38.423888+0000","last_undegraded":"2024-08-24T21:40:38.423888+0000","last_fullsized":"2024-08-24T21:40:38.423888+0000","mapping_epoch":17,"log_start":"92'12730","ondisk_log_start":"92'12730","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":173,"log_size":10047,"log_dups_size":0,"ondisk_log_size":10047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 1s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041195799999999997,"stat_sum":{"num_bytes":3333325934,"num_objects":5308,"num_object_clones":4686,"num_object_copies":10616,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5308,"num_whiteouts":0,"num_read":40760,"num_read_kb":32068269,"num_write":17460,"num_write_kb":3254135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"165'21095","reported_seq":53090,"reported_epoch":165,"state":"active+clean+scrubbing+deep","last_fresh":"2024-08-24T21:40:37.292567+0000","last_change":"2024-08-24T21:40:34.913857+0000","last_active":"2024-08-24T21:40:37.292567+0000","last_peered":"2024-08-24T21:40:37.292567+0000","last_clean":"2024-08-24T21:40:37.292567+0000","last_became_active":"2024-08-24T21:10:54.741763+0000","last_became_peered":"2024-08-24T21:10:54.741763+0000","last_unstale":"2024-08-24T21:40:37.292567+0000","last_undegraded":"2024-08-24T21:40:37.292567+0000","last_fullsized":"2024-08-24T21:40:37.292567+0000","mapping_epoch":17,"log_start":"78'11013","ondisk_log_start":"78'11013","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":271,"log_size":10082,"log_dups_size":0,"ondisk_log_size":10082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 2s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044521900000000001,"stat_sum":{"num_bytes":2751292542,"num_objects":4326,"num_object_clones":3779,"num_object_copies":8652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4326,"num_whiteouts":0,"num_read":35476,"num_read_kb":27207000,"num_write":16688,"num_write_kb":2682112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"165'74","reported_seq":426,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-24T21:40:35.965160+0000","last_change":"2024-08-24T21:40:35.965204+0000","last_active":"2024-08-24T21:40:35.965160+0000","last_peered":"2024-08-24T21:40:35.965160+0000","last_clean":"2024-08-24T21:40:35.965160+0000","last_became_active":"2024-08-24T21:10:48.522968+0000","last_became_peered":"2024-08-24T21:10:48.522968+0000","last_unstale":"2024-08-24T21:40:35.965160+0000","last_undegraded":"2024-08-24T21:40:35.965160+0000","last_fullsized":"2024-08-24T21:40:35.965160+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"165'74","last_scrub_stamp":"2024-08-24T21:40:35.965081+0000","last_deep_scrub":"165'74","last_deep_scrub_stamp":"2024-08-24T21:40:35.965081+0000","last_clean_scrub_stamp":"2024-08-24T21:40:35.965081+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T05:46:33.359006+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":23859064259,"num_objects":36315,"num_object_clones":31842,"num_object_copies":72630,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36315,"num_whiteouts":0,"num_read":558356,"num_read_kb":241182599,"num_write":158182,"num_write_kb":23264935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":47629131776,"data_stored":64453999494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80472,"ondisk_log_size":80472,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575208,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9578196,"kb_used_data":9177860,"kb_used_omap":1,"kb_used_meta":400318,"kb_avail":84793644,"statfs":{"total":96636764160,"available":86828691456,"internally_reserved":0,"allocated":9398128640,"data_stored":12597758490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":409926091},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575208,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5878512,"kb_used_data":5685024,"kb_used_omap":1,"kb_used_meta":193470,"kb_avail":88493328,"statfs":{"total":96636764160,"available":90617167872,"internally_reserved":0,"allocated":5821464576,"data_stored":7669968994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":198113734},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575209,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5469632,"kb_used_data":5280304,"kb_used_omap":1,"kb_used_meta":189310,"kb_avail":88902208,"statfs":{"total":96636764160,"available":91035860992,"internally_reserved":0,"allocated":5407031296,"data_stored":7168891943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":193853893},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,0,0,5,0,5,4,4],"upper_bound":256},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575209,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28968,"kb_used_data":1940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342872,"statfs":{"total":96636764160,"available":96607100928,"internally_reserved":0,"allocated":1986560,"data_stored":902074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575208,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3393688,"kb_used_data":3250120,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":90978152,"statfs":{"total":96636764160,"available":93161627648,"internally_reserved":0,"allocated":3328122880,"data_stored":4869306894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":146995655},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575210,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6196408,"kb_used_data":5932200,"kb_used_omap":1,"kb_used_meta":264190,"kb_avail":88175432,"statfs":{"total":96636764160,"available":90291642368,"internally_reserved":0,"allocated":6074572800,"data_stored":8657632908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":270531013},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575209,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11798988,"kb_used_data":11406908,"kb_used_omap":1,"kb_used_meta":392062,"kb_avail":82572852,"statfs":{"total":96636764160,"available":84554600448,"internally_reserved":0,"allocated":11680673792,"data_stored":15434675929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":401471941},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,0,1,3,3,4,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575209,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6087196,"kb_used_data":5795148,"kb_used_omap":1,"kb_used_meta":292030,"kb_avail":88284644,"statfs":{"total":96636764160,"available":90403475456,"internally_reserved":0,"allocated":5934231552,"data_stored":8063259590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":299039173},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5931651072,"data_stored":8061767148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11678687232,"data_stored":15433773855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6072586240,"data_stored":8656730834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3326136320,"data_stored":4868404820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5405044736,"data_stored":7167989869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5819478016,"data_stored":7669066920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9395548160,"data_stored":12596266048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-24T21:40:41.312 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-08-24T21:10:53.718293+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=24, tm_hour=21, tm_min=10, tm_sec=53, tm_wday=5, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=24, tm_hour=21, tm_min=40, tm_sec=28, tm_wday=5, tm_yday=237, tm_isdst=0) 2024-08-24T21:40:41.313 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-08-24T21:10:53.718293+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=24, tm_hour=21, tm_min=10, tm_sec=53, tm_wday=5, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=24, tm_hour=21, tm_min=40, tm_sec=28, tm_wday=5, tm_yday=237, tm_isdst=0) 2024-08-24T21:40:41.313 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-08-24T21:10:53.718293+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=24, tm_hour=21, tm_min=10, tm_sec=53, tm_wday=5, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=24, tm_hour=21, tm_min=40, tm_sec=28, tm_wday=5, tm_yday=237, tm_isdst=0) 2024-08-24T21:40:41.313 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-08-24T21:10:53.718293+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=24, tm_hour=21, tm_min=10, tm_sec=53, tm_wday=5, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=24, tm_hour=21, tm_min=40, tm_sec=28, tm_wday=5, tm_yday=237, tm_isdst=0) 2024-08-24T21:40:41.313 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-08-24T21:10:53.718293+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=24, tm_hour=21, tm_min=10, tm_sec=53, tm_wday=5, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=24, tm_hour=21, tm_min=40, tm_sec=28, tm_wday=5, tm_yday=237, tm_isdst=0) 2024-08-24T21:40:41.313 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-08-24T21:10:53.718293+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=24, tm_hour=21, tm_min=10, tm_sec=53, tm_wday=5, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=24, tm_hour=21, tm_min=40, tm_sec=28, tm_wday=5, tm_yday=237, tm_isdst=0) 2024-08-24T21:40:41.313 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-08-24T21:10:53.718293+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=24, tm_hour=21, tm_min=10, tm_sec=53, tm_wday=5, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=24, tm_hour=21, tm_min=40, tm_sec=28, tm_wday=5, tm_yday=237, tm_isdst=0) 2024-08-24T21:40:41.313 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-08-24T21:10:53.718293+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=24, tm_hour=21, tm_min=10, tm_sec=53, tm_wday=5, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=24, tm_hour=21, tm_min=40, tm_sec=28, tm_wday=5, tm_yday=237, tm_isdst=0) 2024-08-24T21:40:41.313 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-08-24T21:40:41.418 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":262,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:40:41.457 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-08-24T21:40:41.457 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-08-24T21:40:41.458 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:40:41.776 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:40:41.777 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:40:41.777 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:40:41.777 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:40:41.777 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 262, 2024-08-24T21:40:41.777 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 26308, 2024-08-24T21:40:41.777 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:40:41.777 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:40:41.777 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:40:41.777 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:40:41.777 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-08-24T21:40:41.777 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:40:41.778 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:40:41.778 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:40:41.778 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:40:41.778 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:40:41.778 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:40:41.778 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:40:41.778 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:40:41.778 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:40:41.778 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:40:41.778 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:40:41.778 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:40:41.778 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:40:41.779 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:40:41.779 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:40:41.779 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:40:41.779 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:40:41.779 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:40:41.779 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:40:41.779 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:40:41.779 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:40:41.779 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:40:41.779 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:40:41.779 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:40:41.779 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:40:41.780 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:40:41.780 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:40:41.780 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:40:41.780 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:40:41.780 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:41.780 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:40:41.780 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:40:41.780 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:40:41.780 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:40:41.780 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:40:41.780 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:40:41.780 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:40:41.780 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:40:41.781 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:40:41.781 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:40:41.781 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:40:41.781 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:40:41.781 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:40:41.781 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:40:41.781 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:40:41.781 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:40:41.781 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:40:41.781 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:40:41.781 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:40:41.781 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:40:41.781 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:40:41.782 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:40:41.782 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:40:41.782 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:40:41.782 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:40:41.782 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:40:41.782 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:40:41.782 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:40:41.782 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:40:41.783 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:40:41.783 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:41.783 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:40:41.783 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:41.783 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:40:41.783 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:40:41.783 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:40:41.783 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:40:41.783 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:41.783 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:40:41.783 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:40:41.783 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:40:41.783 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:41.784 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:41.784 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:40:41.784 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:40:41.784 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:40:41.784 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:40:41.784 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:40:41.784 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:41.784 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:40:41.784 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:40:41.784 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:40:41.784 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:40:41.784 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:40:41.784 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:41.785 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:41.785 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:40:41.785 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:40:41.785 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:40:41.785 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:40:41.785 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:41.785 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:40:41.785 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:40:41.785 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:40:41.785 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:41.785 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:41.785 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:40:41.786 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:40:41.786 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:40:41.786 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:40:41.786 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:40:41.786 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:41.786 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:40:41.786 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:40:41.786 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:40:41.786 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:40:41.786 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:40:41.786 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:41.786 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:41.786 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:40:41.787 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:40:41.787 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:40:41.787 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:40:41.787 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:41.787 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:40:41.787 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:40:41.787 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:40:41.787 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:41.787 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:41.787 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:40:41.787 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:40:41.787 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:40:41.788 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:40:41.788 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:40:41.788 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:41.788 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:40:41.788 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:40:41.788 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:40:41.788 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:40:41.788 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:40:41.788 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:40:41.788 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:40:41.788 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:41.788 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:40:41.788 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:40:41.789 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:41.789 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:40:41.789 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:40:41.789 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:40:41.789 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:40:41.789 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:40:41.789 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:40:41.789 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:41.789 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:40:41.789 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:40:41.789 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-08-24T21:40:41.789 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:40:41.789 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:40:41.790 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:40:41.790 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:41.790 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:40:41.790 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:40:41.790 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:40:41.790 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:40:41.790 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:40:41.790 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:40:41.790 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:41.790 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:40:41.790 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:40:41.790 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:40:41.790 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:40:41.791 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:40:41.791 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:41.791 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:40:41.791 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:40:41.810 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:40:41.810 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-08-24T21:40:41.811 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:40:42.138 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:40:42.138 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:40:42.139 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:40:42.139 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:40:42.139 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 262, 2024-08-24T21:40:42.139 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 91301, 2024-08-24T21:40:42.139 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:40:42.139 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:40:42.139 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:40:42.139 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:40:42.139 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 1, 2024-08-24T21:40:42.139 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:40:42.139 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:40:42.139 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:40:42.140 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:40:42.140 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:40:42.140 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:40:42.140 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:40:42.140 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:40:42.140 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:40:42.140 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:40:42.140 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:40:42.140 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:40:42.140 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:40:42.140 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:40:42.140 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:40:42.140 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:40:42.141 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:40:42.141 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:40:42.141 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:40:42.141 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:40:42.141 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:40:42.141 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:40:42.141 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:40:42.141 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:40:42.141 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:40:42.141 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:40:42.141 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:40:42.141 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:40:42.141 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:40:42.142 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:42.142 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:40:42.142 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:40:42.142 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:40:42.142 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:40:42.142 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:40:42.142 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:40:42.142 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:40:42.142 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:40:42.142 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:40:42.142 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:40:42.142 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:40:42.143 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:40:42.143 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:40:42.143 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:40:42.143 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:40:42.143 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:40:42.143 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:40:42.143 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:40:42.143 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:40:42.143 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:40:42.143 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:40:42.143 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:40:42.143 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:40:42.143 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:40:42.144 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:40:42.144 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:40:42.144 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:40:42.144 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:40:42.144 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:40:42.144 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:40:42.144 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:42.144 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:40:42.144 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:42.144 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:40:42.144 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:40:42.144 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:40:42.145 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:40:42.145 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:42.145 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:40:42.145 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:40:42.145 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:40:42.145 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:42.145 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:42.145 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:40:42.145 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:40:42.146 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:40:42.146 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:40:42.146 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:40:42.146 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:42.146 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:40:42.146 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:40:42.146 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:40:42.146 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:40:42.146 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:40:42.147 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:42.147 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:42.147 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:40:42.147 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:40:42.147 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:40:42.147 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:40:42.147 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:42.147 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:40:42.147 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:40:42.147 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:40:42.147 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:42.147 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:42.147 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:40:42.148 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:40:42.148 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:40:42.148 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:40:42.148 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:40:42.148 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:42.148 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:40:42.148 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:40:42.148 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:40:42.148 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:40:42.148 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:40:42.148 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:42.148 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:42.148 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:40:42.149 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:40:42.149 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:40:42.149 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:40:42.149 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:42.149 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:40:42.149 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:40:42.149 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:40:42.149 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:42.149 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:42.149 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:40:42.149 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:40:42.150 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:40:42.150 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:40:42.150 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:40:42.150 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:42.150 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:40:42.150 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:40:42.150 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:40:42.150 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:40:42.150 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:40:42.150 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:40:42.150 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:40:42.150 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:42.150 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:40:42.151 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:40:42.151 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:42.151 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:40:42.151 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:40:42.151 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:40:42.151 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:40:42.151 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:40:42.151 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:40:42.151 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:42.151 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:40:42.151 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:40:42.151 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 6 2024-08-24T21:40:42.151 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:40:42.152 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:40:42.152 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:40:42.152 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:42.152 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:40:42.152 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:40:42.152 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:40:42.152 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:40:42.152 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:40:42.152 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:40:42.152 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:40:42.152 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:40:42.152 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:40:42.152 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:40:42.152 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:40:42.153 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:40:42.153 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:40:42.153 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:40:42.153 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:40:42.169 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-08-24T21:40:42.169 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-08-24T21:41:01.314 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-24T21:41:02.019 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-08-24T21:41:02.021 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-08-24T21:41:02.053 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":1065,"stamp":"2024-08-24T21:41:01.033552+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23859654627,"num_objects":36317,"num_object_clones":31842,"num_object_copies":72634,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36317,"num_whiteouts":0,"num_read":558422,"num_read_kb":241182654,"num_write":158283,"num_write_kb":23266563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80507,"ondisk_log_size":80507,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":48542692,"kb_used_data":46529504,"kb_used_omap":12,"kb_used_meta":2013043,"kb_avail":706432028,"statfs":{"total":773094113280,"available":723386396672,"internally_reserved":0,"allocated":47646212096,"data_stored":64462396822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":2061356593},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,0,1,6,8,14,26,8,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002196"},"pg_stats":[{"pgid":"2.7","version":"165'26717","reported_seq":64048,"reported_epoch":165,"state":"active+clean+scrubbing+deep","last_fresh":"2024-08-24T21:40:57.266972+0000","last_change":"2024-08-24T21:40:35.186924+0000","last_active":"2024-08-24T21:40:57.266972+0000","last_peered":"2024-08-24T21:40:57.266972+0000","last_clean":"2024-08-24T21:40:57.266972+0000","last_became_active":"2024-08-24T21:10:54.740448+0000","last_became_peered":"2024-08-24T21:10:54.740448+0000","last_unstale":"2024-08-24T21:40:57.266972+0000","last_undegraded":"2024-08-24T21:40:57.266972+0000","last_fullsized":"2024-08-24T21:40:57.266972+0000","mapping_epoch":17,"log_start":"112'16624","ondisk_log_start":"112'16624","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":2886,"log_size":10093,"log_dups_size":0,"ondisk_log_size":10093,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 22s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063699500000000001,"stat_sum":{"num_bytes":3058996982,"num_objects":4709,"num_object_clones":4119,"num_object_copies":9418,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4709,"num_whiteouts":0,"num_read":78231,"num_read_kb":31399812,"num_write":19230,"num_write_kb":2986515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"165'22616","reported_seq":54211,"reported_epoch":165,"state":"active+clean+scrubbing+deep","last_fresh":"2024-08-24T21:41:00.253521+0000","last_change":"2024-08-24T21:40:32.089330+0000","last_active":"2024-08-24T21:41:00.253521+0000","last_peered":"2024-08-24T21:41:00.253521+0000","last_clean":"2024-08-24T21:41:00.253521+0000","last_became_active":"2024-08-24T21:10:54.740255+0000","last_became_peered":"2024-08-24T21:10:54.740255+0000","last_unstale":"2024-08-24T21:41:00.253521+0000","last_undegraded":"2024-08-24T21:41:00.253521+0000","last_fullsized":"2024-08-24T21:41:00.253521+0000","mapping_epoch":17,"log_start":"107'12520","ondisk_log_start":"107'12520","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":2866,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 28s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065658299999999997,"stat_sum":{"num_bytes":2766190002,"num_objects":4332,"num_object_clones":3794,"num_object_copies":8664,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4332,"num_whiteouts":0,"num_read":34855,"num_read_kb":27515762,"num_write":15521,"num_write_kb":2696713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"165'41787","reported_seq":75298,"reported_epoch":165,"state":"active+clean+scrubbing+deep","last_fresh":"2024-08-24T21:40:59.439547+0000","last_change":"2024-08-24T21:40:37.963520+0000","last_active":"2024-08-24T21:40:59.439547+0000","last_peered":"2024-08-24T21:40:59.439547+0000","last_clean":"2024-08-24T21:40:59.439547+0000","last_became_active":"2024-08-24T21:10:55.004842+0000","last_became_peered":"2024-08-24T21:10:55.004842+0000","last_unstale":"2024-08-24T21:40:59.439547+0000","last_undegraded":"2024-08-24T21:40:59.439547+0000","last_fullsized":"2024-08-24T21:40:59.439547+0000","mapping_epoch":17,"log_start":"101'31731","ondisk_log_start":"101'31731","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":2390,"log_size":10056,"log_dups_size":0,"ondisk_log_size":10056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 21s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039021900000000003,"stat_sum":{"num_bytes":3013331164,"num_objects":4518,"num_object_clones":3976,"num_object_copies":9036,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4518,"num_whiteouts":0,"num_read":122735,"num_read_kb":30694751,"num_write":29066,"num_write_kb":2942932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"165'26140","reported_seq":58646,"reported_epoch":165,"state":"active+clean+scrubbing+deep","last_fresh":"2024-08-24T21:41:00.243678+0000","last_change":"2024-08-24T21:40:31.085828+0000","last_active":"2024-08-24T21:41:00.243678+0000","last_peered":"2024-08-24T21:41:00.243678+0000","last_clean":"2024-08-24T21:41:00.243678+0000","last_became_active":"2024-08-24T21:10:55.004437+0000","last_became_peered":"2024-08-24T21:10:55.004437+0000","last_unstale":"2024-08-24T21:41:00.243678+0000","last_undegraded":"2024-08-24T21:41:00.243678+0000","last_fullsized":"2024-08-24T21:41:00.243678+0000","mapping_epoch":17,"log_start":"111'16121","ondisk_log_start":"111'16121","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":3111,"log_size":10019,"log_dups_size":0,"ondisk_log_size":10019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 29s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000725513,"stat_sum":{"num_bytes":2932036880,"num_objects":4426,"num_object_clones":3878,"num_object_copies":8852,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4426,"num_whiteouts":0,"num_read":35836,"num_read_kb":29684996,"num_write":18753,"num_write_kb":2857790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"165'23850","reported_seq":56543,"reported_epoch":165,"state":"active+clean+scrubbing+deep","last_fresh":"2024-08-24T21:40:57.611792+0000","last_change":"2024-08-24T21:40:33.956233+0000","last_active":"2024-08-24T21:40:57.611792+0000","last_peered":"2024-08-24T21:40:57.611792+0000","last_clean":"2024-08-24T21:40:57.611792+0000","last_became_active":"2024-08-24T21:10:54.740821+0000","last_became_peered":"2024-08-24T21:10:54.740821+0000","last_unstale":"2024-08-24T21:40:57.611792+0000","last_undegraded":"2024-08-24T21:40:57.611792+0000","last_fullsized":"2024-08-24T21:40:57.611792+0000","mapping_epoch":17,"log_start":"92'13820","ondisk_log_start":"92'13820","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":2482,"log_size":10030,"log_dups_size":0,"ondisk_log_size":10030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 23s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096400900000000005,"stat_sum":{"num_bytes":2659980271,"num_objects":4067,"num_object_clones":3542,"num_object_copies":8134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4067,"num_whiteouts":0,"num_read":36071,"num_read_kb":27990304,"num_write":17504,"num_write_kb":2596261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"165'32365","reported_seq":78918,"reported_epoch":165,"state":"active+clean+scrubbing+deep","last_fresh":"2024-08-24T21:40:58.186030+0000","last_change":"2024-08-24T21:40:31.707767+0000","last_active":"2024-08-24T21:40:58.186030+0000","last_peered":"2024-08-24T21:40:58.186030+0000","last_clean":"2024-08-24T21:40:58.186030+0000","last_became_active":"2024-08-24T21:10:54.739867+0000","last_became_peered":"2024-08-24T21:10:54.739867+0000","last_unstale":"2024-08-24T21:40:58.186030+0000","last_undegraded":"2024-08-24T21:40:58.186030+0000","last_fullsized":"2024-08-24T21:40:58.186030+0000","mapping_epoch":17,"log_start":"110'22328","ondisk_log_start":"110'22328","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":2936,"log_size":10037,"log_dups_size":0,"ondisk_log_size":10037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 26s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032487299999999999,"stat_sum":{"num_bytes":3343910484,"num_objects":4629,"num_object_clones":4068,"num_object_copies":9258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4629,"num_whiteouts":0,"num_read":174392,"num_read_kb":34621705,"num_write":23960,"num_write_kb":3248477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"165'24891","reported_seq":61467,"reported_epoch":165,"state":"active+clean+scrubbing+deep","last_fresh":"2024-08-24T21:40:59.454694+0000","last_change":"2024-08-24T21:40:36.974002+0000","last_active":"2024-08-24T21:40:59.454694+0000","last_peered":"2024-08-24T21:40:59.454694+0000","last_clean":"2024-08-24T21:40:59.454694+0000","last_became_active":"2024-08-24T21:10:54.739290+0000","last_became_peered":"2024-08-24T21:10:54.739290+0000","last_unstale":"2024-08-24T21:40:59.454694+0000","last_undegraded":"2024-08-24T21:40:59.454694+0000","last_fullsized":"2024-08-24T21:40:59.454694+0000","mapping_epoch":17,"log_start":"112'14830","ondisk_log_start":"112'14830","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":2287,"log_size":10061,"log_dups_size":0,"ondisk_log_size":10061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 22s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041195799999999997,"stat_sum":{"num_bytes":3333325934,"num_objects":5308,"num_object_clones":4686,"num_object_copies":10616,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5308,"num_whiteouts":0,"num_read":40760,"num_read_kb":32068269,"num_write":17460,"num_write_kb":3254135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"165'23354","reported_seq":55441,"reported_epoch":165,"state":"active+clean+scrubbing+deep","last_fresh":"2024-08-24T21:40:57.582790+0000","last_change":"2024-08-24T21:40:34.913857+0000","last_active":"2024-08-24T21:40:57.582790+0000","last_peered":"2024-08-24T21:40:57.582790+0000","last_clean":"2024-08-24T21:40:57.582790+0000","last_became_active":"2024-08-24T21:10:54.741763+0000","last_became_peered":"2024-08-24T21:10:54.741763+0000","last_unstale":"2024-08-24T21:40:57.582790+0000","last_undegraded":"2024-08-24T21:40:57.582790+0000","last_fullsized":"2024-08-24T21:40:57.582790+0000","mapping_epoch":17,"log_start":"100'13313","ondisk_log_start":"100'13313","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":2530,"log_size":10041,"log_dups_size":0,"ondisk_log_size":10041,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 22s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044521900000000001,"stat_sum":{"num_bytes":2751292542,"num_objects":4326,"num_object_clones":3779,"num_object_copies":8652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4326,"num_whiteouts":0,"num_read":35476,"num_read_kb":27207000,"num_write":16688,"num_write_kb":2682112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"165'74","reported_seq":427,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-24T21:40:35.965204+0000","last_change":"2024-08-24T21:40:35.965204+0000","last_active":"2024-08-24T21:40:35.965204+0000","last_peered":"2024-08-24T21:40:35.965204+0000","last_clean":"2024-08-24T21:40:35.965204+0000","last_became_active":"2024-08-24T21:10:48.522968+0000","last_became_peered":"2024-08-24T21:10:48.522968+0000","last_unstale":"2024-08-24T21:40:35.965204+0000","last_undegraded":"2024-08-24T21:40:35.965204+0000","last_fullsized":"2024-08-24T21:40:35.965204+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"165'74","last_scrub_stamp":"2024-08-24T21:40:35.965081+0000","last_deep_scrub":"165'74","last_deep_scrub_stamp":"2024-08-24T21:40:35.965081+0000","last_clean_scrub_stamp":"2024-08-24T21:40:35.965081+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T05:46:33.359006+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":23859064259,"num_objects":36315,"num_object_clones":31842,"num_object_copies":72630,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36315,"num_whiteouts":0,"num_read":558356,"num_read_kb":241182599,"num_write":158182,"num_write_kb":23264935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":47629131776,"data_stored":64453999494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80433,"ondisk_log_size":80433,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575212,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9592084,"kb_used_data":9177860,"kb_used_omap":1,"kb_used_meta":414206,"kb_avail":84779756,"statfs":{"total":96636764160,"available":86814470144,"internally_reserved":0,"allocated":9398128640,"data_stored":12597758490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":424147403},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,0,1,1,2,5,11,3],"upper_bound":256},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575212,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5936816,"kb_used_data":5685024,"kb_used_omap":1,"kb_used_meta":251774,"kb_avail":88435024,"statfs":{"total":96636764160,"available":90557464576,"internally_reserved":0,"allocated":5821464576,"data_stored":7669968994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":257817030},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,1,0,4],"upper_bound":128},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575213,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5469632,"kb_used_data":5280304,"kb_used_omap":1,"kb_used_meta":189310,"kb_avail":88902208,"statfs":{"total":96636764160,"available":91035860992,"internally_reserved":0,"allocated":5407031296,"data_stored":7168891943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":193853893},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575213,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28968,"kb_used_data":1940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342872,"statfs":{"total":96636764160,"available":96607100928,"internally_reserved":0,"allocated":1986560,"data_stored":902074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575212,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3385368,"kb_used_data":3250120,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":90986472,"statfs":{"total":96636764160,"available":93170147328,"internally_reserved":0,"allocated":3328122880,"data_stored":4869306894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":138475975},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,2,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575214,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6193720,"kb_used_data":5932200,"kb_used_omap":1,"kb_used_meta":261502,"kb_avail":88178120,"statfs":{"total":96636764160,"available":90294394880,"internally_reserved":0,"allocated":6074572800,"data_stored":8657632908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":267778501},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575213,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11830924,"kb_used_data":11406908,"kb_used_omap":1,"kb_used_meta":423998,"kb_avail":82540916,"statfs":{"total":96636764160,"available":84521897984,"internally_reserved":0,"allocated":11680673792,"data_stored":15434675929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":434174405},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,3,3,7,11,5,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575213,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6105180,"kb_used_data":5795148,"kb_used_omap":1,"kb_used_meta":310014,"kb_avail":88266660,"statfs":{"total":96636764160,"available":90385059840,"internally_reserved":0,"allocated":5934231552,"data_stored":8063259590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":317454789},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5931651072,"data_stored":8061767148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11678687232,"data_stored":15433773855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6072586240,"data_stored":8656730834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3326136320,"data_stored":4868404820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5405044736,"data_stored":7167989869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5819478016,"data_stored":7669066920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9395548160,"data_stored":12596266048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-24T21:41:02.055 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-08-24T21:10:53.718293+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=24, tm_hour=21, tm_min=10, tm_sec=53, tm_wday=5, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=24, tm_hour=21, tm_min=40, tm_sec=28, tm_wday=5, tm_yday=237, tm_isdst=0) 2024-08-24T21:41:02.055 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-08-24T21:10:53.718293+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=24, tm_hour=21, tm_min=10, tm_sec=53, tm_wday=5, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=24, tm_hour=21, tm_min=40, tm_sec=28, tm_wday=5, tm_yday=237, tm_isdst=0) 2024-08-24T21:41:02.055 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-08-24T21:10:53.718293+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=24, tm_hour=21, tm_min=10, tm_sec=53, tm_wday=5, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=24, tm_hour=21, tm_min=40, tm_sec=28, tm_wday=5, tm_yday=237, tm_isdst=0) 2024-08-24T21:41:02.055 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-08-24T21:10:53.718293+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=24, tm_hour=21, tm_min=10, tm_sec=53, tm_wday=5, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=24, tm_hour=21, tm_min=40, tm_sec=28, tm_wday=5, tm_yday=237, tm_isdst=0) 2024-08-24T21:41:02.055 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-08-24T21:10:53.718293+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=24, tm_hour=21, tm_min=10, tm_sec=53, tm_wday=5, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=24, tm_hour=21, tm_min=40, tm_sec=28, tm_wday=5, tm_yday=237, tm_isdst=0) 2024-08-24T21:41:02.055 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-08-24T21:10:53.718293+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=24, tm_hour=21, tm_min=10, tm_sec=53, tm_wday=5, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=24, tm_hour=21, tm_min=40, tm_sec=28, tm_wday=5, tm_yday=237, tm_isdst=0) 2024-08-24T21:41:02.055 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-08-24T21:10:53.718293+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=24, tm_hour=21, tm_min=10, tm_sec=53, tm_wday=5, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=24, tm_hour=21, tm_min=40, tm_sec=28, tm_wday=5, tm_yday=237, tm_isdst=0) 2024-08-24T21:41:02.055 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-08-24T21:10:53.718293+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=24, tm_hour=21, tm_min=10, tm_sec=53, tm_wday=5, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=24, tm_hour=21, tm_min=40, tm_sec=28, tm_wday=5, tm_yday=237, tm_isdst=0) 2024-08-24T21:41:02.056 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-08-24T21:41:02.170 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-08-24T21:41:02.170 INFO:tasks.ceph.mon.b:Restarting daemon 2024-08-24T21:41:02.171 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-08-24T21:41:02.176 INFO:tasks.ceph.mon.b:Started 2024-08-24T21:41:02.176 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-08-24T21:41:02.176 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:41:03.039 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":262,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":22,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:41:06.077 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:41:06.945 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":262,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":26,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:41:09.977 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-24T21:41:10.837 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":264,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"97068482-6757-4fb2-8da4-aa9f786bab40","modified":"2024-08-24T21:09:49.671468Z","created":"2024-08-24T21:09:49.671468Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3301","nonce":0},{"type":"v1","addr":"172.21.15.60:6790","nonce":0}]},"addr":"172.21.15.60:6790/0","public_addr":"172.21.15.60:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-24T21:41:10.870 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-08-24T21:41:10.870 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-08-24T21:41:10.870 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-24T21:41:11.207 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:41:11.208 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:41:11.208 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:41:11.208 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-08-24T21:41:11.208 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 264, 2024-08-24T21:41:11.208 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 55739, 2024-08-24T21:41:11.208 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:41:11.208 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:41:11.208 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:41:11.208 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:41:11.208 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:41:11.208 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 4, 2024-08-24T21:41:11.209 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:41:11.209 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:41:11.209 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:41:11.209 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:41:11.209 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:41:11.209 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:41:11.209 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:41:11.209 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:41:11.209 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:41:11.209 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:41:11.209 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:41:11.209 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:41:11.209 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:41:11.210 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:41:11.210 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:41:11.210 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:41:11.210 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:41:11.210 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:41:11.210 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:41:11.210 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:41:11.210 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:41:11.210 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:41:11.210 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:41:11.210 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:41:11.210 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:41:11.211 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:41:11.211 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:41:11.211 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:41:11.211 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:41:11.211 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:41:11.211 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:41:11.211 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:41:11.211 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:41:11.211 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:41:11.211 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:41:11.211 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:41:11.211 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:41:11.211 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:41:11.212 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:41:11.212 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:41:11.212 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:41:11.212 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:41:11.212 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:41:11.212 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:41:11.212 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:41:11.212 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:41:11.212 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:41:11.212 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:41:11.212 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:41:11.212 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:41:11.212 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:41:11.213 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:41:11.213 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:41:11.213 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:41:11.213 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:41:11.213 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:41:11.213 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:41:11.213 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:41:11.213 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:41:11.213 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:41:11.213 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:41:11.213 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:41:11.213 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:41:11.213 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:41:11.214 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:41:11.214 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:41:11.214 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:41:11.214 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:41:11.214 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:41:11.214 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:41:11.214 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:41:11.214 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:41:11.214 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:41:11.214 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:41:11.214 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:41:11.214 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:41:11.214 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:41:11.215 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:41:11.215 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:41:11.215 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:41:11.215 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:41:11.215 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:41:11.215 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:41:11.215 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:41:11.215 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:41:11.215 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:41:11.215 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:41:11.215 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:41:11.215 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:41:11.216 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:41:11.216 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:41:11.216 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:41:11.216 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:41:11.216 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:41:11.216 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:41:11.216 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:41:11.216 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:41:11.216 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:41:11.216 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:41:11.216 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:41:11.216 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:41:11.216 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:41:11.217 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:41:11.217 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:41:11.217 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:41:11.217 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:41:11.217 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:41:11.217 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:41:11.217 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:41:11.217 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:41:11.217 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:41:11.217 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:41:11.217 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:41:11.217 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:41:11.217 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:41:11.218 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:41:11.218 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:41:11.218 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:41:11.218 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:41:11.218 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:41:11.218 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:41:11.218 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:41:11.218 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:41:11.218 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:41:11.218 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:41:11.218 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:41:11.218 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:41:11.219 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:41:11.219 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:41:11.219 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:41:11.219 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:41:11.219 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:41:11.219 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:41:11.219 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:41:11.219 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:41:11.219 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:41:11.219 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:41:11.219 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:41:11.219 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:41:11.220 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:41:11.220 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:41:11.220 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:41:11.220 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:41:11.220 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:41:11.220 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:41:11.220 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-08-24T21:41:11.220 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:41:11.220 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:41:11.220 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:41:11.220 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:41:11.220 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:41:11.220 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:41:11.220 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-08-24T21:41:11.221 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:41:11.221 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:41:11.221 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:41:11.221 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:41:11.221 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:41:11.221 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:41:11.221 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:41:11.221 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:41:11.221 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:41:11.221 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:41:11.221 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:41:11.221 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:41:11.241 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:41:11.242 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-08-24T21:41:11.242 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-24T21:41:11.591 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:41:11.591 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:41:11.591 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:41:11.591 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:41:11.591 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 264, 2024-08-24T21:41:11.591 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 120753, 2024-08-24T21:41:11.591 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:41:11.591 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:41:11.591 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:41:11.592 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:41:11.592 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:41:11.592 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 4, 2024-08-24T21:41:11.592 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:41:11.592 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:41:11.592 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:41:11.592 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:41:11.592 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:41:11.592 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:41:11.592 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:41:11.592 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:41:11.592 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:41:11.592 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:41:11.592 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:41:11.593 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:41:11.593 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:41:11.593 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:41:11.593 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:41:11.593 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:41:11.593 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:41:11.593 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:41:11.593 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:41:11.593 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:41:11.593 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:41:11.593 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:41:11.593 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:41:11.593 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:41:11.594 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:41:11.594 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:41:11.594 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:41:11.594 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:41:11.594 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:41:11.594 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:41:11.594 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:41:11.594 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:41:11.594 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:41:11.594 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:41:11.594 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:41:11.594 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:41:11.594 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:41:11.595 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:41:11.595 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:41:11.595 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:41:11.595 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:41:11.595 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:41:11.595 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:41:11.595 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:41:11.595 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:41:11.595 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:41:11.595 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:41:11.595 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:41:11.595 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:41:11.595 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:41:11.596 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:41:11.596 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:41:11.596 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:41:11.596 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:41:11.596 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:41:11.596 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:41:11.596 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:41:11.596 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:41:11.596 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:41:11.596 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:41:11.596 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:41:11.596 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:41:11.596 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:41:11.597 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:41:11.597 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:41:11.597 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:41:11.597 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:41:11.597 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:41:11.597 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:41:11.597 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:41:11.597 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:41:11.597 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:41:11.598 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:41:11.598 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:41:11.598 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:41:11.598 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:41:11.598 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:41:11.598 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:41:11.598 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:41:11.598 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:41:11.598 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:41:11.598 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:41:11.598 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:41:11.598 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:41:11.598 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:41:11.599 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:41:11.599 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:41:11.599 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:41:11.599 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:41:11.599 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:41:11.599 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:41:11.599 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:41:11.599 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:41:11.599 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:41:11.599 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:41:11.600 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:41:11.600 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:41:11.600 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:41:11.600 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:41:11.600 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:41:11.600 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:41:11.600 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:41:11.600 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:41:11.600 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:41:11.600 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:41:11.600 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:41:11.600 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:41:11.601 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:41:11.601 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:41:11.601 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:41:11.601 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:41:11.601 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:41:11.601 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:41:11.601 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:41:11.601 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:41:11.601 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:41:11.601 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:41:11.601 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:41:11.601 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:41:11.601 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:41:11.601 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:41:11.602 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:41:11.602 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:41:11.602 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:41:11.602 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:41:11.602 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:41:11.602 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:41:11.602 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:41:11.602 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:41:11.602 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:41:11.602 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:41:11.602 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:41:11.602 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:41:11.602 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:41:11.603 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:41:11.603 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:41:11.603 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:41:11.603 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:41:11.603 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:41:11.603 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:41:11.603 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:41:11.603 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-08-24T21:41:11.603 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:41:11.603 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:41:11.603 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:41:11.603 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-08-24T21:41:11.603 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:41:11.603 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:41:11.604 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:41:11.604 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:41:11.604 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:41:11.604 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:41:11.604 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-08-24T21:41:11.604 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:41:11.604 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:41:11.604 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-08-24T21:41:11.605 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:41:11.605 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:41:11.605 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:41:11.605 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:41:11.605 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:41:11.605 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:41:11.605 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:41:11.605 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:41:11.605 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:41:11.630 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:41:11.630 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-08-24T21:41:11.630 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-24T21:41:11.987 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-08-24T21:41:11.987 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:41:11.987 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:41:11.987 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-08-24T21:41:11.987 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 264, 2024-08-24T21:41:11.988 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 9595, 2024-08-24T21:41:11.988 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-08-24T21:41:11.988 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-08-24T21:41:11.988 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-08-24T21:41:11.988 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-08-24T21:41:11.988 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:41:11.988 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 4, 2024-08-24T21:41:11.988 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:41:11.988 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-08-24T21:41:11.988 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-08-24T21:41:11.989 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:41:11.989 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:41:11.989 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:41:11.989 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:41:11.989 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:41:11.989 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:41:11.989 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:41:11.989 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:41:11.989 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:41:11.989 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:41:11.989 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:41:11.990 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:41:11.990 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-08-24T21:41:11.990 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-08-24T21:41:11.990 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:41:11.990 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:41:11.990 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:41:11.990 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:41:11.990 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:41:11.990 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:41:11.990 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:41:11.991 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:41:11.991 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:41:11.991 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:41:11.991 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:41:11.991 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:41:11.991 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:41:11.991 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-08-24T21:41:11.991 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-08-24T21:41:11.991 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-08-24T21:41:11.991 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-08-24T21:41:11.992 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-08-24T21:41:11.992 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "97068482-6757-4fb2-8da4-aa9f786bab40", 2024-08-24T21:41:11.992 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:41:11.992 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-08-24T21:09:49.671468Z", 2024-08-24T21:41:11.992 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-08-24T21:41:11.992 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-08-24T21:41:11.992 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-08-24T21:41:11.992 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-08-24T21:41:11.992 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-08-24T21:41:11.992 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-08-24T21:41:11.992 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-08-24T21:41:11.993 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-08-24T21:41:11.993 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-08-24T21:41:11.993 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-08-24T21:41:11.993 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-08-24T21:41:11.993 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-08-24T21:41:11.993 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-08-24T21:41:11.993 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-08-24T21:41:11.993 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-08-24T21:41:11.993 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-08-24T21:41:11.993 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-08-24T21:41:11.993 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-08-24T21:41:11.994 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-08-24T21:41:11.994 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-08-24T21:41:11.994 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:41:11.994 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-08-24T21:41:11.994 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:41:11.994 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-08-24T21:41:11.994 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:41:11.994 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-08-24T21:41:11.994 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-08-24T21:41:11.994 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:41:11.994 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:41:11.995 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:41:11.995 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:41:11.995 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-08-24T21:41:11.995 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:41:11.995 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:41:11.995 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:41:11.995 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:41:11.995 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-08-24T21:41:11.995 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:41:11.995 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:41:11.995 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:41:11.996 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:41:11.996 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-08-24T21:41:11.996 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-08-24T21:41:11.996 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:41:11.996 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:41:11.996 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:41:11.996 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:41:11.996 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:41:11.997 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-08-24T21:41:11.997 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-08-24T21:41:11.997 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:41:11.997 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:41:11.997 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:41:11.997 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:41:11.997 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:3300", 2024-08-24T21:41:11.997 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:41:11.997 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:41:11.997 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:41:11.998 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:41:11.998 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789", 2024-08-24T21:41:11.998 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:41:11.998 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:41:11.998 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:41:11.998 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:41:11.998 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.119:6789/0", 2024-08-24T21:41:11.998 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.119:6789/0", 2024-08-24T21:41:11.998 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:41:11.998 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:41:11.999 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:41:11.999 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:41:11.999 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:41:11.999 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-08-24T21:41:11.999 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-08-24T21:41:11.999 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-08-24T21:41:11.999 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-08-24T21:41:11.999 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:41:11.999 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-08-24T21:41:11.999 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3301", 2024-08-24T21:41:11.999 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:41:11.999 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:41:12.000 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:41:12.000 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-08-24T21:41:12.000 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790", 2024-08-24T21:41:12.000 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-08-24T21:41:12.000 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:41:12.000 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:41:12.000 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:41:12.000 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6790/0", 2024-08-24T21:41:12.000 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6790/0", 2024-08-24T21:41:12.000 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-08-24T21:41:12.000 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-08-24T21:41:12.001 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-08-24T21:41:12.001 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:41:12.001 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:41:12.001 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:41:12.001 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-08-24T21:41:12.001 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-08-24T21:41:12.001 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:41:12.001 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:41:12.001 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:41:12.001 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:41:12.001 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:41:12.002 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-08-24T21:41:12.002 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-08-24T21:41:12.002 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-08-24T21:41:12.002 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-08-24T21:41:12.002 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-08-24T21:41:12.002 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-08-24T21:41:12.002 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-08-24T21:41:12.002 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-08-24T21:41:12.002 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-08-24T21:41:12.002 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-08-24T21:41:12.002 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-08-24T21:41:12.023 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-08-24T21:41:12.023 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-08-24T21:41:12.023 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-08-24T21:41:12.908 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-08-24T21:41:13.909 ERROR:tasks.mon_thrash.mon_thrasher:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_797669399b32d2915e64eb6d4b1257ae3c50f80b/qa/tasks/mon_thrash.py", line 272, in do_thrash self._do_thrash() File "/home/teuthworker/src/git.ceph.com_ceph_797669399b32d2915e64eb6d4b1257ae3c50f80b/qa/tasks/mon_thrash.py", line 321, in _do_thrash while not self.stopping.is_set(): AttributeError: 'bool' object has no attribute 'is_set' 2024-08-24T21:41:15.276 INFO:tasks.daemonwatchdog.daemon_watchdog:MonitorThrasher failed 2024-08-24T21:41:15.277 ERROR:tasks.daemonwatchdog.daemon_watchdog:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_797669399b32d2915e64eb6d4b1257ae3c50f80b/qa/tasks/daemonwatchdog.py", line 42, in _run self.watch() File "/home/teuthworker/src/git.ceph.com_ceph_797669399b32d2915e64eb6d4b1257ae3c50f80b/qa/tasks/daemonwatchdog.py", line 120, in watch thrasher.stop_and_join() File "/home/teuthworker/src/git.ceph.com_ceph_797669399b32d2915e64eb6d4b1257ae3c50f80b/qa/tasks/mon_thrash.py", line 178, in stop_and_join return self.join() File "/home/teuthworker/src/git.ceph.com_ceph_797669399b32d2915e64eb6d4b1257ae3c50f80b/qa/tasks/mon_thrash.py", line 170, in join self.stopping.set() AttributeError: 'bool' object has no attribute 'set' 2024-08-24T21:41:22.057 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-24T21:41:22.437 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-08-24T21:41:22.437 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-08-24T21:41:22.453 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":1075,"stamp":"2024-08-24T21:41:21.036989+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23859654627,"num_objects":36317,"num_object_clones":31842,"num_object_copies":72634,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36317,"num_whiteouts":0,"num_read":558422,"num_read_kb":241182654,"num_write":158283,"num_write_kb":23266563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9354,"num_omap_keys":164,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80372,"ondisk_log_size":80372,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":48671780,"kb_used_data":46529504,"kb_used_omap":12,"kb_used_meta":2142131,"kb_avail":706302940,"statfs":{"total":773094113280,"available":723254210560,"internally_reserved":0,"allocated":47646212096,"data_stored":64462396822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":2193542705},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,2,6,2,3,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9354,"num_omap_keys":164,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001941"},"pg_stats":[{"pgid":"2.7","version":"165'28540","reported_seq":65950,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-24T21:41:11.655249+0000","last_change":"2024-08-24T21:41:11.655302+0000","last_active":"2024-08-24T21:41:11.655249+0000","last_peered":"2024-08-24T21:41:11.655249+0000","last_clean":"2024-08-24T21:41:11.655249+0000","last_became_active":"2024-08-24T21:10:54.740448+0000","last_became_peered":"2024-08-24T21:10:54.740448+0000","last_unstale":"2024-08-24T21:41:11.655249+0000","last_undegraded":"2024-08-24T21:41:11.655249+0000","last_fullsized":"2024-08-24T21:41:11.655249+0000","mapping_epoch":17,"log_start":"125'18524","ondisk_log_start":"125'18524","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"165'28540","last_scrub_stamp":"2024-08-24T21:41:11.655144+0000","last_deep_scrub":"165'28540","last_deep_scrub_stamp":"2024-08-24T21:41:11.655144+0000","last_clean_scrub_stamp":"2024-08-24T21:41:11.655144+0000","objects_scrubbed":4709,"log_size":10016,"log_dups_size":0,"ondisk_log_size":10016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":37,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T01:01:22.231082+0000","scrub_duration":36468,"objects_trimmed":0,"snaptrim_duration":0.00063699500000000001,"stat_sum":{"num_bytes":3058996982,"num_objects":4709,"num_object_clones":4119,"num_object_copies":9418,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4709,"num_whiteouts":0,"num_read":78231,"num_read_kb":31399812,"num_write":19230,"num_write_kb":2986515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4609,"num_omap_keys":79,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"165'24082","reported_seq":55741,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-24T21:41:14.925858+0000","last_change":"2024-08-24T21:41:14.925911+0000","last_active":"2024-08-24T21:41:14.925858+0000","last_peered":"2024-08-24T21:41:14.925858+0000","last_clean":"2024-08-24T21:41:14.925858+0000","last_became_active":"2024-08-24T21:10:54.740255+0000","last_became_peered":"2024-08-24T21:10:54.740255+0000","last_unstale":"2024-08-24T21:41:14.925858+0000","last_undegraded":"2024-08-24T21:41:14.925858+0000","last_fullsized":"2024-08-24T21:41:14.925858+0000","mapping_epoch":17,"log_start":"119'14020","ondisk_log_start":"119'14020","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"165'24082","last_scrub_stamp":"2024-08-24T21:41:14.925784+0000","last_deep_scrub":"165'24082","last_deep_scrub_stamp":"2024-08-24T21:41:14.925784+0000","last_clean_scrub_stamp":"2024-08-24T21:41:14.925784+0000","objects_scrubbed":4332,"log_size":10062,"log_dups_size":0,"ondisk_log_size":10062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":43,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T08:10:40.087085+0000","scrub_duration":42837,"objects_trimmed":0,"snaptrim_duration":0.00065658299999999997,"stat_sum":{"num_bytes":2766190002,"num_objects":4332,"num_object_clones":3794,"num_object_copies":8664,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4332,"num_whiteouts":0,"num_read":34855,"num_read_kb":27515762,"num_write":15521,"num_write_kb":2696713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"165'43915","reported_seq":77525,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-24T21:41:17.369348+0000","last_change":"2024-08-24T21:41:17.369395+0000","last_active":"2024-08-24T21:41:17.369348+0000","last_peered":"2024-08-24T21:41:17.369348+0000","last_clean":"2024-08-24T21:41:17.369348+0000","last_became_active":"2024-08-24T21:10:55.004842+0000","last_became_peered":"2024-08-24T21:10:55.004842+0000","last_unstale":"2024-08-24T21:41:17.369348+0000","last_undegraded":"2024-08-24T21:41:17.369348+0000","last_fullsized":"2024-08-24T21:41:17.369348+0000","mapping_epoch":17,"log_start":"120'33831","ondisk_log_start":"120'33831","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"165'43915","last_scrub_stamp":"2024-08-24T21:41:17.369281+0000","last_deep_scrub":"165'43915","last_deep_scrub_stamp":"2024-08-24T21:41:17.369281+0000","last_clean_scrub_stamp":"2024-08-24T21:41:17.369281+0000","objects_scrubbed":4518,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":40,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T01:12:37.018657+0000","scrub_duration":39406,"objects_trimmed":0,"snaptrim_duration":0.00039021900000000003,"stat_sum":{"num_bytes":3013331164,"num_objects":4518,"num_object_clones":3976,"num_object_copies":9036,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4518,"num_whiteouts":0,"num_read":122735,"num_read_kb":30694751,"num_write":29066,"num_write_kb":2942932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"165'27455","reported_seq":60019,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-24T21:41:14.062425+0000","last_change":"2024-08-24T21:41:14.062502+0000","last_active":"2024-08-24T21:41:14.062425+0000","last_peered":"2024-08-24T21:41:14.062425+0000","last_clean":"2024-08-24T21:41:14.062425+0000","last_became_active":"2024-08-24T21:10:55.004437+0000","last_became_peered":"2024-08-24T21:10:55.004437+0000","last_unstale":"2024-08-24T21:41:14.062425+0000","last_undegraded":"2024-08-24T21:41:14.062425+0000","last_fullsized":"2024-08-24T21:41:14.062425+0000","mapping_epoch":17,"log_start":"119'17421","ondisk_log_start":"119'17421","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"165'27455","last_scrub_stamp":"2024-08-24T21:41:14.062324+0000","last_deep_scrub":"165'27455","last_deep_scrub_stamp":"2024-08-24T21:41:14.062324+0000","last_clean_scrub_stamp":"2024-08-24T21:41:14.062324+0000","objects_scrubbed":4426,"log_size":10034,"log_dups_size":0,"ondisk_log_size":10034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":43,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T04:29:21.389242+0000","scrub_duration":42976,"objects_trimmed":0,"snaptrim_duration":0.000725513,"stat_sum":{"num_bytes":2932036880,"num_objects":4426,"num_object_clones":3878,"num_object_copies":8852,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4426,"num_whiteouts":0,"num_read":35836,"num_read_kb":29684996,"num_write":18753,"num_write_kb":2857790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":120,"num_omap_keys":4,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"165'25435","reported_seq":58212,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-24T21:41:14.100171+0000","last_change":"2024-08-24T21:41:14.100226+0000","last_active":"2024-08-24T21:41:14.100171+0000","last_peered":"2024-08-24T21:41:14.100171+0000","last_clean":"2024-08-24T21:41:14.100171+0000","last_became_active":"2024-08-24T21:10:54.740821+0000","last_became_peered":"2024-08-24T21:10:54.740821+0000","last_unstale":"2024-08-24T21:41:14.100171+0000","last_undegraded":"2024-08-24T21:41:14.100171+0000","last_fullsized":"2024-08-24T21:41:14.100171+0000","mapping_epoch":17,"log_start":"112'15420","ondisk_log_start":"112'15420","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"165'25435","last_scrub_stamp":"2024-08-24T21:41:14.100085+0000","last_deep_scrub":"165'25435","last_deep_scrub_stamp":"2024-08-24T21:41:14.100085+0000","last_clean_scrub_stamp":"2024-08-24T21:41:14.100085+0000","objects_scrubbed":4067,"log_size":10015,"log_dups_size":0,"ondisk_log_size":10015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":41,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T00:14:40.556530+0000","scrub_duration":40144,"objects_trimmed":0,"snaptrim_duration":0.00096400900000000005,"stat_sum":{"num_bytes":2659980271,"num_objects":4067,"num_object_clones":3542,"num_object_copies":8134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4067,"num_whiteouts":0,"num_read":36071,"num_read_kb":27990304,"num_write":17504,"num_write_kb":2596261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"165'34058","reported_seq":80696,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-24T21:41:14.072177+0000","last_change":"2024-08-24T21:41:14.072231+0000","last_active":"2024-08-24T21:41:14.072177+0000","last_peered":"2024-08-24T21:41:14.072177+0000","last_clean":"2024-08-24T21:41:14.072177+0000","last_became_active":"2024-08-24T21:10:54.739867+0000","last_became_peered":"2024-08-24T21:10:54.739867+0000","last_unstale":"2024-08-24T21:41:14.072177+0000","last_undegraded":"2024-08-24T21:41:14.072177+0000","last_fullsized":"2024-08-24T21:41:14.072177+0000","mapping_epoch":17,"log_start":"120'24028","ondisk_log_start":"120'24028","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"165'34058","last_scrub_stamp":"2024-08-24T21:41:14.072042+0000","last_deep_scrub":"165'34058","last_deep_scrub_stamp":"2024-08-24T21:41:14.072042+0000","last_clean_scrub_stamp":"2024-08-24T21:41:14.072042+0000","objects_scrubbed":4629,"log_size":10030,"log_dups_size":0,"ondisk_log_size":10030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":43,"scrub_schedule":"periodic scrub scheduled @ 2024-08-25T22:34:45.141993+0000","scrub_duration":42364,"objects_trimmed":0,"snaptrim_duration":0.00032487299999999999,"stat_sum":{"num_bytes":3343910484,"num_objects":4629,"num_object_clones":4068,"num_object_copies":9258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4629,"num_whiteouts":0,"num_read":174392,"num_read_kb":34621705,"num_write":23960,"num_write_kb":3248477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4625,"num_omap_keys":81,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"165'27450","reported_seq":64153,"reported_epoch":165,"state":"active+clean+scrubbing+deep","last_fresh":"2024-08-24T21:41:19.675080+0000","last_change":"2024-08-24T21:40:36.974002+0000","last_active":"2024-08-24T21:41:19.675080+0000","last_peered":"2024-08-24T21:41:19.675080+0000","last_clean":"2024-08-24T21:41:19.675080+0000","last_became_active":"2024-08-24T21:10:54.739290+0000","last_became_peered":"2024-08-24T21:10:54.739290+0000","last_unstale":"2024-08-24T21:41:19.675080+0000","last_undegraded":"2024-08-24T21:41:19.675080+0000","last_fullsized":"2024-08-24T21:41:19.675080+0000","mapping_epoch":17,"log_start":"125'17430","ondisk_log_start":"125'17430","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-24T21:10:53.718293+0000","last_clean_scrub_stamp":"2024-08-24T21:10:53.718293+0000","objects_scrubbed":4846,"log_size":10020,"log_dups_size":0,"ondisk_log_size":10020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 42s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041195799999999997,"stat_sum":{"num_bytes":3333325934,"num_objects":5308,"num_object_clones":4686,"num_object_copies":10616,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5308,"num_whiteouts":0,"num_read":40760,"num_read_kb":32068269,"num_write":17460,"num_write_kb":3254135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"165'25150","reported_seq":57315,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-24T21:41:13.992781+0000","last_change":"2024-08-24T21:41:13.992848+0000","last_active":"2024-08-24T21:41:13.992781+0000","last_peered":"2024-08-24T21:41:13.992781+0000","last_clean":"2024-08-24T21:41:13.992781+0000","last_became_active":"2024-08-24T21:10:54.741763+0000","last_became_peered":"2024-08-24T21:10:54.741763+0000","last_unstale":"2024-08-24T21:41:13.992781+0000","last_undegraded":"2024-08-24T21:41:13.992781+0000","last_fullsized":"2024-08-24T21:41:13.992781+0000","mapping_epoch":17,"log_start":"119'15113","ondisk_log_start":"119'15113","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"165'25150","last_scrub_stamp":"2024-08-24T21:41:13.992688+0000","last_deep_scrub":"165'25150","last_deep_scrub_stamp":"2024-08-24T21:41:13.992688+0000","last_clean_scrub_stamp":"2024-08-24T21:41:13.992688+0000","objects_scrubbed":4326,"log_size":10037,"log_dups_size":0,"ondisk_log_size":10037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":40,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T08:02:27.387293+0000","scrub_duration":39078,"objects_trimmed":0,"snaptrim_duration":0.00044521900000000001,"stat_sum":{"num_bytes":2751292542,"num_objects":4326,"num_object_clones":3779,"num_object_copies":8652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4326,"num_whiteouts":0,"num_read":35476,"num_read_kb":27207000,"num_write":16688,"num_write_kb":2682112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"165'74","reported_seq":427,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-24T21:40:35.965204+0000","last_change":"2024-08-24T21:40:35.965204+0000","last_active":"2024-08-24T21:40:35.965204+0000","last_peered":"2024-08-24T21:40:35.965204+0000","last_clean":"2024-08-24T21:40:35.965204+0000","last_became_active":"2024-08-24T21:10:48.522968+0000","last_became_peered":"2024-08-24T21:10:48.522968+0000","last_unstale":"2024-08-24T21:40:35.965204+0000","last_undegraded":"2024-08-24T21:40:35.965204+0000","last_fullsized":"2024-08-24T21:40:35.965204+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"165'74","last_scrub_stamp":"2024-08-24T21:40:35.965081+0000","last_deep_scrub":"165'74","last_deep_scrub_stamp":"2024-08-24T21:40:35.965081+0000","last_clean_scrub_stamp":"2024-08-24T21:40:35.965081+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T05:46:33.359006+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":23859064259,"num_objects":36315,"num_object_clones":31842,"num_object_copies":72630,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36315,"num_whiteouts":0,"num_read":558356,"num_read_kb":241182599,"num_write":158182,"num_write_kb":23264935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9354,"num_omap_keys":164,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":47629131776,"data_stored":64453999494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80298,"ondisk_log_size":80298,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575216,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9601812,"kb_used_data":9177860,"kb_used_omap":1,"kb_used_meta":423934,"kb_avail":84770028,"statfs":{"total":96636764160,"available":86804508672,"internally_reserved":0,"allocated":9398128640,"data_stored":12597758490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":434108875},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,4,1,0,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575216,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5936816,"kb_used_data":5685024,"kb_used_omap":1,"kb_used_meta":251774,"kb_avail":88435024,"statfs":{"total":96636764160,"available":90557464576,"internally_reserved":0,"allocated":5821464576,"data_stored":7669968994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":257817030},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575217,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5505728,"kb_used_data":5280304,"kb_used_omap":1,"kb_used_meta":225406,"kb_avail":88866112,"statfs":{"total":96636764160,"available":90998898688,"internally_reserved":0,"allocated":5407031296,"data_stored":7168891943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":230816197},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575217,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28968,"kb_used_data":1940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342872,"statfs":{"total":96636764160,"available":96607100928,"internally_reserved":0,"allocated":1986560,"data_stored":902074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575216,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3411736,"kb_used_data":3250120,"kb_used_omap":1,"kb_used_meta":161598,"kb_avail":90960104,"statfs":{"total":96636764160,"available":93143146496,"internally_reserved":0,"allocated":3328122880,"data_stored":4869306894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":165476807},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575218,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6206200,"kb_used_data":5932200,"kb_used_omap":1,"kb_used_meta":273982,"kb_avail":88165640,"statfs":{"total":96636764160,"available":90281615360,"internally_reserved":0,"allocated":6074572800,"data_stored":8657632908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":280558021},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575217,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11857292,"kb_used_data":11406908,"kb_used_omap":1,"kb_used_meta":450366,"kb_avail":82514548,"statfs":{"total":96636764160,"available":84494897152,"internally_reserved":0,"allocated":11680673792,"data_stored":15434675929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":461175237},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575217,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6123228,"kb_used_data":5795148,"kb_used_omap":1,"kb_used_meta":328062,"kb_avail":88248612,"statfs":{"total":96636764160,"available":90366578688,"internally_reserved":0,"allocated":5934231552,"data_stored":8063259590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":335935941},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1,1,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5931651072,"data_stored":8061767148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11678687232,"data_stored":15433773855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6072586240,"data_stored":8656730834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3326136320,"data_stored":4868404820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5405044736,"data_stored":7167989869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5819478016,"data_stored":7669066920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9395548160,"data_stored":12596266048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-24T21:41:22.455 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-08-24T21:10:53.718293+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=24, tm_hour=21, tm_min=10, tm_sec=53, tm_wday=5, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=24, tm_hour=21, tm_min=40, tm_sec=28, tm_wday=5, tm_yday=237, tm_isdst=0) 2024-08-24T21:41:22.455 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-08-24T21:41:42.456 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-24T21:41:42.832 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-08-24T21:41:42.832 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-08-24T21:41:42.849 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":1085,"stamp":"2024-08-24T21:41:41.040941+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23859654627,"num_objects":36317,"num_object_clones":31842,"num_object_copies":72634,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36317,"num_whiteouts":0,"num_read":558422,"num_read_kb":241182654,"num_write":158283,"num_write_kb":23266563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9354,"num_omap_keys":164,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80434,"ondisk_log_size":80434,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":48675940,"kb_used_data":46529504,"kb_used_omap":12,"kb_used_meta":2146291,"kb_avail":706298780,"statfs":{"total":773094113280,"available":723249950720,"internally_reserved":0,"allocated":47646212096,"data_stored":64462396822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":2197802545},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002163"},"pg_stats":[{"pgid":"2.7","version":"165'28540","reported_seq":65950,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-24T21:41:11.655249+0000","last_change":"2024-08-24T21:41:11.655302+0000","last_active":"2024-08-24T21:41:11.655249+0000","last_peered":"2024-08-24T21:41:11.655249+0000","last_clean":"2024-08-24T21:41:11.655249+0000","last_became_active":"2024-08-24T21:10:54.740448+0000","last_became_peered":"2024-08-24T21:10:54.740448+0000","last_unstale":"2024-08-24T21:41:11.655249+0000","last_undegraded":"2024-08-24T21:41:11.655249+0000","last_fullsized":"2024-08-24T21:41:11.655249+0000","mapping_epoch":17,"log_start":"125'18524","ondisk_log_start":"125'18524","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"165'28540","last_scrub_stamp":"2024-08-24T21:41:11.655144+0000","last_deep_scrub":"165'28540","last_deep_scrub_stamp":"2024-08-24T21:41:11.655144+0000","last_clean_scrub_stamp":"2024-08-24T21:41:11.655144+0000","objects_scrubbed":4709,"log_size":10016,"log_dups_size":0,"ondisk_log_size":10016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":37,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T01:01:22.231082+0000","scrub_duration":36468,"objects_trimmed":0,"snaptrim_duration":0.00063699500000000001,"stat_sum":{"num_bytes":3058996982,"num_objects":4709,"num_object_clones":4119,"num_object_copies":9418,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4709,"num_whiteouts":0,"num_read":78231,"num_read_kb":31399812,"num_write":19230,"num_write_kb":2986515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4609,"num_omap_keys":79,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"165'24082","reported_seq":55741,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-24T21:41:14.925858+0000","last_change":"2024-08-24T21:41:14.925911+0000","last_active":"2024-08-24T21:41:14.925858+0000","last_peered":"2024-08-24T21:41:14.925858+0000","last_clean":"2024-08-24T21:41:14.925858+0000","last_became_active":"2024-08-24T21:10:54.740255+0000","last_became_peered":"2024-08-24T21:10:54.740255+0000","last_unstale":"2024-08-24T21:41:14.925858+0000","last_undegraded":"2024-08-24T21:41:14.925858+0000","last_fullsized":"2024-08-24T21:41:14.925858+0000","mapping_epoch":17,"log_start":"119'14020","ondisk_log_start":"119'14020","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"165'24082","last_scrub_stamp":"2024-08-24T21:41:14.925784+0000","last_deep_scrub":"165'24082","last_deep_scrub_stamp":"2024-08-24T21:41:14.925784+0000","last_clean_scrub_stamp":"2024-08-24T21:41:14.925784+0000","objects_scrubbed":4332,"log_size":10062,"log_dups_size":0,"ondisk_log_size":10062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":43,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T08:10:40.087085+0000","scrub_duration":42837,"objects_trimmed":0,"snaptrim_duration":0.00065658299999999997,"stat_sum":{"num_bytes":2766190002,"num_objects":4332,"num_object_clones":3794,"num_object_copies":8664,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4332,"num_whiteouts":0,"num_read":34855,"num_read_kb":27515762,"num_write":15521,"num_write_kb":2696713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"165'43915","reported_seq":77525,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-24T21:41:17.369348+0000","last_change":"2024-08-24T21:41:17.369395+0000","last_active":"2024-08-24T21:41:17.369348+0000","last_peered":"2024-08-24T21:41:17.369348+0000","last_clean":"2024-08-24T21:41:17.369348+0000","last_became_active":"2024-08-24T21:10:55.004842+0000","last_became_peered":"2024-08-24T21:10:55.004842+0000","last_unstale":"2024-08-24T21:41:17.369348+0000","last_undegraded":"2024-08-24T21:41:17.369348+0000","last_fullsized":"2024-08-24T21:41:17.369348+0000","mapping_epoch":17,"log_start":"120'33831","ondisk_log_start":"120'33831","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"165'43915","last_scrub_stamp":"2024-08-24T21:41:17.369281+0000","last_deep_scrub":"165'43915","last_deep_scrub_stamp":"2024-08-24T21:41:17.369281+0000","last_clean_scrub_stamp":"2024-08-24T21:41:17.369281+0000","objects_scrubbed":4518,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":40,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T01:12:37.018657+0000","scrub_duration":39406,"objects_trimmed":0,"snaptrim_duration":0.00039021900000000003,"stat_sum":{"num_bytes":3013331164,"num_objects":4518,"num_object_clones":3976,"num_object_copies":9036,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4518,"num_whiteouts":0,"num_read":122735,"num_read_kb":30694751,"num_write":29066,"num_write_kb":2942932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"165'27455","reported_seq":60019,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-24T21:41:14.062425+0000","last_change":"2024-08-24T21:41:14.062502+0000","last_active":"2024-08-24T21:41:14.062425+0000","last_peered":"2024-08-24T21:41:14.062425+0000","last_clean":"2024-08-24T21:41:14.062425+0000","last_became_active":"2024-08-24T21:10:55.004437+0000","last_became_peered":"2024-08-24T21:10:55.004437+0000","last_unstale":"2024-08-24T21:41:14.062425+0000","last_undegraded":"2024-08-24T21:41:14.062425+0000","last_fullsized":"2024-08-24T21:41:14.062425+0000","mapping_epoch":17,"log_start":"119'17421","ondisk_log_start":"119'17421","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"165'27455","last_scrub_stamp":"2024-08-24T21:41:14.062324+0000","last_deep_scrub":"165'27455","last_deep_scrub_stamp":"2024-08-24T21:41:14.062324+0000","last_clean_scrub_stamp":"2024-08-24T21:41:14.062324+0000","objects_scrubbed":4426,"log_size":10034,"log_dups_size":0,"ondisk_log_size":10034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":43,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T04:29:21.389242+0000","scrub_duration":42976,"objects_trimmed":0,"snaptrim_duration":0.000725513,"stat_sum":{"num_bytes":2932036880,"num_objects":4426,"num_object_clones":3878,"num_object_copies":8852,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4426,"num_whiteouts":0,"num_read":35836,"num_read_kb":29684996,"num_write":18753,"num_write_kb":2857790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":120,"num_omap_keys":4,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"165'25435","reported_seq":58212,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-24T21:41:14.100171+0000","last_change":"2024-08-24T21:41:14.100226+0000","last_active":"2024-08-24T21:41:14.100171+0000","last_peered":"2024-08-24T21:41:14.100171+0000","last_clean":"2024-08-24T21:41:14.100171+0000","last_became_active":"2024-08-24T21:10:54.740821+0000","last_became_peered":"2024-08-24T21:10:54.740821+0000","last_unstale":"2024-08-24T21:41:14.100171+0000","last_undegraded":"2024-08-24T21:41:14.100171+0000","last_fullsized":"2024-08-24T21:41:14.100171+0000","mapping_epoch":17,"log_start":"112'15420","ondisk_log_start":"112'15420","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"165'25435","last_scrub_stamp":"2024-08-24T21:41:14.100085+0000","last_deep_scrub":"165'25435","last_deep_scrub_stamp":"2024-08-24T21:41:14.100085+0000","last_clean_scrub_stamp":"2024-08-24T21:41:14.100085+0000","objects_scrubbed":4067,"log_size":10015,"log_dups_size":0,"ondisk_log_size":10015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":41,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T00:14:40.556530+0000","scrub_duration":40144,"objects_trimmed":0,"snaptrim_duration":0.00096400900000000005,"stat_sum":{"num_bytes":2659980271,"num_objects":4067,"num_object_clones":3542,"num_object_copies":8134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4067,"num_whiteouts":0,"num_read":36071,"num_read_kb":27990304,"num_write":17504,"num_write_kb":2596261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"165'34058","reported_seq":80696,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-24T21:41:14.072177+0000","last_change":"2024-08-24T21:41:14.072231+0000","last_active":"2024-08-24T21:41:14.072177+0000","last_peered":"2024-08-24T21:41:14.072177+0000","last_clean":"2024-08-24T21:41:14.072177+0000","last_became_active":"2024-08-24T21:10:54.739867+0000","last_became_peered":"2024-08-24T21:10:54.739867+0000","last_unstale":"2024-08-24T21:41:14.072177+0000","last_undegraded":"2024-08-24T21:41:14.072177+0000","last_fullsized":"2024-08-24T21:41:14.072177+0000","mapping_epoch":17,"log_start":"120'24028","ondisk_log_start":"120'24028","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"165'34058","last_scrub_stamp":"2024-08-24T21:41:14.072042+0000","last_deep_scrub":"165'34058","last_deep_scrub_stamp":"2024-08-24T21:41:14.072042+0000","last_clean_scrub_stamp":"2024-08-24T21:41:14.072042+0000","objects_scrubbed":4629,"log_size":10030,"log_dups_size":0,"ondisk_log_size":10030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":43,"scrub_schedule":"periodic scrub scheduled @ 2024-08-25T22:34:45.141993+0000","scrub_duration":42364,"objects_trimmed":0,"snaptrim_duration":0.00032487299999999999,"stat_sum":{"num_bytes":3343910484,"num_objects":4629,"num_object_clones":4068,"num_object_copies":9258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4629,"num_whiteouts":0,"num_read":174392,"num_read_kb":34621705,"num_write":23960,"num_write_kb":3248477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4625,"num_omap_keys":81,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"165'27912","reported_seq":64638,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-24T21:41:21.402410+0000","last_change":"2024-08-24T21:41:21.402448+0000","last_active":"2024-08-24T21:41:21.402410+0000","last_peered":"2024-08-24T21:41:21.402410+0000","last_clean":"2024-08-24T21:41:21.402410+0000","last_became_active":"2024-08-24T21:10:54.739290+0000","last_became_peered":"2024-08-24T21:10:54.739290+0000","last_unstale":"2024-08-24T21:41:21.402410+0000","last_undegraded":"2024-08-24T21:41:21.402410+0000","last_fullsized":"2024-08-24T21:41:21.402410+0000","mapping_epoch":17,"log_start":"128'17830","ondisk_log_start":"128'17830","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"165'27912","last_scrub_stamp":"2024-08-24T21:41:21.402325+0000","last_deep_scrub":"165'27912","last_deep_scrub_stamp":"2024-08-24T21:41:21.402325+0000","last_clean_scrub_stamp":"2024-08-24T21:41:21.402325+0000","objects_scrubbed":5308,"log_size":10082,"log_dups_size":0,"ondisk_log_size":10082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":45,"scrub_schedule":"periodic scrub scheduled @ 2024-08-25T23:44:33.438234+0000","scrub_duration":44427,"objects_trimmed":0,"snaptrim_duration":0.00041195799999999997,"stat_sum":{"num_bytes":3333325934,"num_objects":5308,"num_object_clones":4686,"num_object_copies":10616,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5308,"num_whiteouts":0,"num_read":40760,"num_read_kb":32068269,"num_write":17460,"num_write_kb":3254135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"165'25150","reported_seq":57315,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-24T21:41:13.992781+0000","last_change":"2024-08-24T21:41:13.992848+0000","last_active":"2024-08-24T21:41:13.992781+0000","last_peered":"2024-08-24T21:41:13.992781+0000","last_clean":"2024-08-24T21:41:13.992781+0000","last_became_active":"2024-08-24T21:10:54.741763+0000","last_became_peered":"2024-08-24T21:10:54.741763+0000","last_unstale":"2024-08-24T21:41:13.992781+0000","last_undegraded":"2024-08-24T21:41:13.992781+0000","last_fullsized":"2024-08-24T21:41:13.992781+0000","mapping_epoch":17,"log_start":"119'15113","ondisk_log_start":"119'15113","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"165'25150","last_scrub_stamp":"2024-08-24T21:41:13.992688+0000","last_deep_scrub":"165'25150","last_deep_scrub_stamp":"2024-08-24T21:41:13.992688+0000","last_clean_scrub_stamp":"2024-08-24T21:41:13.992688+0000","objects_scrubbed":4326,"log_size":10037,"log_dups_size":0,"ondisk_log_size":10037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":40,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T08:02:27.387293+0000","scrub_duration":39078,"objects_trimmed":0,"snaptrim_duration":0.00044521900000000001,"stat_sum":{"num_bytes":2751292542,"num_objects":4326,"num_object_clones":3779,"num_object_copies":8652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4326,"num_whiteouts":0,"num_read":35476,"num_read_kb":27207000,"num_write":16688,"num_write_kb":2682112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"165'74","reported_seq":427,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-24T21:40:35.965204+0000","last_change":"2024-08-24T21:40:35.965204+0000","last_active":"2024-08-24T21:40:35.965204+0000","last_peered":"2024-08-24T21:40:35.965204+0000","last_clean":"2024-08-24T21:40:35.965204+0000","last_became_active":"2024-08-24T21:10:48.522968+0000","last_became_peered":"2024-08-24T21:10:48.522968+0000","last_unstale":"2024-08-24T21:40:35.965204+0000","last_undegraded":"2024-08-24T21:40:35.965204+0000","last_fullsized":"2024-08-24T21:40:35.965204+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"165'74","last_scrub_stamp":"2024-08-24T21:40:35.965081+0000","last_deep_scrub":"165'74","last_deep_scrub_stamp":"2024-08-24T21:40:35.965081+0000","last_clean_scrub_stamp":"2024-08-24T21:40:35.965081+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-26T05:46:33.359006+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":23859064259,"num_objects":36315,"num_object_clones":31842,"num_object_copies":72630,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36315,"num_whiteouts":0,"num_read":558356,"num_read_kb":241182599,"num_write":158182,"num_write_kb":23264935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9354,"num_omap_keys":164,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":47629131776,"data_stored":64453999494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80360,"ondisk_log_size":80360,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575220,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9605972,"kb_used_data":9177860,"kb_used_omap":1,"kb_used_meta":428094,"kb_avail":84765868,"statfs":{"total":96636764160,"available":86800248832,"internally_reserved":0,"allocated":9398128640,"data_stored":12597758490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":438368715},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575220,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5936816,"kb_used_data":5685024,"kb_used_omap":1,"kb_used_meta":251774,"kb_avail":88435024,"statfs":{"total":96636764160,"available":90557464576,"internally_reserved":0,"allocated":5821464576,"data_stored":7669968994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":257817030},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575221,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5505728,"kb_used_data":5280304,"kb_used_omap":1,"kb_used_meta":225406,"kb_avail":88866112,"statfs":{"total":96636764160,"available":90998898688,"internally_reserved":0,"allocated":5407031296,"data_stored":7168891943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":230816197},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575221,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28968,"kb_used_data":1940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342872,"statfs":{"total":96636764160,"available":96607100928,"internally_reserved":0,"allocated":1986560,"data_stored":902074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575220,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3411736,"kb_used_data":3250120,"kb_used_omap":1,"kb_used_meta":161598,"kb_avail":90960104,"statfs":{"total":96636764160,"available":93143146496,"internally_reserved":0,"allocated":3328122880,"data_stored":4869306894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":165476807},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575222,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6206200,"kb_used_data":5932200,"kb_used_omap":1,"kb_used_meta":273982,"kb_avail":88165640,"statfs":{"total":96636764160,"available":90281615360,"internally_reserved":0,"allocated":6074572800,"data_stored":8657632908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":280558021},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575221,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11857292,"kb_used_data":11406908,"kb_used_omap":1,"kb_used_meta":450366,"kb_avail":82514548,"statfs":{"total":96636764160,"available":84494897152,"internally_reserved":0,"allocated":11680673792,"data_stored":15434675929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":461175237},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575221,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6123228,"kb_used_data":5795148,"kb_used_omap":1,"kb_used_meta":328062,"kb_avail":88248612,"statfs":{"total":96636764160,"available":90366578688,"internally_reserved":0,"allocated":5934231552,"data_stored":8063259590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":335935941},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5931651072,"data_stored":8061767148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11678687232,"data_stored":15433773855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6072586240,"data_stored":8656730834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3326136320,"data_stored":4868404820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5405044736,"data_stored":7167989869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5819478016,"data_stored":7669066920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9395548160,"data_stored":12596266048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-24T21:41:42.850 DEBUG:teuthology.orchestra.run.smithi060:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-08-24T21:41:43.234 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph_797669399b32d2915e64eb6d4b1257ae3c50f80b/qa/tasks/ceph.py", line 1980, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_797669399b32d2915e64eb6d4b1257ae3c50f80b/qa/tasks/mon_thrash.py", line 466, in task thrash_proc.stop_and_join() File "/home/teuthworker/src/git.ceph.com_ceph_797669399b32d2915e64eb6d4b1257ae3c50f80b/qa/tasks/mon_thrash.py", line 178, in stop_and_join return self.join() File "/home/teuthworker/src/git.ceph.com_ceph_797669399b32d2915e64eb6d4b1257ae3c50f80b/qa/tasks/mon_thrash.py", line 170, in join self.stopping.set() AttributeError: 'bool' object has no attribute 'set' 2024-08-24T21:41:43.236 INFO:teuthology.misc:Shutting down mds daemons... 2024-08-24T21:41:43.236 INFO:teuthology.misc:Shutting down osd daemons... 2024-08-24T21:41:43.236 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-08-24T21:41:43.237 INFO:teuthology.orchestra.run:waiting for 300 2024-08-24T21:41:49.339 INFO:tasks.ceph.osd.0:Stopped 2024-08-24T21:41:49.340 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-08-24T21:41:49.340 INFO:teuthology.orchestra.run:waiting for 300 2024-08-24T21:41:55.442 INFO:tasks.ceph.osd.1:Stopped 2024-08-24T21:41:55.443 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-08-24T21:41:55.443 INFO:teuthology.orchestra.run:waiting for 300 2024-08-24T21:41:55.540 INFO:tasks.ceph.osd.2:Stopped 2024-08-24T21:41:55.541 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-08-24T21:41:55.541 INFO:teuthology.orchestra.run:waiting for 300 2024-08-24T21:41:55.612 INFO:tasks.ceph.osd.3:Stopped 2024-08-24T21:41:55.613 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-08-24T21:41:55.613 INFO:teuthology.orchestra.run:waiting for 300 2024-08-24T21:41:55.659 INFO:tasks.ceph.osd.4:Stopped 2024-08-24T21:41:55.660 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-08-24T21:41:55.660 INFO:teuthology.orchestra.run:waiting for 300 2024-08-24T21:41:55.756 INFO:tasks.ceph.osd.5:Stopped 2024-08-24T21:41:55.756 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-08-24T21:41:55.756 INFO:teuthology.orchestra.run:waiting for 300 2024-08-24T21:41:55.842 INFO:tasks.ceph.osd.6:Stopped 2024-08-24T21:41:55.842 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-08-24T21:41:55.842 INFO:teuthology.orchestra.run:waiting for 300 2024-08-24T21:42:01.945 INFO:tasks.ceph.osd.7:Stopped 2024-08-24T21:42:01.945 INFO:teuthology.misc:Shutting down mgr daemons... 2024-08-24T21:42:01.945 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-08-24T21:42:01.945 INFO:teuthology.orchestra.run:waiting for 300 2024-08-24T21:42:02.013 INFO:tasks.ceph.mgr.x:Stopped 2024-08-24T21:42:02.013 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-08-24T21:42:02.014 INFO:teuthology.orchestra.run:waiting for 300 2024-08-24T21:42:02.085 INFO:tasks.ceph.mgr.y:Stopped 2024-08-24T21:42:02.085 INFO:teuthology.misc:Shutting down mon daemons... 2024-08-24T21:42:02.085 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-08-24T21:42:02.085 INFO:teuthology.orchestra.run:waiting for 300 2024-08-24T21:42:02.107 INFO:tasks.ceph.mon.a:Stopped 2024-08-24T21:42:02.107 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-08-24T21:42:02.108 INFO:teuthology.orchestra.run:waiting for 300 2024-08-24T21:42:02.170 INFO:tasks.ceph.mon.c:Stopped 2024-08-24T21:42:02.170 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-08-24T21:42:02.170 INFO:teuthology.orchestra.run:waiting for 300 2024-08-24T21:42:02.188 INFO:tasks.ceph.mon.b:Stopped 2024-08-24T21:42:02.189 INFO:tasks.ceph:Checking cluster log for badness... 2024-08-24T21:42:02.189 DEBUG:teuthology.orchestra.run.smithi060:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(MON_DOWN\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v SLOW_OPS | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v noscrub | egrep -v nodeep-scrub | head -n 1 2024-08-24T21:42:02.291 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi060.front.sepia.ceph.com 2024-08-24T21:42:02.291 DEBUG:teuthology.orchestra.run.smithi060:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-08-24T21:42:02.580 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi060.front.sepia.ceph.com 2024-08-24T21:42:02.581 DEBUG:teuthology.orchestra.run.smithi060:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-08-24T21:42:02.747 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi060.front.sepia.ceph.com 2024-08-24T21:42:02.748 DEBUG:teuthology.orchestra.run.smithi060:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-08-24T21:42:02.885 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi060.front.sepia.ceph.com 2024-08-24T21:42:02.886 DEBUG:teuthology.orchestra.run.smithi060:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-08-24T21:42:03.038 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi119.front.sepia.ceph.com 2024-08-24T21:42:03.038 DEBUG:teuthology.orchestra.run.smithi119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-08-24T21:42:03.236 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi119.front.sepia.ceph.com 2024-08-24T21:42:03.236 DEBUG:teuthology.orchestra.run.smithi119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-08-24T21:42:03.366 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi119.front.sepia.ceph.com 2024-08-24T21:42:03.367 DEBUG:teuthology.orchestra.run.smithi119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-08-24T21:42:03.509 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi119.front.sepia.ceph.com 2024-08-24T21:42:03.509 DEBUG:teuthology.orchestra.run.smithi119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-08-24T21:42:03.685 INFO:tasks.ceph:Archiving mon data... 2024-08-24T21:42:03.686 DEBUG:teuthology.misc:Transferring archived files from smithi060:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-08-17_20:48:17-krbd-main-testing-default-smithi/7858438/data/mon.a.tgz 2024-08-24T21:42:03.687 DEBUG:teuthology.orchestra.run.smithi060:> mktemp 2024-08-24T21:42:03.724 INFO:teuthology.orchestra.run.smithi060.stdout:/tmp/tmp.3iFHHPmPtw 2024-08-24T21:42:03.724 DEBUG:teuthology.orchestra.run.smithi060:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.3iFHHPmPtw 2024-08-24T21:42:03.941 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 0666 /tmp/tmp.3iFHHPmPtw 2024-08-24T21:42:04.035 DEBUG:teuthology.orchestra.remote:smithi060:/tmp/tmp.3iFHHPmPtw is 567KB 2024-08-24T21:42:04.130 DEBUG:teuthology.orchestra.run.smithi060:> rm -fr /tmp/tmp.3iFHHPmPtw 2024-08-24T21:42:04.167 DEBUG:teuthology.misc:Transferring archived files from smithi060:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-08-17_20:48:17-krbd-main-testing-default-smithi/7858438/data/mon.c.tgz 2024-08-24T21:42:04.168 DEBUG:teuthology.orchestra.run.smithi060:> mktemp 2024-08-24T21:42:04.242 INFO:teuthology.orchestra.run.smithi060.stdout:/tmp/tmp.fiY4PLr5T6 2024-08-24T21:42:04.242 DEBUG:teuthology.orchestra.run.smithi060:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.fiY4PLr5T6 2024-08-24T21:42:04.439 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 0666 /tmp/tmp.fiY4PLr5T6 2024-08-24T21:42:04.533 DEBUG:teuthology.orchestra.remote:smithi060:/tmp/tmp.fiY4PLr5T6 is 569KB 2024-08-24T21:42:04.629 DEBUG:teuthology.orchestra.run.smithi060:> rm -fr /tmp/tmp.fiY4PLr5T6 2024-08-24T21:42:04.663 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-08-17_20:48:17-krbd-main-testing-default-smithi/7858438/data/mon.b.tgz 2024-08-24T21:42:04.663 DEBUG:teuthology.orchestra.run.smithi119:> mktemp 2024-08-24T21:42:04.701 INFO:teuthology.orchestra.run.smithi119.stdout:/tmp/tmp.wz9U6W7lsQ 2024-08-24T21:42:04.701 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.wz9U6W7lsQ 2024-08-24T21:42:04.934 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 0666 /tmp/tmp.wz9U6W7lsQ 2024-08-24T21:42:05.026 DEBUG:teuthology.orchestra.remote:smithi119:/tmp/tmp.wz9U6W7lsQ is 568KB 2024-08-24T21:42:05.117 DEBUG:teuthology.orchestra.run.smithi119:> rm -fr /tmp/tmp.wz9U6W7lsQ 2024-08-24T21:42:05.153 INFO:tasks.ceph:Cleaning ceph cluster... 2024-08-24T21:42:05.153 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-08-24T21:42:05.157 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-08-24T21:42:05.198 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-08-24T21:42:05.295 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-08-24T21:42:05.330 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-08-24T21:42:05.366 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-08-24T21:42:05.367 INFO:tasks.ceph:Archiving crash dumps... 2024-08-24T21:42:05.368 DEBUG:teuthology.misc:Transferring archived files from smithi060:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-08-17_20:48:17-krbd-main-testing-default-smithi/7858438/remote/smithi060/crash 2024-08-24T21:42:05.369 DEBUG:teuthology.orchestra.run.smithi060:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-08-24T21:42:05.425 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-08-17_20:48:17-krbd-main-testing-default-smithi/7858438/remote/smithi119/crash 2024-08-24T21:42:05.426 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-08-24T21:42:05.480 DEBUG:teuthology.misc:Transferring archived files from smithi179:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-08-17_20:48:17-krbd-main-testing-default-smithi/7858438/remote/smithi179/crash 2024-08-24T21:42:05.480 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-08-24T21:42:05.537 INFO:tasks.ceph:Compressing logs... 2024-08-24T21:42:05.537 DEBUG:teuthology.orchestra.run.smithi060:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-24T21:42:05.546 DEBUG:teuthology.orchestra.run.smithi119:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-24T21:42:05.558 DEBUG:teuthology.orchestra.run.smithi179:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-24T21:42:05.598 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24893.log 2024-08-24T21:42:05.599 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45668.log 2024-08-24T21:42:05.603 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.24893.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24893.log.gz 2024-08-24T21:42:05.603 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47093.log 2024-08-24T21:42:05.604 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.45668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25413.log 2024-08-24T21:42:05.604 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45668.log.gz 2024-08-24T21:42:05.604 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.47093.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47093.log.gz 2024-08-24T21:42:05.604 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26043.log 2024-08-24T21:42:05.607 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.25413.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25413.log.gz 2024-08-24T21:42:05.607 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27009.log 2024-08-24T21:42:05.607 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.26043.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26043.log.gz 2024-08-24T21:42:05.607 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46088.log 2024-08-24T21:42:05.607 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.27009.log: gzip 0.0% -5 --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.27009.log.gz /var/log/ceph/ceph-client.admin.47933.log 2024-08-24T21:42:05.607 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-08-24T21:42:05.607 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46088.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46088.log.gz -5 2024-08-24T21:42:05.607 INFO:teuthology.orchestra.run.smithi060.stderr: --verbose -- /var/log/ceph/ceph-client.admin.46273.log 2024-08-24T21:42:05.608 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.47933.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47933.log.gz 2024-08-24T21:42:05.608 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27572.log 2024-08-24T21:42:05.608 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46273.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46273.log.gz 2024-08-24T21:42:05.608 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44683.log 2024-08-24T21:42:05.608 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.27572.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27572.log.gz 2024-08-24T21:42:05.608 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27614.log 2024-08-24T21:42:05.612 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18446.log 2024-08-24T21:42:05.613 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-08-24T21:42:05.613 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.18446.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18446.log.gz 2024-08-24T21:42:05.613 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-08-24T21:42:05.613 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-08-24T21:42:05.613 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18206.log 2024-08-24T21:42:05.613 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18406.log 2024-08-24T21:42:05.613 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.18206.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18206.log.gz 2024-08-24T21:42:05.613 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18486.log 2024-08-24T21:42:05.616 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.44683.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44683.log.gzgzip 2024-08-24T21:42:05.616 INFO:teuthology.orchestra.run.smithi060.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.28791.log 2024-08-24T21:42:05.616 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.27614.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27614.log.gz 2024-08-24T21:42:05.616 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34737.log 2024-08-24T21:42:05.617 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.28791.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28791.log.gz 2024-08-24T21:42:05.617 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33251.log 2024-08-24T21:42:05.617 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.34737.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34737.log.gz 2024-08-24T21:42:05.617 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33503.log 2024-08-24T21:42:05.617 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.33251.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33251.log.gz 2024-08-24T21:42:05.617 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28581.log 2024-08-24T21:42:05.617 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.33503.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33503.log.gz 2024-08-24T21:42:05.617 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25329.log 2024-08-24T21:42:05.617 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.28581.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.28581.log.gz -5 2024-08-24T21:42:05.618 INFO:teuthology.orchestra.run.smithi060.stderr: --verbose -- /var/log/ceph/ceph-client.admin.30031.log 2024-08-24T21:42:05.618 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.25329.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25329.log.gz 2024-08-24T21:42:05.618 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33858.log 2024-08-24T21:42:05.618 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.30031.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30031.log.gz 2024-08-24T21:42:05.618 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40058.log 2024-08-24T21:42:05.618 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.33858.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33858.log.gz 2024-08-24T21:42:05.618 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31239.log 2024-08-24T21:42:05.618 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.40058.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40058.log.gz 2024-08-24T21:42:05.618 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43533.log 2024-08-24T21:42:05.618 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.31239.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31239.log.gz 2024-08-24T21:42:05.618 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33293.log 2024-08-24T21:42:05.623 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18326.log 2024-08-24T21:42:05.623 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.18406.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18406.log.gz 2024-08-24T21:42:05.623 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.18486.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18486.log.gz 2024-08-24T21:42:05.623 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-08-24T21:42:05.623 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18366.log 2024-08-24T21:42:05.623 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.18326.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18326.log.gz 2024-08-24T21:42:05.623 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-08-24T21:42:05.623 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.18366.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18366.log.gz 2024-08-24T21:42:05.623 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18286.log 2024-08-24T21:42:05.624 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-08-24T21:42:05.624 INFO:teuthology.orchestra.run.smithi119.stderr: 87.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-08-24T21:42:05.624 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.18286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18246.log 2024-08-24T21:42:05.624 INFO:teuthology.orchestra.run.smithi119.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18286.log.gz 2024-08-24T21:42:05.624 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-08-24T21:42:05.624 INFO:teuthology.orchestra.run.smithi119.stderr: 90.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-08-24T21:42:05.624 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.18246.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-08-24T21:42:05.624 INFO:teuthology.orchestra.run.smithi119.stderr: -- replaced with /var/log/ceph/ceph-client.admin.18246.log.gz 2024-08-24T21:42:05.630 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33629.log 2024-08-24T21:42:05.630 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43533.log.gz 2024-08-24T21:42:05.630 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.33293.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33293.log.gz 2024-08-24T21:42:05.630 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46483.log 2024-08-24T21:42:05.630 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.33629.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33629.log.gz 2024-08-24T21:42:05.630 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47009.log 2024-08-24T21:42:05.630 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46483.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46483.log.gz 2024-08-24T21:42:05.631 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40368.log 2024-08-24T21:42:05.631 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.47009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35947.log 0.0% 2024-08-24T21:42:05.631 INFO:teuthology.orchestra.run.smithi060.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47009.log.gz 2024-08-24T21:42:05.631 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.40368.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.40368.log.gz /var/log/ceph/ceph-client.admin.46231.log 2024-08-24T21:42:05.631 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-08-24T21:42:05.631 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.35947.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35947.log.gz 2024-08-24T21:42:05.631 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39201.log 2024-08-24T21:42:05.631 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46231.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.46231.log.gz -- 2024-08-24T21:42:05.631 INFO:teuthology.orchestra.run.smithi060.stderr: /var/log/ceph/ceph-client.admin.36073.log 2024-08-24T21:42:05.631 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.39201.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.39201.log.gz -5 2024-08-24T21:42:05.631 INFO:teuthology.orchestra.run.smithi060.stderr: --verbose -- /var/log/ceph/ceph-client.admin.42151.log 2024-08-24T21:42:05.631 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.36073.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.36073.log.gz 2024-08-24T21:42:05.631 INFO:teuthology.orchestra.run.smithi060.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.36804.log 2024-08-24T21:42:05.632 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42151.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42151.log.gz 2024-08-24T21:42:05.632 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29231.log 2024-08-24T21:42:05.632 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.36804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35863.log 2024-08-24T21:42:05.632 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36804.log.gz 2024-08-24T21:42:05.632 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.29231.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29231.log.gz 2024-08-24T21:42:05.632 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37056.log 2024-08-24T21:42:05.632 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.35863.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35863.log.gz 2024-08-24T21:42:05.632 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28076.log 2024-08-24T21:42:05.632 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.37056.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.37056.log.gz 2024-08-24T21:42:05.632 INFO:teuthology.orchestra.run.smithi060.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.25623.log 2024-08-24T21:42:05.632 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.28076.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28076.log.gz 2024-08-24T21:42:05.632 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35821.log 2024-08-24T21:42:05.633 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.25623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33167.log 2024-08-24T21:42:05.633 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25623.log.gz 2024-08-24T21:42:05.633 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.35821.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35821.log.gz 2024-08-24T21:42:05.633 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43139.log 2024-08-24T21:42:05.646 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20230.log 2024-08-24T21:42:05.646 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19169.log 2024-08-24T21:42:05.646 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.20230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19925.log 2024-08-24T21:42:05.646 INFO:teuthology.orchestra.run.smithi179.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20230.log.gz 2024-08-24T21:42:05.646 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.19169.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19169.log.gz 2024-08-24T21:42:05.646 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14189.log 2024-08-24T21:42:05.646 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.19925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22714.log 2024-08-24T21:42:05.646 INFO:teuthology.orchestra.run.smithi179.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19925.log.gz 2024-08-24T21:42:05.646 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.14189.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14189.log.gz 2024-08-24T21:42:05.647 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.13434.log 2024-08-24T21:42:05.647 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.22714.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22714.log.gz 2024-08-24T21:42:05.647 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19559.log 2024-08-24T21:42:05.647 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.13434.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.13434.log.gz 2024-08-24T21:42:05.647 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16535.log 2024-08-24T21:42:05.647 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.19559.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19559.log.gz 2024-08-24T21:42:05.647 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17312.log 2024-08-24T21:42:05.647 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.16535.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.16535.log.gz 2024-08-24T21:42:05.647 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18629.log 2024-08-24T21:42:05.647 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.17312.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.17312.log.gz --verbose 2024-08-24T21:42:05.647 INFO:teuthology.orchestra.run.smithi179.stderr: -- /var/log/ceph/ceph-client.admin.18392.log 2024-08-24T21:42:05.647 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.18629.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.18629.log.gz --verbose 2024-08-24T21:42:05.648 INFO:teuthology.orchestra.run.smithi179.stderr: -- /var/log/ceph/ceph-client.admin.14335.log 2024-08-24T21:42:05.648 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.18392.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18392.log.gz 2024-08-24T21:42:05.648 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17032.log 2024-08-24T21:42:05.648 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.14335.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.14335.log.gz --verbose 2024-08-24T21:42:05.648 INFO:teuthology.orchestra.run.smithi179.stderr: -- /var/log/ceph/ceph-client.admin.19840.log 2024-08-24T21:42:05.648 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.17032.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.17032.log.gz -5 2024-08-24T21:42:05.648 INFO:teuthology.orchestra.run.smithi179.stderr: --verbose -- /var/log/ceph/ceph-client.admin.22909.log 2024-08-24T21:42:05.648 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.19840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.13513.log 2024-08-24T21:42:05.648 INFO:teuthology.orchestra.run.smithi179.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19840.log.gz 2024-08-24T21:42:05.648 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.22909.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22909.log.gz 2024-08-24T21:42:05.648 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16751.log 2024-08-24T21:42:05.648 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.13513.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.13513.log.gz /var/log/ceph/ceph-client.admin.16361.log 2024-08-24T21:42:05.648 INFO:teuthology.orchestra.run.smithi179.stderr: 2024-08-24T21:42:05.649 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.16751.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.16751.log.gz 2024-08-24T21:42:05.649 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14022.log 2024-08-24T21:42:05.649 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.16361.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.16361.log.gz 2024-08-24T21:42:05.649 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15074.log 2024-08-24T21:42:05.649 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.14022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15691.log 2024-08-24T21:42:05.649 INFO:teuthology.orchestra.run.smithi179.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14022.log.gz 2024-08-24T21:42:05.649 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.15074.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15074.log.gz -5 2024-08-24T21:42:05.649 INFO:teuthology.orchestra.run.smithi179.stderr: --verbose -- /var/log/ceph/ceph-client.admin.21246.log 2024-08-24T21:42:05.649 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.15691.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15691.log.gz 2024-08-24T21:42:05.649 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14252.log 2024-08-24T21:42:05.649 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.21246.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.21246.log.gz -5 2024-08-24T21:42:05.649 INFO:teuthology.orchestra.run.smithi179.stderr: --verbose -- /var/log/ceph/ceph-client.admin.18328.log 2024-08-24T21:42:05.650 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.14252.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14252.log.gz -5 2024-08-24T21:42:05.650 INFO:teuthology.orchestra.run.smithi179.stderr: --verbose -- /var/log/ceph/ceph-client.admin.22218.log 2024-08-24T21:42:05.650 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.18328.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.18328.log.gz --verbose 2024-08-24T21:42:05.650 INFO:teuthology.orchestra.run.smithi179.stderr: -- /var/log/ceph/ceph-client.admin.18998.log 2024-08-24T21:42:05.650 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.22218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21700.log 2024-08-24T21:42:05.650 INFO:teuthology.orchestra.run.smithi179.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22218.log.gz 2024-08-24T21:42:05.650 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.18998.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.18998.log.gz -- 2024-08-24T21:42:05.650 INFO:teuthology.orchestra.run.smithi179.stderr: /var/log/ceph/ceph-client.admin.17788.log 2024-08-24T21:42:05.650 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.21700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22087.log 2024-08-24T21:42:05.650 INFO:teuthology.orchestra.run.smithi179.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21700.log.gz 2024-08-24T21:42:05.650 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.17788.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17788.log.gzgzip 2024-08-24T21:42:05.650 INFO:teuthology.orchestra.run.smithi179.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.13250.log 2024-08-24T21:42:05.651 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.33167.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33167.log.gz 2024-08-24T21:42:05.651 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26463.log 2024-08-24T21:42:05.651 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43139.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43139.log.gz 2024-08-24T21:42:05.651 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25581.log 2024-08-24T21:42:05.651 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.26463.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.26463.log.gz -5 2024-08-24T21:42:05.651 INFO:teuthology.orchestra.run.smithi060.stderr: --verbose -- /var/log/ceph/ceph-mon.c.log 2024-08-24T21:42:05.651 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.25581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27530.log 2024-08-24T21:42:05.651 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25581.log.gz 2024-08-24T21:42:05.651 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23785.log 2024-08-24T21:42:05.651 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.27530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48775.log 2024-08-24T21:42:05.651 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27530.log.gz 2024-08-24T21:42:05.651 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.23785.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23785.log.gz 2024-08-24T21:42:05.651 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33981.log 2024-08-24T21:42:05.652 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.48775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39931.log 2024-08-24T21:42:05.652 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48775.log.gz 2024-08-24T21:42:05.652 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.33981.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33981.log.gz 2024-08-24T21:42:05.652 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43827.log 2024-08-24T21:42:05.652 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.39931.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39931.log.gz 2024-08-24T21:42:05.652 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25455.log 2024-08-24T21:42:05.652 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43827.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43827.log.gz 2024-08-24T21:42:05.652 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30325.log 2024-08-24T21:42:05.652 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.25455.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25455.log.gz 2024-08-24T21:42:05.652 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43407.log 2024-08-24T21:42:05.652 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.30325.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30325.log.gz 2024-08-24T21:42:05.652 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23598.log 2024-08-24T21:42:05.652 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43407.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43407.log.gz 2024-08-24T21:42:05.653 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38739.log 2024-08-24T21:42:05.653 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.23598.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23598.log.gz 2024-08-24T21:42:05.653 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31803.log 2024-08-24T21:42:05.653 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.38739.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38739.log.gz 2024-08-24T21:42:05.653 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42845.log 2024-08-24T21:42:05.653 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.31803.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31803.log.gz 2024-08-24T21:42:05.653 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45794.log 2024-08-24T21:42:05.653 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42845.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42845.log.gz 2024-08-24T21:42:05.653 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24121.log 2024-08-24T21:42:05.653 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.45794.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45794.log.gz 2024-08-24T21:42:05.653 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46315.log 2024-08-24T21:42:05.653 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.24121.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24121.log.gz 2024-08-24T21:42:05.654 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45146.log 2024-08-24T21:42:05.654 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46315.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46315.log.gz 2024-08-24T21:42:05.654 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38130.log 2024-08-24T21:42:05.671 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.22087.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.22087.log.gz --verbose 2024-08-24T21:42:05.671 INFO:teuthology.orchestra.run.smithi179.stderr: -- /var/log/ceph/ceph-client.admin.17399.log 2024-08-24T21:42:05.671 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.13250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19796.log 2024-08-24T21:42:05.671 INFO:teuthology.orchestra.run.smithi179.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.13250.log.gz 2024-08-24T21:42:05.671 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.17399.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.17399.log.gz 2024-08-24T21:42:05.671 INFO:teuthology.orchestra.run.smithi179.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.21871.log 2024-08-24T21:42:05.672 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.19796.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19796.log.gz 2024-08-24T21:42:05.672 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17615.log 2024-08-24T21:42:05.672 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.21871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20922.log 2024-08-24T21:42:05.672 INFO:teuthology.orchestra.run.smithi179.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21871.log.gz 2024-08-24T21:42:05.672 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.17615.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17615.log.gz 2024-08-24T21:42:05.672 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16427.log 2024-08-24T21:42:05.672 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.20922.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.20922.log.gz -- 2024-08-24T21:42:05.672 INFO:teuthology.orchestra.run.smithi179.stderr: /var/log/ceph/ceph-client.admin.15389.log 2024-08-24T21:42:05.672 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.16427.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.16427.log.gz 2024-08-24T21:42:05.672 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21808.log 2024-08-24T21:42:05.672 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.15389.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15389.log.gzgzip 2024-08-24T21:42:05.672 INFO:teuthology.orchestra.run.smithi179.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.22456.log 2024-08-24T21:42:05.673 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.21808.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21808.log.gz 2024-08-24T21:42:05.673 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14078.log 2024-08-24T21:42:05.673 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.22456.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22456.log.gz 2024-08-24T21:42:05.673 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21655.log 2024-08-24T21:42:05.673 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.14078.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14078.log.gz 2024-08-24T21:42:05.673 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22650.log 2024-08-24T21:42:05.673 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.21655.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.21655.log.gz -5 2024-08-24T21:42:05.673 INFO:teuthology.orchestra.run.smithi179.stderr: --verbose -- /var/log/ceph/ceph-client.admin.18004.log 2024-08-24T21:42:05.673 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.22650.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22650.log.gz 2024-08-24T21:42:05.673 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18068.log 2024-08-24T21:42:05.673 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.18004.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18004.log.gz 2024-08-24T21:42:05.673 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21937.log 2024-08-24T21:42:05.673 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.18068.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18068.log.gz 2024-08-24T21:42:05.674 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.13680.log 2024-08-24T21:42:05.674 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.21937.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21937.log.gz 2024-08-24T21:42:05.674 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16772.log 2024-08-24T21:42:05.674 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.13680.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.13680.log.gz 2024-08-24T21:42:05.674 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.13981.log 2024-08-24T21:42:05.674 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.16772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14648.log 2024-08-24T21:42:05.674 INFO:teuthology.orchestra.run.smithi179.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.16772.log.gz 2024-08-24T21:42:05.674 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.13981.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.13981.log.gzgzip 2024-08-24T21:42:05.674 INFO:teuthology.orchestra.run.smithi179.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.23146.log 2024-08-24T21:42:05.674 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.14648.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14648.log.gz 2024-08-24T21:42:05.674 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19775.log 2024-08-24T21:42:05.675 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.23146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15734.log 2024-08-24T21:42:05.675 INFO:teuthology.orchestra.run.smithi179.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23146.log.gz 2024-08-24T21:42:05.675 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.19775.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19775.log.gz 2024-08-24T21:42:05.675 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19192.log 2024-08-24T21:42:05.675 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.15734.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15734.log.gz 2024-08-24T21:42:05.675 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22888.log 2024-08-24T21:42:05.675 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.19192.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.19192.log.gz -5 2024-08-24T21:42:05.675 INFO:teuthology.orchestra.run.smithi179.stderr: --verbose -- /var/log/ceph/ceph-client.admin.16340.log 2024-08-24T21:42:05.675 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.22888.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.22888.log.gz -5 2024-08-24T21:42:05.675 INFO:teuthology.orchestra.run.smithi179.stderr: --verbose -- /var/log/ceph/ceph-client.admin.20899.log 2024-08-24T21:42:05.675 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.16340.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.16340.log.gz --verbose 2024-08-24T21:42:05.675 INFO:teuthology.orchestra.run.smithi179.stderr: -- /var/log/ceph/ceph-client.admin.22780.log 2024-08-24T21:42:05.675 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.20899.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20899.log.gz 2024-08-24T21:42:05.676 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.13918.log 2024-08-24T21:42:05.676 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.22780.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22780.log.gz 2024-08-24T21:42:05.676 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14540.log 2024-08-24T21:42:05.676 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.13918.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.13918.log.gz 2024-08-24T21:42:05.676 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18371.log 2024-08-24T21:42:05.676 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.14540.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14540.log.gz -5 2024-08-24T21:42:05.676 INFO:teuthology.orchestra.run.smithi179.stderr: --verbose -- /var/log/ceph/ceph-client.admin.13375.log 2024-08-24T21:42:05.676 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.18371.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18371.log.gz 2024-08-24T21:42:05.676 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23383.log 2024-08-24T21:42:05.676 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.13375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16168.log 2024-08-24T21:42:05.676 INFO:teuthology.orchestra.run.smithi179.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.13375.log.gz 2024-08-24T21:42:05.701 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.45146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47807.log 2024-08-24T21:42:05.701 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45146.log.gz 2024-08-24T21:42:05.701 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.38130.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38130.log.gz 2024-08-24T21:42:05.701 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39243.log 2024-08-24T21:42:05.701 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.47807.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47807.log.gz 2024-08-24T21:42:05.702 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42445.log 2024-08-24T21:42:05.702 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.39243.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.39243.log.gz --verbose 2024-08-24T21:42:05.702 INFO:teuthology.orchestra.run.smithi060.stderr: -- /var/log/ceph/ceph-client.admin.36972.log 2024-08-24T21:42:05.702 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42445.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42445.log.gz 2024-08-24T21:42:05.702 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.12506.log 2024-08-24T21:42:05.702 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.36972.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36972.log.gz 2024-08-24T21:42:05.702 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38697.log 2024-08-24T21:42:05.702 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph.tmp-client.admin.12506.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.12506.log.gz 2024-08-24T21:42:05.702 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29567.log 2024-08-24T21:42:05.702 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.38697.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38697.log.gz 2024-08-24T21:42:05.702 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28161.log 2024-08-24T21:42:05.703 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.29567.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29567.log.gz 2024-08-24T21:42:05.703 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26505.log 2024-08-24T21:42:05.703 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.28161.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28161.log.gz 2024-08-24T21:42:05.703 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22917.log 2024-08-24T21:42:05.703 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.26505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40830.log 2024-08-24T21:42:05.703 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26505.log.gz 2024-08-24T21:42:05.703 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.22917.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22917.log.gz 2024-08-24T21:42:05.703 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42277.log 2024-08-24T21:42:05.703 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.40830.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40830.log.gz 2024-08-24T21:42:05.703 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48983.log 2024-08-24T21:42:05.703 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42277.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42277.log.gz 2024-08-24T21:42:05.704 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33587.log 2024-08-24T21:42:05.704 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.48983.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48983.log.gz 2024-08-24T21:42:05.704 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32857.log 2024-08-24T21:42:05.704 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.33587.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33587.log.gz 2024-08-24T21:42:05.704 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32689.log 2024-08-24T21:42:05.704 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.32857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29777.log 2024-08-24T21:42:05.704 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32857.log.gz 2024-08-24T21:42:05.704 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.32689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44641.log 2024-08-24T21:42:05.704 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32689.log.gz 2024-08-24T21:42:05.704 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.29777.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29777.log.gz 2024-08-24T21:42:05.704 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31323.log 2024-08-24T21:42:05.705 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.44641.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44641.log.gz 2024-08-24T21:42:05.705 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25248.log 2024-08-24T21:42:05.705 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.31323.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31323.log.gz 2024-08-24T21:42:05.705 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44137.log 2024-08-24T21:42:05.705 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.25248.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25248.log.gz 2024-08-24T21:42:05.705 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34401.log 2024-08-24T21:42:05.705 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.44137.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.44137.log.gz -- 2024-08-24T21:42:05.705 INFO:teuthology.orchestra.run.smithi060.stderr: /var/log/ceph/ceph-client.admin.45878.log 2024-08-24T21:42:05.705 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.34401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37308.log 2024-08-24T21:42:05.705 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34401.log.gz 2024-08-24T21:42:05.706 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.45878.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45878.log.gz 2024-08-24T21:42:05.706 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36426.log 2024-08-24T21:42:05.706 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.37308.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37308.log.gz 2024-08-24T21:42:05.706 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33797.log 2024-08-24T21:42:05.706 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.36426.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36426.log.gz 2024-08-24T21:42:05.706 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48733.log 2024-08-24T21:42:05.706 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.33797.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33797.log.gz 2024-08-24T21:42:05.706 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32058.log 2024-08-24T21:42:05.706 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.48733.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48733.log.gz 2024-08-24T21:42:05.706 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26589.log 2024-08-24T21:42:05.706 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.32058.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32058.log.gz 2024-08-24T21:42:05.707 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23590.log 2024-08-24T21:42:05.707 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.26589.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26589.log.gz 2024-08-24T21:42:05.707 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42760.log 2024-08-24T21:42:05.707 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.23590.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23590.log.gz 2024-08-24T21:42:05.707 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23827.log 2024-08-24T21:42:05.707 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42760.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42760.log.gz 2024-08-24T21:42:05.707 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46004.log 2024-08-24T21:42:05.707 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.23827.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23827.log.gz 2024-08-24T21:42:05.707 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43181.log 2024-08-24T21:42:05.707 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46004.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46004.log.gz 2024-08-24T21:42:05.707 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35175.log 2024-08-24T21:42:05.707 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43181.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43181.log.gz 2024-08-24T21:42:05.708 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25959.log 2024-08-24T21:42:05.708 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.35175.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35175.log.gz 2024-08-24T21:42:05.708 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26967.log 2024-08-24T21:42:05.708 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.25959.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25959.log.gz 2024-08-24T21:42:05.708 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30987.log 2024-08-24T21:42:05.708 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.26967.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26967.log.gz 2024-08-24T21:42:05.708 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47387.log 2024-08-24T21:42:05.708 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.30987.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30987.log.gz 2024-08-24T21:42:05.708 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28034.log 2024-08-24T21:42:05.708 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.47387.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47387.log.gz 2024-08-24T21:42:05.708 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42590.log 2024-08-24T21:42:05.708 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.28034.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28034.log.gz 2024-08-24T21:42:05.709 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42025.log 2024-08-24T21:42:05.709 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42590.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42590.log.gz 2024-08-24T21:42:05.709 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39973.log 2024-08-24T21:42:05.709 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42025.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42025.log.gz 2024-08-24T21:42:05.709 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42403.log 2024-08-24T21:42:05.709 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.39973.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39973.log.gz 2024-08-24T21:42:05.709 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26925.log 2024-08-24T21:42:05.709 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42403.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42403.log.gz 2024-08-24T21:42:05.709 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39763.log 2024-08-24T21:42:05.709 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.26925.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26925.log.gz 2024-08-24T21:42:05.709 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25707.log 2024-08-24T21:42:05.709 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.39763.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39763.log.gz 2024-08-24T21:42:05.710 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24247.log 2024-08-24T21:42:05.710 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.25707.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25707.log.gz 2024-08-24T21:42:05.710 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25833.log 2024-08-24T21:42:05.710 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.24247.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24247.log.gz 2024-08-24T21:42:05.710 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39637.log 2024-08-24T21:42:05.710 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.25833.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25833.log.gz 2024-08-24T21:42:05.710 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46399.log 2024-08-24T21:42:05.710 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.39637.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39637.log.gz 2024-08-24T21:42:05.710 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24205.log 2024-08-24T21:42:05.710 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30735.log 2024-08-24T21:42:05.710 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46399.log.gz 2024-08-24T21:42:05.710 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.24205.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24205.log.gz 2024-08-24T21:42:05.711 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34485.log 2024-08-24T21:42:05.711 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.30735.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30735.log.gz 2024-08-24T21:42:05.711 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38298.log 2024-08-24T21:42:05.711 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.34485.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34485.log.gz 2024-08-24T21:42:05.711 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33939.log 2024-08-24T21:42:05.711 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.38298.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38298.log.gz 2024-08-24T21:42:05.711 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23531.log 2024-08-24T21:42:05.711 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.33939.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33939.log.gz 2024-08-24T21:42:05.711 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37224.log 2024-08-24T21:42:05.711 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.23531.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23531.log.gz 2024-08-24T21:42:05.711 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28203.log 2024-08-24T21:42:05.711 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.37224.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37224.log.gz 2024-08-24T21:42:05.712 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24977.log 2024-08-24T21:42:05.712 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.28203.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28203.log.gz 2024-08-24T21:42:05.712 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32100.log 2024-08-24T21:42:05.712 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.24977.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24977.log.gz 2024-08-24T21:42:05.712 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44347.log 2024-08-24T21:42:05.712 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.32100.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32100.log.gz 2024-08-24T21:42:05.712 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47597.log 2024-08-24T21:42:05.712 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.44347.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44347.log.gz 2024-08-24T21:42:05.712 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37820.log 2024-08-24T21:42:05.712 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.47597.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47597.log.gz 2024-08-24T21:42:05.712 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27488.log 2024-08-24T21:42:05.713 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.37820.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37820.log.gz 2024-08-24T21:42:05.713 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42109.log 2024-08-24T21:42:05.713 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.27488.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27488.log.gz 2024-08-24T21:42:05.713 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26421.log 2024-08-24T21:42:05.713 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42109.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42109.log.gz 2024-08-24T21:42:05.713 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38508.log 2024-08-24T21:42:05.713 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.26421.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26421.log.gz 2024-08-24T21:42:05.713 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32521.log 2024-08-24T21:42:05.713 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.38508.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38508.log.gz 2024-08-24T21:42:05.713 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23248.log 2024-08-24T21:42:05.713 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.32521.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32521.log.gz 2024-08-24T21:42:05.713 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36846.log 2024-08-24T21:42:05.714 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.23248.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23248.log.gz 2024-08-24T21:42:05.714 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44263.log 2024-08-24T21:42:05.757 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.36846.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36846.log.gz 2024-08-24T21:42:05.758 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47555.log 2024-08-24T21:42:05.758 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.44263.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44263.log.gz 2024-08-24T21:42:05.758 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25539.log 2024-08-24T21:42:05.758 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.47555.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47555.log.gz 2024-08-24T21:42:05.758 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45836.log 2024-08-24T21:42:05.758 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.25539.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25539.log.gz 2024-08-24T21:42:05.758 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41504.log 2024-08-24T21:42:05.758 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.45836.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45836.log.gz 2024-08-24T21:42:05.758 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26799.log 2024-08-24T21:42:05.758 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.41504.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41504.log.gz 2024-08-24T21:42:05.758 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35653.log 2024-08-24T21:42:05.759 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.26799.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26799.log.gz 2024-08-24T21:42:05.759 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36678.log 2024-08-24T21:42:05.759 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.35653.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35653.log.gz 2024-08-24T21:42:05.759 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48060.log 2024-08-24T21:42:05.759 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.36678.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36678.log.gz 2024-08-24T21:42:05.759 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45566.log 2024-08-24T21:42:05.759 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.48060.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48060.log.gz 2024-08-24T21:42:05.759 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27908.log 2024-08-24T21:42:05.759 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.45566.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45566.log.gz 2024-08-24T21:42:05.759 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43969.log 2024-08-24T21:42:05.759 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.27908.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27908.log.gz 2024-08-24T21:42:05.759 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46863.log 2024-08-24T21:42:05.760 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43969.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43969.log.gz 2024-08-24T21:42:05.760 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29441.log 2024-08-24T21:42:05.760 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46863.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46863.log.gz 2024-08-24T21:42:05.760 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26337.log 2024-08-24T21:42:05.760 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.29441.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29441.log.gz 2024-08-24T21:42:05.760 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30495.log 2024-08-24T21:42:05.760 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.26337.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26337.log.gz 2024-08-24T21:42:05.760 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37438.log 2024-08-24T21:42:05.760 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.30495.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30495.log.gzgzip 2024-08-24T21:42:05.760 INFO:teuthology.orchestra.run.smithi060.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.23953.log 2024-08-24T21:42:05.760 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.37438.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37438.log.gz 2024-08-24T21:42:05.760 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40326.log 2024-08-24T21:42:05.761 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.23953.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23953.log.gz 2024-08-24T21:42:05.761 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22911.log 2024-08-24T21:42:05.761 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.40326.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40326.log.gz 2024-08-24T21:42:05.761 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41083.log 2024-08-24T21:42:05.761 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.22911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23253.log 2024-08-24T21:42:05.761 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22911.log.gz 2024-08-24T21:42:05.761 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.41083.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41083.log.gz 2024-08-24T21:42:05.761 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23185.log 2024-08-24T21:42:05.761 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.23253.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23253.log.gz 2024-08-24T21:42:05.761 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41293.log 2024-08-24T21:42:05.761 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.23185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28413.log 2024-08-24T21:42:05.761 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23185.log.gz 2024-08-24T21:42:05.761 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.41293.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41293.log.gz 2024-08-24T21:42:05.762 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24373.log 2024-08-24T21:42:05.762 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.28413.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28413.log.gz 2024-08-24T21:42:05.762 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40788.log 2024-08-24T21:42:05.762 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.24373.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24373.log.gz 2024-08-24T21:42:05.762 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34023.log 2024-08-24T21:42:05.762 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.40788.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40788.log.gz 2024-08-24T21:42:05.762 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44977.log 2024-08-24T21:42:05.762 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.34023.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34023.log.gz 2024-08-24T21:42:05.762 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39553.log 2024-08-24T21:42:05.762 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.44977.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44977.log.gz 2024-08-24T21:42:05.762 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41899.log 2024-08-24T21:42:05.762 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.39553.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39553.log.gz 2024-08-24T21:42:05.762 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45314.log 2024-08-24T21:42:05.763 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.41899.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.41899.log.gz 2024-08-24T21:42:05.763 INFO:teuthology.orchestra.run.smithi060.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.23600.log 2024-08-24T21:42:05.763 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.45314.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45314.log.gz 2024-08-24T21:42:05.763 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32268.log 2024-08-24T21:42:05.763 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.23600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45398.log 2024-08-24T21:42:05.763 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23600.log.gz 2024-08-24T21:42:05.763 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.32268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41692.log 2024-08-24T21:42:05.763 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32268.log.gz 2024-08-24T21:42:05.763 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.45398.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45398.log.gz -5 2024-08-24T21:42:05.763 INFO:teuthology.orchestra.run.smithi060.stderr: --verbose -- /var/log/ceph/ceph-client.admin.32605.log 2024-08-24T21:42:05.763 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.41692.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41692.log.gz 2024-08-24T21:42:05.763 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25187.log 2024-08-24T21:42:05.763 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.32605.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32605.log.gz 2024-08-24T21:42:05.764 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34191.log 2024-08-24T21:42:05.764 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.25187.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25187.log.gz 2024-08-24T21:42:05.764 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39159.log 2024-08-24T21:42:05.764 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.34191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37396.log 2024-08-24T21:42:05.764 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34191.log.gz 2024-08-24T21:42:05.764 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.39159.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39159.log.gz 2024-08-24T21:42:05.764 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46651.log 2024-08-24T21:42:05.764 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.37396.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37396.log.gz 2024-08-24T21:42:05.764 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31719.log 2024-08-24T21:42:05.764 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39889.log 2024-08-24T21:42:05.764 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46651.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46651.log.gz 2024-08-24T21:42:05.764 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.31719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46130.log 2024-08-24T21:42:05.764 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31719.log.gz 2024-08-24T21:42:05.765 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.39889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48522.log 2024-08-24T21:42:05.765 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39889.log.gz 2024-08-24T21:42:05.765 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46130.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46130.log.gz 2024-08-24T21:42:05.765 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37606.log 2024-08-24T21:42:05.765 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.48522.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48522.log.gz 2024-08-24T21:42:05.765 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28245.log 2024-08-24T21:42:05.765 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.37606.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37606.log.gz 2024-08-24T21:42:05.765 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39511.log 2024-08-24T21:42:05.765 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.28245.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28245.log.gz 2024-08-24T21:42:05.765 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47219.log 2024-08-24T21:42:05.765 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.39511.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39511.log.gz 2024-08-24T21:42:05.765 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30537.log 2024-08-24T21:42:05.765 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.47219.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47219.log.gz 2024-08-24T21:42:05.766 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32184.log 2024-08-24T21:42:05.766 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.30537.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30537.log.gzgzip 2024-08-24T21:42:05.766 INFO:teuthology.orchestra.run.smithi060.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.29059.log 2024-08-24T21:42:05.766 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.32184.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32184.log.gz 2024-08-24T21:42:05.766 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29735.log 2024-08-24T21:42:05.766 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.29059.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29059.log.gz 2024-08-24T21:42:05.766 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-08-24T21:42:05.766 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.29735.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29735.log.gz 2024-08-24T21:42:05.766 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33461.log 2024-08-24T21:42:05.766 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48901.log 2024-08-24T21:42:05.766 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.33461.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33461.log.gz 2024-08-24T21:42:05.766 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22910.log 2024-08-24T21:42:05.767 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.48901.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48901.log.gzgzip 2024-08-24T21:42:05.767 INFO:teuthology.orchestra.run.smithi060.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.48606.log 2024-08-24T21:42:05.767 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.22910.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22910.log.gz 2024-08-24T21:42:05.767 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30451.log 2024-08-24T21:42:05.767 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.48606.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48606.log.gzgzip 2024-08-24T21:42:05.767 INFO:teuthology.orchestra.run.smithi060.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.37648.log 2024-08-24T21:42:05.767 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.30451.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30451.log.gz 2024-08-24T21:42:05.767 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26211.log 2024-08-24T21:42:05.767 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.37648.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37648.log.gzgzip 2024-08-24T21:42:05.767 INFO:teuthology.orchestra.run.smithi060.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.23541.log 2024-08-24T21:42:05.767 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.26211.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26211.log.gz 2024-08-24T21:42:05.767 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-08-24T21:42:05.767 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.23541.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23541.log.gz 2024-08-24T21:42:05.768 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40242.log 2024-08-24T21:42:05.768 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43097.log 2024-08-24T21:42:05.768 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.40242.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40242.log.gz 2024-08-24T21:42:05.768 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23182.log 2024-08-24T21:42:05.768 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42361.log 2024-08-24T21:42:05.768 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43097.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43097.log.gz 2024-08-24T21:42:05.768 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.23182.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23182.log.gz 2024-08-24T21:42:05.768 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18677.log 2024-08-24T21:42:05.768 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42361.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42361.log.gz 2024-08-24T21:42:05.768 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34841.log 2024-08-24T21:42:05.790 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.18677.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18677.log.gz 2024-08-24T21:42:05.790 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34569.log 2024-08-24T21:42:05.790 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.34841.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34841.log.gz 2024-08-24T21:42:05.790 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47261.log 2024-08-24T21:42:05.790 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.34569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46357.log 2024-08-24T21:42:05.790 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34569.log.gz 2024-08-24T21:42:05.790 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.47261.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47261.log.gz 2024-08-24T21:42:05.790 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30945.log 2024-08-24T21:42:05.790 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46357.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46357.log.gz 2024-08-24T21:42:05.791 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29861.log 2024-08-24T21:42:05.791 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.30945.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30945.log.gz 2024-08-24T21:42:05.791 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24683.log 2024-08-24T21:42:05.791 INFO:teuthology.orchestra.run.smithi060.stderr: 92.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-08-24T21:42:05.791 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.29861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22693.log 2024-08-24T21:42:05.791 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29861.log.gz 2024-08-24T21:42:05.791 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.24683.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24683.log.gz 2024-08-24T21:42:05.791 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26757.log 2024-08-24T21:42:05.791 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.22693.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22693.log.gz 2024-08-24T21:42:05.791 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29315.log 2024-08-24T21:42:05.791 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.26757.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26757.log.gz 2024-08-24T21:42:05.791 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43491.log 2024-08-24T21:42:05.791 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.29315.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29315.log.gz 2024-08-24T21:42:05.792 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42487.log 2024-08-24T21:42:05.792 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43491.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43491.log.gz 2024-08-24T21:42:05.792 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45710.log 2024-08-24T21:42:05.792 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42487.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42487.log.gz 2024-08-24T21:42:05.792 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44305.log 2024-08-24T21:42:05.792 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.45710.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45710.log.gz 2024-08-24T21:42:05.792 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36300.log 2024-08-24T21:42:05.792 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.44305.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44305.log.gz 2024-08-24T21:42:05.792 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23251.log 2024-08-24T21:42:05.792 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.36300.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36300.log.gz 2024-08-24T21:42:05.792 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29185.log 2024-08-24T21:42:05.792 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.23251.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23251.log.gz 2024-08-24T21:42:05.792 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37522.log 2024-08-24T21:42:05.793 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.29185.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29185.log.gz 2024-08-24T21:42:05.793 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47765.log 2024-08-24T21:42:05.793 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.37522.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37522.log.gz 2024-08-24T21:42:05.793 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41462.log 2024-08-24T21:42:05.793 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.47765.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47765.log.gz 2024-08-24T21:42:05.793 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31677.log 2024-08-24T21:42:05.793 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.41462.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41462.log.gz 2024-08-24T21:42:05.793 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44221.log 2024-08-24T21:42:05.793 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.31677.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31677.log.gz 2024-08-24T21:42:05.793 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41335.log 2024-08-24T21:42:05.793 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.44221.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44221.log.gz 2024-08-24T21:42:05.793 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22558.log 2024-08-24T21:42:05.793 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.41335.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41335.log.gz 2024-08-24T21:42:05.793 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32983.log 2024-08-24T21:42:05.794 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.22558.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22558.log.gz 2024-08-24T21:42:05.794 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-08-24T21:42:05.794 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.32983.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32983.log.gz 2024-08-24T21:42:05.794 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48018.log 2024-08-24T21:42:05.794 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32563.log 2024-08-24T21:42:05.794 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.48018.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48018.log.gz 2024-08-24T21:42:05.794 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-08-24T21:42:05.794 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.32563.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32563.log.gz 2024-08-24T21:42:05.794 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27950.log 2024-08-24T21:42:05.794 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35611.log 2024-08-24T21:42:05.794 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.27950.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27950.log.gz 2024-08-24T21:42:05.794 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26547.log 2024-08-24T21:42:05.795 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.35611.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35611.log.gz 2024-08-24T21:42:05.795 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22651.log 2024-08-24T21:42:05.802 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.26547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33025.log 2024-08-24T21:42:05.802 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26547.log.gz 2024-08-24T21:42:05.802 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.22651.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.22651.log.gz 2024-08-24T21:42:05.802 INFO:teuthology.orchestra.run.smithi060.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43617.log 2024-08-24T21:42:05.802 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.33025.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33025.log.gz 2024-08-24T21:42:05.802 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28455.log 2024-08-24T21:42:05.802 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43617.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43617.log.gz 2024-08-24T21:42:05.802 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41630.log 2024-08-24T21:42:05.802 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.28455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33419.log 2024-08-24T21:42:05.802 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28455.log.gz 2024-08-24T21:42:05.802 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.41630.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41630.log.gz 2024-08-24T21:42:05.802 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44767.log 2024-08-24T21:42:05.803 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.33419.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33419.log.gz 2024-08-24T21:42:05.803 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37946.log 2024-08-24T21:42:05.803 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.44767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37862.log 2024-08-24T21:42:05.803 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44767.log.gz 2024-08-24T21:42:05.803 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.37946.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37946.log.gz 2024-08-24T21:42:05.803 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43449.log 2024-08-24T21:42:05.803 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39721.log 2024-08-24T21:42:05.803 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.37862.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37862.log.gz 2024-08-24T21:42:05.803 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43449.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43449.log.gz 2024-08-24T21:42:05.803 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32226.log 2024-08-24T21:42:05.808 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22477.log 2024-08-24T21:42:05.808 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.39721.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39721.log.gz 2024-08-24T21:42:05.808 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.32226.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32226.log.gz 2024-08-24T21:42:05.808 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25103.log 2024-08-24T21:42:05.808 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39075.log 2024-08-24T21:42:05.809 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.22477.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22477.log.gz 2024-08-24T21:42:05.809 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.25103.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25103.log.gz 2024-08-24T21:42:05.809 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37776.log 2024-08-24T21:42:05.809 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.39075.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39075.log.gz 2024-08-24T21:42:05.809 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26379.log 2024-08-24T21:42:05.809 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.37776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48228.log 2024-08-24T21:42:05.809 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37776.log.gz 2024-08-24T21:42:05.812 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.26379.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26379.log.gz 2024-08-24T21:42:05.812 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31450.log 2024-08-24T21:42:05.812 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.48228.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48228.log.gz 2024-08-24T21:42:05.812 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34527.log 2024-08-24T21:42:05.812 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.31450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24767.log 2024-08-24T21:42:05.812 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31450.log.gz 2024-08-24T21:42:05.819 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.34527.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34527.log.gz 2024-08-24T21:42:05.819 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34653.log 2024-08-24T21:42:05.819 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.24767.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24767.log.gz 2024-08-24T21:42:05.819 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44809.log 2024-08-24T21:42:05.819 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.34653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39285.log 2024-08-24T21:42:05.819 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34653.log.gz 2024-08-24T21:42:05.819 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.44809.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44809.log.gz 2024-08-24T21:42:05.819 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22903.log 2024-08-24T21:42:05.819 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22609.log 2024-08-24T21:42:05.820 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.39285.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39285.log.gz 2024-08-24T21:42:05.820 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.22903.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22903.log.gz 2024-08-24T21:42:05.820 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28707.log 2024-08-24T21:42:05.820 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.22609.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22609.log.gz 2024-08-24T21:42:05.820 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27866.log 2024-08-24T21:42:05.822 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.28707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43785.log 2024-08-24T21:42:05.823 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28707.log.gz 2024-08-24T21:42:05.823 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.27866.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27866.log.gz 2024-08-24T21:42:05.823 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48270.log 2024-08-24T21:42:05.823 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43785.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43785.log.gz 2024-08-24T21:42:05.823 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41815.log 2024-08-24T21:42:05.829 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.48270.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48270.log.gz 2024-08-24T21:42:05.829 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31281.log 2024-08-24T21:42:05.829 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.41815.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41815.log.gz 2024-08-24T21:42:05.829 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43013.log 2024-08-24T21:42:05.829 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.31281.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31281.log.gz 2024-08-24T21:42:05.829 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39595.log 2024-08-24T21:42:05.829 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43013.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43013.log.gz 2024-08-24T21:42:05.829 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28749.log 2024-08-24T21:42:05.829 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.39595.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39595.log.gz 2024-08-24T21:42:05.829 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36930.log 2024-08-24T21:42:05.833 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.28749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30157.log 2024-08-24T21:42:05.834 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28749.log.gz 2024-08-24T21:42:05.834 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.36930.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36930.log.gz 2024-08-24T21:42:05.834 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26169.log 2024-08-24T21:42:05.834 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.30157.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30157.log.gz 2024-08-24T21:42:05.834 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30073.log 2024-08-24T21:42:05.834 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.26169.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26169.log.gz 2024-08-24T21:42:05.834 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46694.log 2024-08-24T21:42:05.840 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.30073.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30073.log.gz 2024-08-24T21:42:05.840 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32437.log 2024-08-24T21:42:05.840 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46694.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46694.log.gz 2024-08-24T21:42:05.840 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40999.log 2024-08-24T21:42:05.840 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.32437.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32437.log.gz 2024-08-24T21:42:05.840 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40536.log 2024-08-24T21:42:05.840 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.40999.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40999.log.gz 2024-08-24T21:42:05.840 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23525.log 2024-08-24T21:42:05.840 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.40536.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40536.log.gz 2024-08-24T21:42:05.840 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36342.log 2024-08-24T21:42:05.844 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.23525.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23525.log.gz 2024-08-24T21:42:05.844 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23467.log 2024-08-24T21:42:05.844 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.36342.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36342.log.gz 2024-08-24T21:42:05.844 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44557.log 2024-08-24T21:42:05.844 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.23467.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23467.log.gz 2024-08-24T21:42:05.844 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37140.log 2024-08-24T21:42:05.851 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.44557.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44557.log.gz 2024-08-24T21:42:05.851 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22533.log 2024-08-24T21:42:05.851 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.37140.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37140.log.gz 2024-08-24T21:42:05.851 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31029.log 2024-08-24T21:42:05.851 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.22533.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22533.log.gz 2024-08-24T21:42:05.851 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45482.log 2024-08-24T21:42:05.851 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.31029.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31029.log.gz 2024-08-24T21:42:05.851 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35695.log 2024-08-24T21:42:05.851 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.45482.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45482.log.gz 2024-08-24T21:42:05.851 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36468.log 2024-08-24T21:42:05.851 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.35695.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35695.log.gz 2024-08-24T21:42:05.855 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40494.log 2024-08-24T21:42:05.855 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.36468.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36468.log.gz 2024-08-24T21:42:05.855 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25019.log 2024-08-24T21:42:05.855 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.40494.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40494.log.gz 2024-08-24T21:42:05.855 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42718.log 2024-08-24T21:42:05.855 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.25019.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25019.log.gz 2024-08-24T21:42:05.855 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40704.log 2024-08-24T21:42:05.861 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42718.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42718.log.gz 2024-08-24T21:42:05.861 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41588.log 2024-08-24T21:42:05.861 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.40704.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40704.log.gz 2024-08-24T21:42:05.861 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46821.log 2024-08-24T21:42:05.861 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.41588.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41588.log.gz 2024-08-24T21:42:05.861 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23869.log 2024-08-24T21:42:05.861 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46821.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46821.log.gz 2024-08-24T21:42:05.861 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32731.log 2024-08-24T21:42:05.865 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.23869.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23869.log.gz 2024-08-24T21:42:05.865 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36762.log 2024-08-24T21:42:05.865 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.32731.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32731.log.gz 2024-08-24T21:42:05.866 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29357.log 2024-08-24T21:42:05.866 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.36762.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36762.log.gz 2024-08-24T21:42:05.866 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34233.log 2024-08-24T21:42:05.866 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.29357.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29357.log.gz 2024-08-24T21:42:05.866 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44725.log 2024-08-24T21:42:05.872 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.34233.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34233.log.gz 2024-08-24T21:42:05.872 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29143.log 2024-08-24T21:42:05.872 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.44725.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44725.log.gz 2024-08-24T21:42:05.872 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40662.log 2024-08-24T21:42:05.872 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.29143.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29143.log.gz 2024-08-24T21:42:05.872 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28975.log 2024-08-24T21:42:05.872 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.40662.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40662.log.gz 2024-08-24T21:42:05.872 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35989.log 2024-08-24T21:42:05.872 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.28975.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28975.log.gz 2024-08-24T21:42:05.872 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42319.log 2024-08-24T21:42:05.876 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.35989.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35989.log.gz 2024-08-24T21:42:05.876 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40620.log 2024-08-24T21:42:05.876 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42319.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42319.log.gz 2024-08-24T21:42:05.876 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38088.log 2024-08-24T21:42:05.877 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.40620.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40620.log.gz 2024-08-24T21:42:05.877 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24079.log 2024-08-24T21:42:05.877 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.38088.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38088.log.gz 2024-08-24T21:42:05.877 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39847.log 2024-08-24T21:42:05.882 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.24079.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24079.log.gz 2024-08-24T21:42:05.882 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25061.log 2024-08-24T21:42:05.882 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.39847.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39847.log.gz 2024-08-24T21:42:05.882 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33545.log 2024-08-24T21:42:05.882 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.25061.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25061.log.gz 2024-08-24T21:42:05.882 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31932.log 2024-08-24T21:42:05.882 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.33545.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33545.log.gz 2024-08-24T21:42:05.882 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34923.log 2024-08-24T21:42:05.887 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.31932.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31932.log.gz 2024-08-24T21:42:05.888 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39346.log 2024-08-24T21:42:05.888 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.34923.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34923.log.gz 2024-08-24T21:42:05.888 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48184.log 2024-08-24T21:42:05.888 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.39346.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39346.log.gz 2024-08-24T21:42:05.888 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32310.log 2024-08-24T21:42:05.888 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.48184.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48184.log.gz 2024-08-24T21:42:05.888 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27093.log 2024-08-24T21:42:05.888 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.32310.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32310.log.gz 2024-08-24T21:42:05.888 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29946.log 2024-08-24T21:42:05.892 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.27093.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27093.log.gz 2024-08-24T21:42:05.892 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45188.log 2024-08-24T21:42:05.892 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.29946.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29946.log.gz 2024-08-24T21:42:05.892 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47659.log 2024-08-24T21:42:05.892 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.45188.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45188.log.gz 2024-08-24T21:42:05.892 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44473.log 2024-08-24T21:42:05.895 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.23383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20965.log 2024-08-24T21:42:05.895 INFO:teuthology.orchestra.run.smithi179.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23383.log.gz 2024-08-24T21:42:05.895 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.16168.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.16168.log.gz 2024-08-24T21:42:05.895 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.12855.log 2024-08-24T21:42:05.895 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.20965.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20965.log.gz 2024-08-24T21:42:05.895 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23212.log 2024-08-24T21:42:05.895 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.12855.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.12855.log.gz -- 2024-08-24T21:42:05.896 INFO:teuthology.orchestra.run.smithi179.stderr: /var/log/ceph/ceph-client.admin.14834.log 2024-08-24T21:42:05.896 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.23212.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23212.log.gz 2024-08-24T21:42:05.896 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23254.log 2024-08-24T21:42:05.896 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.14834.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14834.log.gz 2024-08-24T21:42:05.896 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19601.log 2024-08-24T21:42:05.896 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.23254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20490.log 2024-08-24T21:42:05.896 INFO:teuthology.orchestra.run.smithi179.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23254.log.gz 2024-08-24T21:42:05.896 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.19601.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.18155.log 2024-08-24T21:42:05.896 INFO:teuthology.orchestra.run.smithi179.stderr: -- replaced with /var/log/ceph/ceph-client.admin.19601.log.gz 2024-08-24T21:42:05.896 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.20490.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.20490.log.gz -5 2024-08-24T21:42:05.896 INFO:teuthology.orchestra.run.smithi179.stderr: --verbose -- /var/log/ceph/ceph-client.admin.20944.log 2024-08-24T21:42:05.896 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.18155.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18155.log.gz 2024-08-24T21:42:05.897 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22240.log 2024-08-24T21:42:05.897 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.20944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17723.log 2024-08-24T21:42:05.897 INFO:teuthology.orchestra.run.smithi179.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20944.log.gz 2024-08-24T21:42:05.897 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.22240.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22240.log.gz 2024-08-24T21:42:05.897 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20425.log 2024-08-24T21:42:05.897 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14417.log 2024-08-24T21:42:05.897 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.17723.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17723.log.gz 2024-08-24T21:42:05.897 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.20425.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20425.log.gz 2024-08-24T21:42:05.897 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23406.log 2024-08-24T21:42:05.897 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.14417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21202.log 2024-08-24T21:42:05.897 INFO:teuthology.orchestra.run.smithi179.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14417.log.gz 2024-08-24T21:42:05.897 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.23406.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23406.log.gzgzip 2024-08-24T21:42:05.898 INFO:teuthology.orchestra.run.smithi179.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.17744.log 2024-08-24T21:42:05.898 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.21202.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21202.log.gzgzip 2024-08-24T21:42:05.898 INFO:teuthology.orchestra.run.smithi179.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.20575.log 2024-08-24T21:42:05.898 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.17744.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.17744.log.gz -5 2024-08-24T21:42:05.898 INFO:teuthology.orchestra.run.smithi179.stderr: --verbose -- /var/log/ceph/ceph-client.admin.17204.log 2024-08-24T21:42:05.898 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.20575.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.20575.log.gz 2024-08-24T21:42:05.898 INFO:teuthology.orchestra.run.smithi179.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.20467.log 2024-08-24T21:42:05.898 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.17204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22542.log 2024-08-24T21:42:05.898 INFO:teuthology.orchestra.run.smithi179.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17204.log.gz 2024-08-24T21:42:05.898 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.20467.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.20467.log.gz /var/log/ceph/ceph-client.admin.13066.log 2024-08-24T21:42:05.898 INFO:teuthology.orchestra.run.smithi179.stderr: 2024-08-24T21:42:05.898 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.22542.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.22542.log.gz /var/log/ceph/ceph-client.admin.22822.log 2024-08-24T21:42:05.899 INFO:teuthology.orchestra.run.smithi179.stderr: 2024-08-24T21:42:05.899 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.13066.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.13066.log.gz 2024-08-24T21:42:05.899 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16924.log 2024-08-24T21:42:05.899 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.22822.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22822.log.gz 2024-08-24T21:42:05.899 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22930.log 2024-08-24T21:42:05.899 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.16924.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.16924.log.gz 2024-08-24T21:42:05.899 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21397.log 2024-08-24T21:42:05.899 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.22930.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22930.log.gz 2024-08-24T21:42:05.899 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14563.log 2024-08-24T21:42:05.899 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.21397.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21397.log.gz 2024-08-24T21:42:05.899 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19061.log 2024-08-24T21:42:05.899 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.14563.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14563.log.gz 2024-08-24T21:42:05.899 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18737.log 2024-08-24T21:42:05.900 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.19061.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19061.log.gz 2024-08-24T21:42:05.900 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14814.log 2024-08-24T21:42:05.900 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.18737.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18737.log.gz 2024-08-24T21:42:05.900 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14689.log 2024-08-24T21:42:05.900 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.14814.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14814.log.gz 2024-08-24T21:42:05.900 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18652.log 2024-08-24T21:42:05.900 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.14689.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14689.log.gz 2024-08-24T21:42:05.900 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.13492.log 2024-08-24T21:42:05.900 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.18652.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18652.log.gz 2024-08-24T21:42:05.900 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20878.log 2024-08-24T21:42:05.900 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.13492.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.13492.log.gz 2024-08-24T21:42:05.900 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19646.log 2024-08-24T21:42:05.900 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.20878.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20878.log.gz 2024-08-24T21:42:05.901 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.13700.log 2024-08-24T21:42:05.901 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.19646.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19646.log.gz 2024-08-24T21:42:05.901 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15597.log 2024-08-24T21:42:05.901 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.13700.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.13700.log.gz 2024-08-24T21:42:05.901 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20533.log 2024-08-24T21:42:05.901 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.15597.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.21829.log 2024-08-24T21:42:05.901 INFO:teuthology.orchestra.run.smithi179.stderr: -- replaced with /var/log/ceph/ceph-client.admin.15597.log.gz 2024-08-24T21:42:05.901 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.20533.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20533.log.gz 2024-08-24T21:42:05.901 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18026.log 2024-08-24T21:42:05.901 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.21829.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21829.log.gz 2024-08-24T21:42:05.901 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21484.log 2024-08-24T21:42:05.901 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.18026.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18026.log.gz 2024-08-24T21:42:05.901 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14058.log 2024-08-24T21:42:05.902 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.21484.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21484.log.gz 2024-08-24T21:42:05.902 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16816.log 2024-08-24T21:42:05.902 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.14058.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14058.log.gz 2024-08-24T21:42:05.902 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23559.log 2024-08-24T21:42:05.902 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.16816.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.16816.log.gz 2024-08-24T21:42:05.902 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23298.log 2024-08-24T21:42:05.902 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.23559.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23559.log.gz 2024-08-24T21:42:05.902 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18953.log 2024-08-24T21:42:05.902 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.23298.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23298.log.gz 2024-08-24T21:42:05.902 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19580.log 2024-08-24T21:42:05.902 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.18953.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18953.log.gz 2024-08-24T21:42:05.902 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.13271.log 2024-08-24T21:42:05.903 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.19580.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19580.log.gz 2024-08-24T21:42:05.903 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17572.log 2024-08-24T21:42:05.903 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.13271.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.13271.log.gz 2024-08-24T21:42:05.903 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23470.log 2024-08-24T21:42:05.903 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.17572.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17572.log.gz 2024-08-24T21:42:05.903 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15577.log 2024-08-24T21:42:05.903 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.23470.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23470.log.gz 2024-08-24T21:42:05.903 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22153.log 2024-08-24T21:42:05.903 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.15577.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15577.log.gz 2024-08-24T21:42:05.903 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17378.log 2024-08-24T21:42:05.903 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.22153.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22153.log.gz 2024-08-24T21:42:05.903 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17657.log 2024-08-24T21:42:05.904 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.17378.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17378.log.gz 2024-08-24T21:42:05.904 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22519.log 2024-08-24T21:42:05.904 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.17657.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17657.log.gz 2024-08-24T21:42:05.904 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19993.log 2024-08-24T21:42:05.904 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.22519.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22519.log.gz 2024-08-24T21:42:05.904 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18521.log 2024-08-24T21:42:05.904 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.19993.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19993.log.gz 2024-08-24T21:42:05.904 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19430.log 2024-08-24T21:42:05.904 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.18521.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18521.log.gz 2024-08-24T21:42:05.904 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22348.log 2024-08-24T21:42:05.904 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.19430.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19430.log.gz 2024-08-24T21:42:05.904 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19106.log 2024-08-24T21:42:05.904 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.22348.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22348.log.gz 2024-08-24T21:42:05.905 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17960.log 2024-08-24T21:42:05.905 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.19106.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19106.log.gz 2024-08-24T21:42:05.905 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19624.log 2024-08-24T21:42:05.905 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.17960.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17960.log.gz 2024-08-24T21:42:05.905 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16469.log 2024-08-24T21:42:05.905 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.19624.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19624.log.gz 2024-08-24T21:42:05.905 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21310.log 2024-08-24T21:42:05.905 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.16469.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.16469.log.gz 2024-08-24T21:42:05.905 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23538.log 2024-08-24T21:42:05.905 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.21310.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21310.log.gz 2024-08-24T21:42:05.905 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16190.log 2024-08-24T21:42:05.905 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.23538.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23538.log.gz 2024-08-24T21:42:05.906 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.12981.log 2024-08-24T21:42:05.906 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.16190.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.16190.log.gz 2024-08-24T21:42:05.906 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17162.log 2024-08-24T21:42:05.906 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.12981.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.12981.log.gz 2024-08-24T21:42:05.906 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15010.log 2024-08-24T21:42:05.906 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.17162.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17162.log.gz 2024-08-24T21:42:05.906 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16946.log 2024-08-24T21:42:05.906 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.15010.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15010.log.gz 2024-08-24T21:42:05.906 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.12559.log 2024-08-24T21:42:05.906 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.16946.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.16946.log.gz 2024-08-24T21:42:05.906 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23167.log 2024-08-24T21:42:05.906 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.12559.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.12559.log.gz 2024-08-24T21:42:05.906 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.12670.log 2024-08-24T21:42:05.907 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.23167.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23167.log.gz 2024-08-24T21:42:05.907 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23449.log 2024-08-24T21:42:05.907 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.12670.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.12670.log.gz 2024-08-24T21:42:05.907 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18263.log 2024-08-24T21:42:05.907 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.23449.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23449.log.gz 2024-08-24T21:42:05.907 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18197.log 2024-08-24T21:42:05.907 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.18263.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18263.log.gz 2024-08-24T21:42:05.907 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20706.log 2024-08-24T21:42:05.907 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.18197.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18197.log.gz 2024-08-24T21:42:05.907 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23017.log 2024-08-24T21:42:05.907 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.20706.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20706.log.gz 2024-08-24T21:42:05.907 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16685.log 2024-08-24T21:42:05.907 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.23017.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23017.log.gz 2024-08-24T21:42:05.908 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21115.log 2024-08-24T21:42:05.908 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.16685.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.16685.log.gz 2024-08-24T21:42:05.908 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20446.log 2024-08-24T21:42:05.908 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.21115.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21115.log.gz 2024-08-24T21:42:05.908 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23104.log 2024-08-24T21:42:05.908 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.20446.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20446.log.gz 2024-08-24T21:42:05.908 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22564.log 2024-08-24T21:42:05.908 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.23104.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23104.log.gz 2024-08-24T21:42:05.908 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22066.log 2024-08-24T21:42:05.908 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.22564.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22564.log.gz 2024-08-24T21:42:05.908 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.13293.log 2024-08-24T21:42:05.908 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.22066.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22066.log.gz 2024-08-24T21:42:05.908 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.13897.log 2024-08-24T21:42:05.909 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.13293.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.13293.log.gz 2024-08-24T21:42:05.909 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16384.log 2024-08-24T21:42:05.909 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.13897.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.13897.log.gz 2024-08-24T21:42:05.909 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18587.log 2024-08-24T21:42:05.909 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.16384.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.16384.log.gz 2024-08-24T21:42:05.909 INFO:teuthology.orchestra.run.smithi179.stderr: -- /var/log/ceph/ceph-client.admin.20770.log 2024-08-24T21:42:05.909 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.18587.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18587.log.gz 2024-08-24T21:42:05.909 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19688.log 2024-08-24T21:42:05.909 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.20770.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20770.log.gz 2024-08-24T21:42:05.909 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18674.log 2024-08-24T21:42:05.909 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.19688.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19688.log.gz 2024-08-24T21:42:05.909 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18047.log 2024-08-24T21:42:05.909 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.18674.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18674.log.gz 2024-08-24T21:42:05.909 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.13827.log 2024-08-24T21:42:05.910 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.18047.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18047.log.gz 2024-08-24T21:42:05.910 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21138.log 2024-08-24T21:42:05.910 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.13827.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.13827.log.gz 2024-08-24T21:42:05.910 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22132.log 2024-08-24T21:42:05.910 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.21138.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21138.log.gz 2024-08-24T21:42:05.910 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21462.log 2024-08-24T21:42:05.910 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.22132.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22132.log.gz 2024-08-24T21:42:05.910 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21268.log 2024-08-24T21:42:05.910 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.21462.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21462.log.gz 2024-08-24T21:42:05.910 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21354.log 2024-08-24T21:42:05.910 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.21268.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21268.log.gz 2024-08-24T21:42:05.910 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19732.log 2024-08-24T21:42:05.911 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.21354.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21354.log.gz 2024-08-24T21:42:05.911 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.13107.log 2024-08-24T21:42:05.911 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.19732.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19732.log.gz 2024-08-24T21:42:05.911 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.13721.log 2024-08-24T21:42:05.911 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.13107.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.13107.log.gz 2024-08-24T21:42:05.911 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19084.log 2024-08-24T21:42:05.911 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.13721.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.13721.log.gz 2024-08-24T21:42:05.911 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23125.log 2024-08-24T21:42:05.911 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.19084.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19084.log.gz 2024-08-24T21:42:05.911 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16037.log 2024-08-24T21:42:05.911 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.23125.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23125.log.gz 2024-08-24T21:42:05.911 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17117.log 2024-08-24T21:42:05.911 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.16037.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.16037.log.gz 2024-08-24T21:42:05.912 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17852.log 2024-08-24T21:42:05.912 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.17117.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17117.log.gz 2024-08-24T21:42:05.912 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23320.log 2024-08-24T21:42:05.912 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.17852.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17852.log.gz 2024-08-24T21:42:05.912 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14875.log 2024-08-24T21:42:05.912 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.23320.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23320.log.gz 2024-08-24T21:42:05.912 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16492.log 2024-08-24T21:42:05.912 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.14875.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14875.log.gz 2024-08-24T21:42:05.912 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18242.log 2024-08-24T21:42:05.912 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.16492.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.16492.log.gz 2024-08-24T21:42:05.912 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19817.log 2024-08-24T21:42:05.912 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.18242.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18242.log.gz 2024-08-24T21:42:05.913 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20512.log 2024-08-24T21:42:05.913 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.19817.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19817.log.gz 2024-08-24T21:42:05.913 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17140.log 2024-08-24T21:42:05.913 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.20512.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20512.log.gz 2024-08-24T21:42:05.913 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17507.log 2024-08-24T21:42:05.913 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.17140.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17140.log.gz 2024-08-24T21:42:05.913 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19277.log 2024-08-24T21:42:05.913 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.17507.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17507.log.gz 2024-08-24T21:42:05.913 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18112.log 2024-08-24T21:42:05.913 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.19277.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19277.log.gz 2024-08-24T21:42:05.913 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15285.log 2024-08-24T21:42:05.913 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.18112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20209.log 2024-08-24T21:42:05.913 INFO:teuthology.orchestra.run.smithi179.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18112.log.gz 2024-08-24T21:42:05.914 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.15285.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15285.log.gz 2024-08-24T21:42:05.914 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21763.log 2024-08-24T21:42:05.914 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.20209.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20209.log.gz 2024-08-24T21:42:05.914 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20857.log 2024-08-24T21:42:05.914 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.21763.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21763.log.gz 2024-08-24T21:42:05.914 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.12959.log 2024-08-24T21:42:05.914 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.20857.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20857.log.gz 2024-08-24T21:42:05.914 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15556.log 2024-08-24T21:42:05.914 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.12959.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.12959.log.gz 2024-08-24T21:42:05.914 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16406.log 2024-08-24T21:42:05.914 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.15556.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15556.log.gz 2024-08-24T21:42:05.914 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.13575.log 2024-08-24T21:42:05.914 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.16406.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.16406.log.gz 2024-08-24T21:42:05.915 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22174.log 2024-08-24T21:42:05.915 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.13575.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.13575.log.gz 2024-08-24T21:42:05.915 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18176.log 2024-08-24T21:42:05.915 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.22174.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22174.log.gz 2024-08-24T21:42:05.915 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18479.log 2024-08-24T21:42:05.915 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.18176.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18176.log.gz 2024-08-24T21:42:05.915 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18134.log 2024-08-24T21:42:05.915 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.18479.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18479.log.gz 2024-08-24T21:42:05.915 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14209.log 2024-08-24T21:42:05.915 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.18134.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18134.log.gz 2024-08-24T21:42:05.915 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21505.log 2024-08-24T21:42:05.915 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.14209.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14209.log.gz 2024-08-24T21:42:05.916 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.12773.log 2024-08-24T21:42:05.916 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.21505.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21505.log.gz 2024-08-24T21:42:05.916 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19709.log 2024-08-24T21:42:05.916 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.12773.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.12773.log.gz 2024-08-24T21:42:05.916 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16556.log 2024-08-24T21:42:05.916 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.19709.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19709.log.gz 2024-08-24T21:42:05.916 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20338.log 2024-08-24T21:42:05.916 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.16556.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.16556.log.gz 2024-08-24T21:42:05.916 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15515.log 2024-08-24T21:42:05.916 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.20338.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20338.log.gz 2024-08-24T21:42:05.916 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22693.log 2024-08-24T21:42:05.916 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.15515.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15515.log.gz 2024-08-24T21:42:05.916 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16253.log 2024-08-24T21:42:05.917 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.22693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21160.log 2024-08-24T21:42:05.917 INFO:teuthology.orchestra.run.smithi179.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22693.log.gz 2024-08-24T21:42:05.917 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.16253.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.16253.log.gz 2024-08-24T21:42:05.917 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16967.log 2024-08-24T21:42:05.917 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.21160.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21160.log.gz 2024-08-24T21:42:05.917 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14969.log 2024-08-24T21:42:05.917 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.16967.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.16967.log.gz -5 2024-08-24T21:42:05.917 INFO:teuthology.orchestra.run.smithi179.stderr: --verbose -- /var/log/ceph/ceph-client.admin.21073.log 2024-08-24T21:42:05.917 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.14969.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.14969.log.gz 2024-08-24T21:42:05.917 INFO:teuthology.orchestra.run.smithi179.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.12814.log 2024-08-24T21:42:05.917 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.21073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21916.log 2024-08-24T21:42:05.917 INFO:teuthology.orchestra.run.smithi179.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21073.log.gz 2024-08-24T21:42:05.918 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.12814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.13414.log 2024-08-24T21:42:05.918 INFO:teuthology.orchestra.run.smithi179.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.12814.log.gz 2024-08-24T21:42:05.918 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.21916.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21916.log.gz -5 2024-08-24T21:42:05.918 INFO:teuthology.orchestra.run.smithi179.stderr: --verbose -- /var/log/ceph/ceph-client.admin.13044.log 2024-08-24T21:42:05.918 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.13414.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.13414.log.gz 2024-08-24T21:42:05.918 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23493.log 2024-08-24T21:42:05.918 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.13044.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.13044.log.gz 2024-08-24T21:42:05.918 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20359.log 2024-08-24T21:42:05.918 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.23493.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23493.log.gz -5 2024-08-24T21:42:05.918 INFO:teuthology.orchestra.run.smithi179.stderr: --verbose -- /var/log/ceph/ceph-client.admin.14273.log 2024-08-24T21:42:05.918 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.20359.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20359.log.gz 2024-08-24T21:42:05.919 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15775.log 2024-08-24T21:42:05.919 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.14273.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14273.log.gz 2024-08-24T21:42:05.919 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21030.log 2024-08-24T21:42:05.919 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.15775.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15775.log.gz 2024-08-24T21:42:05.919 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16448.log 2024-08-24T21:42:05.919 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.21030.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21030.log.gz 2024-08-24T21:42:05.919 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.13334.log 2024-08-24T21:42:05.919 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.16448.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.16448.log.gz 2024-08-24T21:42:05.919 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20166.log 2024-08-24T21:42:05.919 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.13334.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.13334.log.gz 2024-08-24T21:42:05.919 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21007.log 2024-08-24T21:42:05.919 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.20166.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20166.log.gz 2024-08-24T21:42:05.920 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21181.log 2024-08-24T21:42:05.920 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.21007.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21007.log.gz 2024-08-24T21:42:05.920 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15928.log 2024-08-24T21:42:05.920 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.21181.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21181.log.gz 2024-08-24T21:42:05.920 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.13534.log 2024-08-24T21:42:05.920 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.15928.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15928.log.gz 2024-08-24T21:42:05.920 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15432.log 2024-08-24T21:42:05.920 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.13534.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.13534.log.gz 2024-08-24T21:42:05.920 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20554.log 2024-08-24T21:42:05.920 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.15432.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15432.log.gz 2024-08-24T21:42:05.920 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18760.log 2024-08-24T21:42:05.920 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.20554.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20554.log.gz 2024-08-24T21:42:05.921 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20986.log 2024-08-24T21:42:05.921 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.18760.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18760.log.gz 2024-08-24T21:42:05.921 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.13001.log 2024-08-24T21:42:05.921 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.20986.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20986.log.gz 2024-08-24T21:42:05.921 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21678.log 2024-08-24T21:42:05.921 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.13001.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.13001.log.gz 2024-08-24T21:42:05.921 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.13637.log 2024-08-24T21:42:05.921 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.21678.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21678.log.gz 2024-08-24T21:42:05.921 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22477.log 2024-08-24T21:42:05.921 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.13637.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.13637.log.gz 2024-08-24T21:42:05.921 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20641.log 2024-08-24T21:42:05.921 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.22477.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22477.log.gz 2024-08-24T21:42:05.921 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14002.log 2024-08-24T21:42:05.922 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.20641.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20641.log.gz 2024-08-24T21:42:05.922 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19019.log 2024-08-24T21:42:05.922 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.14002.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14002.log.gz 2024-08-24T21:42:05.922 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18284.log 2024-08-24T21:42:05.922 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.19019.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19019.log.gz 2024-08-24T21:42:05.922 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17702.log 2024-08-24T21:42:05.922 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.18284.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18284.log.gz 2024-08-24T21:42:05.922 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16319.log 2024-08-24T21:42:05.922 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.17702.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17702.log.gz 2024-08-24T21:42:05.922 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18976.log 2024-08-24T21:42:05.922 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.16319.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.16319.log.gz 2024-08-24T21:42:05.922 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14948.log 2024-08-24T21:42:05.923 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.18976.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18976.log.gz 2024-08-24T21:42:05.923 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22951.log 2024-08-24T21:42:05.923 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.14948.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14948.log.gz 2024-08-24T21:42:05.923 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18458.log 2024-08-24T21:42:05.923 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.22951.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22951.log.gz 2024-08-24T21:42:05.923 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14604.log 2024-08-24T21:42:05.923 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.18458.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18458.log.gz 2024-08-24T21:42:05.923 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.13189.log 2024-08-24T21:42:05.923 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.14604.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14604.log.gz 2024-08-24T21:42:05.923 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.13355.log 2024-08-24T21:42:05.923 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.13189.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.13189.log.gz 2024-08-24T21:42:05.923 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.12711.log 2024-08-24T21:42:05.923 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.13355.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.13355.log.gz 2024-08-24T21:42:05.923 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18803.log 2024-08-24T21:42:05.924 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.12711.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.12711.log.gz 2024-08-24T21:42:05.924 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.12691.log 2024-08-24T21:42:05.924 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.18803.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18803.log.gz 2024-08-24T21:42:05.924 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.13314.log 2024-08-24T21:42:05.924 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.12691.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.12691.log.gz 2024-08-24T21:42:05.924 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17464.log 2024-08-24T21:42:05.924 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.13314.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.13314.log.gz 2024-08-24T21:42:05.924 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21742.log 2024-08-24T21:42:05.924 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.17464.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17464.log.gz 2024-08-24T21:42:05.924 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18911.log 2024-08-24T21:42:05.924 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.21742.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21742.log.gz 2024-08-24T21:42:05.924 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19385.log 2024-08-24T21:42:05.924 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.18911.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18911.log.gz 2024-08-24T21:42:05.925 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16859.log 2024-08-24T21:42:05.925 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.19385.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19385.log.gz 2024-08-24T21:42:05.925 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22261.log 2024-08-24T21:42:05.925 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.16859.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.16859.log.gz 2024-08-24T21:42:05.925 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15218.log 2024-08-24T21:42:05.925 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.22261.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22261.log.gz 2024-08-24T21:42:05.925 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17291.log 2024-08-24T21:42:05.925 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.15218.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15218.log.gz 2024-08-24T21:42:05.925 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17896.log 2024-08-24T21:42:05.925 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.17291.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17291.log.gz 2024-08-24T21:42:05.925 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18932.log 2024-08-24T21:42:05.925 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.17896.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17896.log.gz 2024-08-24T21:42:05.925 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22996.log 2024-08-24T21:42:05.926 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.18932.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18932.log.gz 2024-08-24T21:42:05.926 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22110.log 2024-08-24T21:42:05.926 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.22996.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22996.log.gz 2024-08-24T21:42:05.926 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16124.log 2024-08-24T21:42:05.926 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.22110.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22110.log.gz 2024-08-24T21:42:05.926 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15650.log 2024-08-24T21:42:05.926 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.16124.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.16124.log.gz 2024-08-24T21:42:05.926 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14232.log 2024-08-24T21:42:05.926 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.15650.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15650.log.gz 2024-08-24T21:42:05.926 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23362.log 2024-08-24T21:42:05.926 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.14232.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14232.log.gz 2024-08-24T21:42:05.926 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17441.log 2024-08-24T21:42:05.927 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.23362.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23362.log.gz 2024-08-24T21:42:05.927 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15869.log 2024-08-24T21:42:05.927 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.17441.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17441.log.gz 2024-08-24T21:42:05.927 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14146.log 2024-08-24T21:42:05.927 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.15869.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15869.log.gz 2024-08-24T21:42:05.927 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21979.log 2024-08-24T21:42:05.927 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.14146.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14146.log.gz 2024-08-24T21:42:05.927 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15630.log 2024-08-24T21:42:05.927 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.21979.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21979.log.gz 2024-08-24T21:42:05.927 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19256.log 2024-08-24T21:42:05.927 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.15630.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15630.log.gz 2024-08-24T21:42:05.927 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22672.log 2024-08-24T21:42:05.927 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.19256.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19256.log.gz 2024-08-24T21:42:05.928 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14458.log 2024-08-24T21:42:05.928 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.22672.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22672.log.gz 2024-08-24T21:42:05.928 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23038.log 2024-08-24T21:42:05.928 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.14458.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14458.log.gz 2024-08-24T21:42:05.928 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.13876.log 2024-08-24T21:42:05.928 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.23038.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23038.log.gz 2024-08-24T21:42:05.928 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21094.log 2024-08-24T21:42:05.928 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.13876.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.13876.log.gz 2024-08-24T21:42:05.928 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14855.log 2024-08-24T21:42:05.928 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.21094.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.21094.log.gz 2024-08-24T21:42:05.928 INFO:teuthology.orchestra.run.smithi179.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.20683.log 2024-08-24T21:42:05.928 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.14855.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14855.log.gz 2024-08-24T21:42:05.929 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21052.log 2024-08-24T21:42:05.929 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.20683.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20683.log.gz 2024-08-24T21:42:05.929 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17873.log 2024-08-24T21:42:05.929 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.21052.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21052.log.gz 2024-08-24T21:42:05.929 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14315.log 2024-08-24T21:42:05.929 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.17873.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17873.log.gz 2024-08-24T21:42:05.929 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21289.log 2024-08-24T21:42:05.929 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.14315.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14315.log.gz 2024-08-24T21:42:05.929 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16600.log 2024-08-24T21:42:05.929 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.21289.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21289.log.gz 2024-08-24T21:42:05.929 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22801.log 2024-08-24T21:42:05.929 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.16600.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.16600.log.gz 2024-08-24T21:42:05.929 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.13741.log 2024-08-24T21:42:05.930 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.22801.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22801.log.gz 2024-08-24T21:42:05.930 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.13555.log 2024-08-24T21:42:05.930 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.13741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15369.log 2024-08-24T21:42:05.930 INFO:teuthology.orchestra.run.smithi179.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.13741.log.gz 2024-08-24T21:42:05.930 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.13555.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.13555.log.gz 2024-08-24T21:42:05.930 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15241.log 2024-08-24T21:42:05.930 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.15369.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15369.log.gz 2024-08-24T21:42:05.930 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14356.log 2024-08-24T21:42:05.930 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.15241.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15241.log.gz 2024-08-24T21:42:05.930 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.12752.log 2024-08-24T21:42:05.930 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.14356.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14356.log.gz 2024-08-24T21:42:05.930 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16577.log 2024-08-24T21:42:05.930 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.12752.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.12752.log.gz 2024-08-24T21:42:05.931 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.12793.log 2024-08-24T21:42:05.931 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.16577.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.16577.log.gz 2024-08-24T21:42:05.931 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.13782.log 2024-08-24T21:42:05.931 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.12793.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.12793.log.gz 2024-08-24T21:42:05.931 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22735.log 2024-08-24T21:42:05.931 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.13782.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.13782.log.gz 2024-08-24T21:42:05.931 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15536.log 2024-08-24T21:42:05.931 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.22735.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22735.log.gz 2024-08-24T21:42:05.931 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.13762.log 2024-08-24T21:42:05.931 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.15536.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15536.log.gz 2024-08-24T21:42:05.931 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16664.log 2024-08-24T21:42:05.931 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.13762.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.13762.log.gz 2024-08-24T21:42:05.931 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22627.log 2024-08-24T21:42:05.932 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.16664.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.16664.log.gz 2024-08-24T21:42:05.932 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17420.log 2024-08-24T21:42:05.932 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.22627.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22627.log.gz 2024-08-24T21:42:05.932 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15907.log 2024-08-24T21:42:05.932 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.17420.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17420.log.gz 2024-08-24T21:42:05.932 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15973.log 2024-08-24T21:42:05.932 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.15907.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15907.log.gz 2024-08-24T21:42:05.932 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15473.log 2024-08-24T21:42:05.932 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.15973.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15973.log.gz 2024-08-24T21:42:05.932 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.12576.log 2024-08-24T21:42:05.932 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.15473.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15473.log.gz 2024-08-24T21:42:05.932 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20251.log 2024-08-24T21:42:05.932 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.12576.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.12576.log.gz 2024-08-24T21:42:05.933 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16232.log 2024-08-24T21:42:05.933 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.20251.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20251.log.gz 2024-08-24T21:42:05.933 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.12898.log 2024-08-24T21:42:05.933 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.16232.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.16232.log.gz 2024-08-24T21:42:05.933 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19127.log 2024-08-24T21:42:05.933 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.12898.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.12898.log.gz 2024-08-24T21:42:05.933 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18695.log 2024-08-24T21:42:05.933 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.19127.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19127.log.gz 2024-08-24T21:42:05.933 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18566.log 2024-08-24T21:42:05.933 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.18695.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18695.log.gz 2024-08-24T21:42:05.933 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16298.log 2024-08-24T21:42:05.933 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.18566.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18566.log.gz 2024-08-24T21:42:05.933 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20274.log 2024-08-24T21:42:05.934 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.16298.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.16298.log.gz 2024-08-24T21:42:05.934 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.12918.log 2024-08-24T21:42:05.934 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.20274.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20274.log.gz 2024-08-24T21:42:05.934 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16708.log 2024-08-24T21:42:05.934 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.12918.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.12918.log.gz 2024-08-24T21:42:05.934 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.13938.log 2024-08-24T21:42:05.934 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.16708.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.16708.log.gz 2024-08-24T21:42:05.934 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21786.log 2024-08-24T21:42:05.934 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.13938.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.13938.log.gz 2024-08-24T21:42:05.934 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15453.log 2024-08-24T21:42:05.934 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.21786.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21786.log.gz 2024-08-24T21:42:05.934 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.12834.log 2024-08-24T21:42:05.935 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.15453.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15453.log.gz 2024-08-24T21:42:05.935 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.13230.log 2024-08-24T21:42:05.935 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.12834.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.12834.log.gz 2024-08-24T21:42:05.935 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20035.log 2024-08-24T21:42:05.935 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.13230.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.13230.log.gz 2024-08-24T21:42:05.935 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17075.log 2024-08-24T21:42:05.935 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.20035.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20035.log.gz 2024-08-24T21:42:05.935 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22411.log 2024-08-24T21:42:05.935 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.17075.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17075.log.gz 2024-08-24T21:42:05.935 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.13470.log 2024-08-24T21:42:05.935 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.22411.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22411.log.gz 2024-08-24T21:42:05.935 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22390.log 2024-08-24T21:42:05.935 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.13470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14520.log 2024-08-24T21:42:05.936 INFO:teuthology.orchestra.run.smithi179.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.13470.log.gz 2024-08-24T21:42:05.936 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.22390.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22390.log.gz 2024-08-24T21:42:05.936 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18824.log 2024-08-24T21:42:05.936 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.14520.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14520.log.gz 2024-08-24T21:42:05.936 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17549.log 2024-08-24T21:42:05.936 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.18824.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18824.log.gz 2024-08-24T21:42:05.936 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20122.log 2024-08-24T21:42:05.936 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.17549.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17549.log.gz 2024-08-24T21:42:05.936 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19040.log 2024-08-24T21:42:05.936 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.20122.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20122.log.gz 2024-08-24T21:42:05.936 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15198.log 2024-08-24T21:42:05.936 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.19040.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19040.log.gz 2024-08-24T21:42:05.936 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22282.log 2024-08-24T21:42:05.937 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.15198.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15198.log.gz 2024-08-24T21:42:05.937 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21439.log 2024-08-24T21:42:05.937 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.22282.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22282.log.gz 2024-08-24T21:42:05.937 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16276.log 2024-08-24T21:42:05.937 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.21439.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21439.log.gz 2024-08-24T21:42:05.937 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19754.log 2024-08-24T21:42:05.937 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.16276.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.16276.log.gz 2024-08-24T21:42:05.937 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19148.log 2024-08-24T21:42:05.937 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.19754.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19754.log.gz 2024-08-24T21:42:05.937 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14438.log 2024-08-24T21:42:05.937 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.19148.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19148.log.gz 2024-08-24T21:42:05.937 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17054.log 2024-08-24T21:42:05.937 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.14438.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14438.log.gz 2024-08-24T21:42:05.938 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23516.log 2024-08-24T21:42:05.938 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.17054.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17054.log.gz 2024-08-24T21:42:05.938 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21894.log 2024-08-24T21:42:05.938 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.23516.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23516.log.gz 2024-08-24T21:42:05.938 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21547.log 2024-08-24T21:42:05.938 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.21894.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21894.log.gz 2024-08-24T21:42:05.938 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14479.log 2024-08-24T21:42:05.938 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.21547.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21547.log.gz 2024-08-24T21:42:05.938 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16016.log 2024-08-24T21:42:05.938 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.14479.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14479.log.gz 2024-08-24T21:42:05.938 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.13596.log 2024-08-24T21:42:05.938 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.16016.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.16016.log.gz 2024-08-24T21:42:05.938 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.13023.log 2024-08-24T21:42:05.939 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.13596.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.13596.log.gz 2024-08-24T21:42:05.939 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19972.log 2024-08-24T21:42:05.939 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.13023.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.13023.log.gz 2024-08-24T21:42:05.939 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14990.log 2024-08-24T21:42:05.939 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.19972.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19972.log.gz 2024-08-24T21:42:05.939 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15951.log 2024-08-24T21:42:05.939 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.14990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22758.log 2024-08-24T21:42:05.939 INFO:teuthology.orchestra.run.smithi179.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14990.log.gz 2024-08-24T21:42:05.939 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.15951.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15951.log.gz 2024-08-24T21:42:05.939 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18350.log 2024-08-24T21:42:05.939 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.22758.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22758.log.gzgzip 2024-08-24T21:42:05.939 INFO:teuthology.orchestra.run.smithi179.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.23190.log 2024-08-24T21:42:05.939 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.18350.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18350.log.gz 2024-08-24T21:42:05.940 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22024.log 2024-08-24T21:42:05.940 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.23190.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23190.log.gz 2024-08-24T21:42:05.940 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14499.log 2024-08-24T21:42:05.940 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.22024.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22024.log.gz 2024-08-24T21:42:05.940 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14376.log 2024-08-24T21:42:05.940 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.14499.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14499.log.gz 2024-08-24T21:42:05.940 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21418.log 2024-08-24T21:42:05.940 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.14376.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14376.log.gz 2024-08-24T21:42:05.940 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20728.log 2024-08-24T21:42:05.940 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.21418.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21418.log.gz 2024-08-24T21:42:05.940 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16514.log 2024-08-24T21:42:05.955 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-osd.7.log: /var/log/ceph/ceph-osd.4.log: 91.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-08-24T21:42:05.993 INFO:teuthology.orchestra.run.smithi119.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-08-24T21:42:05.999 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.47659.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47659.log.gz 2024-08-24T21:42:05.999 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48817.log 2024-08-24T21:42:05.999 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.44473.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44473.log.gz 2024-08-24T21:42:05.999 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31635.log 2024-08-24T21:42:05.999 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.48817.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48817.log.gz 2024-08-24T21:42:05.999 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28287.log 2024-08-24T21:42:05.999 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.31635.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31635.log.gz 2024-08-24T21:42:05.999 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37690.log 2024-08-24T21:42:05.999 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.28287.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28287.log.gz 2024-08-24T21:42:05.999 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37354.log 2024-08-24T21:42:06.000 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.37690.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37690.log.gz 2024-08-24T21:42:06.000 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22915.log 2024-08-24T21:42:06.000 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.37354.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37354.log.gz 2024-08-24T21:42:06.000 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47303.log 2024-08-24T21:42:06.000 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.22915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44011.log 2024-08-24T21:42:06.000 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22915.log.gz 2024-08-24T21:42:06.000 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.47303.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47303.log.gz 2024-08-24T21:42:06.000 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42067.log 2024-08-24T21:42:06.000 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33755.log 2024-08-24T21:42:06.000 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.44011.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44011.log.gz 2024-08-24T21:42:06.000 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42067.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42067.log.gz 2024-08-24T21:42:06.000 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30283.log 2024-08-24T21:42:06.001 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.33755.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33755.log.gz 2024-08-24T21:42:06.001 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41209.log 2024-08-24T21:42:06.001 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.30283.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30283.log.gz 2024-08-24T21:42:06.001 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43223.log 2024-08-24T21:42:06.001 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.41209.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41209.log.gz 2024-08-24T21:42:06.001 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26673.log 2024-08-24T21:42:06.001 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43223.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43223.log.gz 2024-08-24T21:42:06.001 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26001.log 2024-08-24T21:42:06.001 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.26673.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26673.log.gz 2024-08-24T21:42:06.001 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22735.log 2024-08-24T21:42:06.001 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.26001.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26001.log.gz 2024-08-24T21:42:06.001 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24725.log 2024-08-24T21:42:06.001 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.22735.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22735.log.gz 2024-08-24T21:42:06.002 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28933.log 2024-08-24T21:42:06.002 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.24725.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24725.log.gz 2024-08-24T21:42:06.002 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31974.log 2024-08-24T21:42:06.002 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.28933.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28933.log.gz 2024-08-24T21:42:06.002 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35301.log 2024-08-24T21:42:06.002 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.31974.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31974.log.gz 2024-08-24T21:42:06.002 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30691.log 2024-08-24T21:42:06.002 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.35301.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35301.log.gz 2024-08-24T21:42:06.002 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35091.log 2024-08-24T21:42:06.002 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.30691.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30691.log.gz 2024-08-24T21:42:06.002 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26883.log 2024-08-24T21:42:06.002 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.35091.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35091.log.gz 2024-08-24T21:42:06.003 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31366.log 2024-08-24T21:42:06.003 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.26883.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26883.log.gz 2024-08-24T21:42:06.003 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37480.log 2024-08-24T21:42:06.003 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.31366.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31366.log.gz 2024-08-24T21:42:06.003 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29525.log 2024-08-24T21:42:06.003 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.37480.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37480.log.gz 2024-08-24T21:42:06.003 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36115.log 2024-08-24T21:42:06.003 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.29525.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29525.log.gz 2024-08-24T21:42:06.003 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30409.log 2024-08-24T21:42:06.003 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.36115.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36115.log.gz 2024-08-24T21:42:06.003 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34965.log 2024-08-24T21:42:06.003 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.30409.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30409.log.gz 2024-08-24T21:42:06.003 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34317.log 2024-08-24T21:42:06.004 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.34965.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34965.log.gz 2024-08-24T21:42:06.004 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38382.log 2024-08-24T21:42:06.004 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.34317.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34317.log.gz 2024-08-24T21:42:06.004 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40578.log 2024-08-24T21:42:06.004 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.38382.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38382.log.gz 2024-08-24T21:42:06.004 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24851.log 2024-08-24T21:42:06.004 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.40578.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40578.log.gz 2024-08-24T21:42:06.004 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44515.log 2024-08-24T21:42:06.004 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.24851.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24851.log.gz 2024-08-24T21:42:06.004 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29651.log 2024-08-24T21:42:06.004 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.44515.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44515.log.gz 2024-08-24T21:42:06.004 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48396.log 2024-08-24T21:42:06.004 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.29651.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29651.log.gz 2024-08-24T21:42:06.005 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28497.log 2024-08-24T21:42:06.005 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.48396.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48396.log.gz 2024-08-24T21:42:06.005 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33713.log 2024-08-24T21:42:06.005 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.28497.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28497.log.gz 2024-08-24T21:42:06.005 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27656.log 2024-08-24T21:42:06.005 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.33713.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33713.log.gz 2024-08-24T21:42:06.005 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24037.log 2024-08-24T21:42:06.005 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.27656.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27656.log.gz 2024-08-24T21:42:06.005 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29819.log 2024-08-24T21:42:06.005 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.24037.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24037.log.gz 2024-08-24T21:42:06.005 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47647.log 2024-08-24T21:42:06.005 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.29819.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29819.log.gz 2024-08-24T21:42:06.005 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27219.log 2024-08-24T21:42:06.005 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.47647.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47647.log.gz 2024-08-24T21:42:06.006 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41941.log 2024-08-24T21:42:06.006 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.27219.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27219.log.gz 2024-08-24T21:42:06.006 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47135.log 2024-08-24T21:42:06.006 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.41941.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41941.log.gz 2024-08-24T21:42:06.006 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32479.log 2024-08-24T21:42:06.006 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.47135.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47135.log.gz 2024-08-24T21:42:06.006 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47721.log 2024-08-24T21:42:06.006 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.32479.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32479.log.gz 2024-08-24T21:42:06.006 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25749.log 2024-08-24T21:42:06.006 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.47721.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47721.log.gz 2024-08-24T21:42:06.006 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40452.log 2024-08-24T21:42:06.006 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.25749.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25749.log.gz 2024-08-24T21:42:06.007 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40016.log 2024-08-24T21:42:06.007 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.40452.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40452.log.gz 2024-08-24T21:42:06.007 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24457.log 2024-08-24T21:42:06.007 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.40016.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40016.log.gz 2024-08-24T21:42:06.007 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27261.log 2024-08-24T21:42:06.007 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.24457.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24457.log.gz 2024-08-24T21:42:06.007 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35007.log 2024-08-24T21:42:06.007 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.27261.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27261.log.gz 2024-08-24T21:42:06.007 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26085.log 2024-08-24T21:42:06.007 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.35007.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35007.log.gz 2024-08-24T21:42:06.007 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35527.log 2024-08-24T21:42:06.007 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.26085.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26085.log.gz 2024-08-24T21:42:06.007 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38907.log 2024-08-24T21:42:06.008 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.35527.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35527.log.gz 2024-08-24T21:42:06.008 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29693.log 2024-08-24T21:42:06.008 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.38907.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38907.log.gz 2024-08-24T21:42:06.008 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44893.log 2024-08-24T21:42:06.008 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.29693.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29693.log.gz 2024-08-24T21:42:06.008 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32353.log 2024-08-24T21:42:06.008 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.44893.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44893.log.gz 2024-08-24T21:42:06.008 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25791.log 2024-08-24T21:42:06.008 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.32353.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32353.log.gz 2024-08-24T21:42:06.008 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43055.log 2024-08-24T21:42:06.008 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.25791.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25791.log.gz 2024-08-24T21:42:06.008 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39469.log 2024-08-24T21:42:06.008 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43055.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43055.log.gz 2024-08-24T21:42:06.009 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36258.log 2024-08-24T21:42:06.009 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.39469.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39469.log.gz 2024-08-24T21:42:06.009 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48691.log 2024-08-24T21:42:06.009 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.36258.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36258.log.gz 2024-08-24T21:42:06.009 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26631.log 2024-08-24T21:42:06.009 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.48691.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48691.log.gz 2024-08-24T21:42:06.009 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47513.log 2024-08-24T21:42:06.009 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.26631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35737.log 2024-08-24T21:42:06.009 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26631.log.gz 2024-08-24T21:42:06.009 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.47513.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47513.log.gz 2024-08-24T21:42:06.009 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48649.log 2024-08-24T21:42:06.009 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.35737.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35737.log.gz 2024-08-24T21:42:06.009 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40914.log 2024-08-24T21:42:06.009 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.48649.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48649.log.gz 2024-08-24T21:42:06.010 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34065.log 2024-08-24T21:42:06.010 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.40914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48426.log 2024-08-24T21:42:06.010 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40914.log.gz 2024-08-24T21:42:06.010 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.34065.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34065.log.gz 2024-08-24T21:42:06.010 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24163.log 2024-08-24T21:42:06.010 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42971.log 2024-08-24T21:42:06.010 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.48426.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48426.log.gz 2024-08-24T21:42:06.010 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.24163.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24163.log.gz 2024-08-24T21:42:06.010 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24560.log 2024-08-24T21:42:06.010 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42971.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42971.log.gz 2024-08-24T21:42:06.010 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24415.log 2024-08-24T21:42:06.010 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.24560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42929.log 2024-08-24T21:42:06.011 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24560.log.gz 2024-08-24T21:42:06.011 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.24415.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24415.log.gz 2024-08-24T21:42:06.011 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46441.log 2024-08-24T21:42:06.011 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35569.log 2024-08-24T21:42:06.011 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42929.log.gz 2024-08-24T21:42:06.011 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46441.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46441.log.gz 2024-08-24T21:42:06.011 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40872.log 2024-08-24T21:42:06.011 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.35569.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35569.log.gz 2024-08-24T21:42:06.011 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45752.log 2024-08-24T21:42:06.011 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.40872.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40872.log.gz 2024-08-24T21:42:06.011 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44179.log 2024-08-24T21:42:06.014 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.45752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31113.log 2024-08-24T21:42:06.015 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45752.log.gz 2024-08-24T21:42:06.015 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.44179.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44179.log.gz 2024-08-24T21:42:06.015 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37014.log 2024-08-24T21:42:06.015 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.31113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48859.log 2024-08-24T21:42:06.015 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31113.log.gz 2024-08-24T21:42:06.015 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.37014.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37014.log.gz 2024-08-24T21:42:06.015 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31593.log 2024-08-24T21:42:06.015 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.48859.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48859.log.gz 2024-08-24T21:42:06.015 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27446.log 2024-08-24T21:42:06.015 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.31593.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31593.log.gz 2024-08-24T21:42:06.015 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45272.log 2024-08-24T21:42:06.015 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.27446.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27446.log.gz 2024-08-24T21:42:06.015 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33671.log 2024-08-24T21:42:06.035 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47429.log 2024-08-24T21:42:06.035 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.45272.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45272.log.gz 2024-08-24T21:42:06.035 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.33671.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33671.log.gz 2024-08-24T21:42:06.035 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26295.log 2024-08-24T21:42:06.035 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40200.log 2024-08-24T21:42:06.036 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.47429.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47429.log.gz 2024-08-24T21:42:06.036 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.26295.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48943.log 2024-08-24T21:42:06.036 INFO:teuthology.orchestra.run.smithi060.stderr: -- replaced with /var/log/ceph/ceph-client.admin.26295.log.gz 2024-08-24T21:42:06.036 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.40200.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40200.log.gz 2024-08-24T21:42:06.036 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44851.log 2024-08-24T21:42:06.036 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.48943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25145.log 2024-08-24T21:42:06.036 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48943.log.gz 2024-08-24T21:42:06.036 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.44851.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44851.log.gz 2024-08-24T21:42:06.036 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43659.log 2024-08-24T21:42:06.036 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.25145.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25145.log.gz 2024-08-24T21:42:06.036 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27698.log 2024-08-24T21:42:06.036 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25875.log 2024-08-24T21:42:06.037 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43659.log.gz 2024-08-24T21:42:06.037 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.27698.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27698.log.gz 2024-08-24T21:42:06.037 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34611.log 2024-08-24T21:42:06.037 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.25875.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.25875.log.gz --verbose 2024-08-24T21:42:06.037 INFO:teuthology.orchestra.run.smithi060.stderr: -- /var/log/ceph/ceph-client.admin.38424.log 2024-08-24T21:42:06.037 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.34611.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34611.log.gz 2024-08-24T21:42:06.037 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38823.log 2024-08-24T21:42:06.037 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.38424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25665.log 2024-08-24T21:42:06.037 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38424.log.gz 2024-08-24T21:42:06.037 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.38823.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38823.log.gz 2024-08-24T21:42:06.037 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28852.log 2024-08-24T21:42:06.037 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39427.log 2024-08-24T21:42:06.037 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.25665.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25665.log.gz 2024-08-24T21:42:06.038 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.28852.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.28852.log.gz /var/log/ceph/ceph-client.admin.23995.log 2024-08-24T21:42:06.038 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-08-24T21:42:06.038 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.39427.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39427.log.gz 2024-08-24T21:42:06.038 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33377.log 2024-08-24T21:42:06.038 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.23995.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-08-24T21:42:06.038 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23995.log.gz 2024-08-24T21:42:06.038 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.33377.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33377.log.gz 2024-08-24T21:42:06.038 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31887.log 2024-08-24T21:42:06.038 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38007.log 2024-08-24T21:42:06.038 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.31887.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42235.log 2024-08-24T21:42:06.038 INFO:teuthology.orchestra.run.smithi060.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31887.log.gz 2024-08-24T21:42:06.038 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.38007.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38007.log.gz 2024-08-24T21:42:06.038 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23199.log 2024-08-24T21:42:06.039 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42235.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42235.log.gz 2024-08-24T21:42:06.039 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46525.log 2024-08-24T21:42:06.039 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.23199.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23199.log.gz 2024-08-24T21:42:06.039 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42193.log 2024-08-24T21:42:06.039 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46525.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46525.log.gz 2024-08-24T21:42:06.039 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24499.log 2024-08-24T21:42:06.039 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42193.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42193.log.gz 2024-08-24T21:42:06.039 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27135.log 2024-08-24T21:42:06.039 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.24499.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24499.log.gz 2024-08-24T21:42:06.039 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32395.log 2024-08-24T21:42:06.039 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.27135.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27135.log.gz 2024-08-24T21:42:06.039 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48122.log 2024-08-24T21:42:06.040 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.32395.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32395.log.gz 2024-08-24T21:42:06.040 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31155.log 2024-08-24T21:42:06.040 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.48122.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48122.log.gz 2024-08-24T21:42:06.040 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40956.log 2024-08-24T21:42:06.040 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.31155.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25371.log 2024-08-24T21:42:06.040 INFO:teuthology.orchestra.run.smithi060.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31155.log.gz 2024-08-24T21:42:06.040 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.40956.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40956.log.gz 2024-08-24T21:42:06.047 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22388.log 2024-08-24T21:42:06.048 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.25371.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25371.log.gz 2024-08-24T21:42:06.048 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23911.log 2024-08-24T21:42:06.048 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.22388.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29273.log 2024-08-24T21:42:06.048 INFO:teuthology.orchestra.run.smithi060.stderr: -- replaced with /var/log/ceph/ceph-client.admin.22388.log.gz 2024-08-24T21:42:06.048 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.23911.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23911.log.gz 2024-08-24T21:42:06.048 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23586.log 2024-08-24T21:42:06.048 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.29273.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29273.log.gz 2024-08-24T21:42:06.048 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.23586.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23586.log.gz 2024-08-24T21:42:06.048 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43265.log 2024-08-24T21:42:06.048 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18280.log 2024-08-24T21:42:06.048 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43265.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43265.log.gz 2024-08-24T21:42:06.048 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40119.log 2024-08-24T21:42:06.049 INFO:teuthology.orchestra.run.smithi060.stderr: 94.3% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-08-24T21:42:06.049 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.18280.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18280.log.gz 2024-08-24T21:42:06.049 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39679.log 2024-08-24T21:42:06.049 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30861.log 2024-08-24T21:42:06.049 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.40119.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40119.log.gz 2024-08-24T21:42:06.049 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.39679.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39679.log.gz 2024-08-24T21:42:06.049 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44935.log 2024-08-24T21:42:06.053 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.30861.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30861.log.gz 2024-08-24T21:42:06.053 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35779.log 2024-08-24T21:42:06.053 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.44935.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44935.log.gz 2024-08-24T21:42:06.054 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25917.log 2024-08-24T21:42:06.054 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.35779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44053.log 2024-08-24T21:42:06.054 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35779.log.gz 2024-08-24T21:42:06.054 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.25917.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25917.log.gz 2024-08-24T21:42:06.054 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33086.log 2024-08-24T21:42:06.054 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27365.log 2024-08-24T21:42:06.054 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.44053.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44053.log.gz 2024-08-24T21:42:06.059 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.33086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38550.log 2024-08-24T21:42:06.059 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33086.log.gz 2024-08-24T21:42:06.060 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.27365.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27365.log.gz 2024-08-24T21:42:06.060 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44095.log 2024-08-24T21:42:06.060 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.38550.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38550.log.gz 2024-08-24T21:42:06.060 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45230.log 2024-08-24T21:42:06.060 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.44095.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44095.log.gz 2024-08-24T21:42:06.060 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47975.log 2024-08-24T21:42:06.060 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.45230.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45230.log.gz 2024-08-24T21:42:06.060 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34695.log 2024-08-24T21:42:06.063 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.47975.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47975.log.gz 2024-08-24T21:42:06.064 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27177.log 2024-08-24T21:42:06.064 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.34695.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34695.log.gz 2024-08-24T21:42:06.064 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37098.log 2024-08-24T21:42:06.064 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.27177.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27177.log.gz 2024-08-24T21:42:06.064 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29609.log 2024-08-24T21:42:06.066 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.20728.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20728.log.gz 2024-08-24T21:42:06.067 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18089.log 2024-08-24T21:42:06.067 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.16514.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.16514.log.gz 2024-08-24T21:42:06.067 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20080.log 2024-08-24T21:42:06.067 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.18089.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18089.log.gz 2024-08-24T21:42:06.067 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17096.log 2024-08-24T21:42:06.067 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.20080.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20080.log.gz 2024-08-24T21:42:06.067 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19322.log 2024-08-24T21:42:06.067 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.17096.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17096.log.gz 2024-08-24T21:42:06.067 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19667.log 2024-08-24T21:42:06.067 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.19322.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19322.log.gz 2024-08-24T21:42:06.067 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20101.log 2024-08-24T21:42:06.067 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.19667.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19667.log.gz 2024-08-24T21:42:06.068 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.12877.log 2024-08-24T21:42:06.068 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.20101.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20101.log.gz 2024-08-24T21:42:06.068 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19235.log 2024-08-24T21:42:06.068 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.12877.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.12877.log.gz 2024-08-24T21:42:06.068 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15033.log 2024-08-24T21:42:06.068 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.19235.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19235.log.gz 2024-08-24T21:42:06.068 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23082.log 2024-08-24T21:42:06.068 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.15033.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15033.log.gz 2024-08-24T21:42:06.068 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.12595.log 2024-08-24T21:42:06.068 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.23082.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23082.log.gz 2024-08-24T21:42:06.068 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19904.log 2024-08-24T21:42:06.068 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.12595.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.12595.log.gz 2024-08-24T21:42:06.069 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14166.log 2024-08-24T21:42:06.069 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.19904.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19904.log.gz 2024-08-24T21:42:06.069 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22498.log 2024-08-24T21:42:06.069 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.14166.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14166.log.gz 2024-08-24T21:42:06.069 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15412.log 2024-08-24T21:42:06.069 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.22498.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22498.log.gz 2024-08-24T21:42:06.069 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20296.log 2024-08-24T21:42:06.069 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.15412.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15412.log.gz 2024-08-24T21:42:06.069 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.12732.log 2024-08-24T21:42:06.069 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.20296.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20296.log.gz 2024-08-24T21:42:06.069 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17225.log 2024-08-24T21:42:06.069 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.12732.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.12732.log.gz 2024-08-24T21:42:06.069 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15053.log 2024-08-24T21:42:06.070 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.17225.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17225.log.gz 2024-08-24T21:42:06.070 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18890.log 2024-08-24T21:42:06.070 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.15053.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15053.log.gz 2024-08-24T21:42:06.070 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14626.log 2024-08-24T21:42:06.070 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.18890.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18890.log.gz 2024-08-24T21:42:06.070 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19950.log 2024-08-24T21:42:06.070 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.14626.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14626.log.gz 2024-08-24T21:42:06.070 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23233.log 2024-08-24T21:42:06.070 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.19950.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19950.log.gz 2024-08-24T21:42:06.070 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18608.log 2024-08-24T21:42:06.070 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.23233.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23233.log.gz 2024-08-24T21:42:06.070 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17831.log 2024-08-24T21:42:06.071 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.18608.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18608.log.gz 2024-08-24T21:42:06.071 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20598.log 2024-08-24T21:42:06.071 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.17831.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17831.log.gz 2024-08-24T21:42:06.071 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20836.log 2024-08-24T21:42:06.071 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.20598.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20598.log.gz 2024-08-24T21:42:06.071 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15263.log 2024-08-24T21:42:06.071 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.20836.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20836.log.gz 2024-08-24T21:42:06.071 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16103.log 2024-08-24T21:42:06.071 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.15263.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15263.log.gz 2024-08-24T21:42:06.071 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22002.log 2024-08-24T21:42:06.071 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.16103.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.16103.log.gz 2024-08-24T21:42:06.071 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15671.log 2024-08-24T21:42:06.071 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.22002.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22002.log.gz 2024-08-24T21:42:06.072 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22974.log 2024-08-24T21:42:06.072 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.15671.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15671.log.gz 2024-08-24T21:42:06.072 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18413.log 2024-08-24T21:42:06.072 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.22974.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22974.log.gz 2024-08-24T21:42:06.072 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22369.log 2024-08-24T21:42:06.072 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.18413.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18413.log.gz 2024-08-24T21:42:06.072 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18436.log 2024-08-24T21:42:06.072 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.22369.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22369.log.gz 2024-08-24T21:42:06.072 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14583.log 2024-08-24T21:42:06.072 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.18436.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18436.log.gz 2024-08-24T21:42:06.072 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15816.log 2024-08-24T21:42:06.072 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.14583.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14583.log.gz 2024-08-24T21:42:06.072 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14730.log 2024-08-24T21:42:06.072 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.15816.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15816.log.gz 2024-08-24T21:42:06.073 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.13168.log 2024-08-24T21:42:06.073 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.14730.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14730.log.gz 2024-08-24T21:42:06.073 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19538.log 2024-08-24T21:42:06.073 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.13168.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.13168.log.gz 2024-08-24T21:42:06.073 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21526.log 2024-08-24T21:42:06.073 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.19538.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19538.log.gz 2024-08-24T21:42:06.073 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16622.log 2024-08-24T21:42:06.073 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.21526.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21526.log.gz 2024-08-24T21:42:06.073 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15094.log 2024-08-24T21:42:06.073 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.16622.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.16622.log.gz 2024-08-24T21:42:06.073 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15495.log 2024-08-24T21:42:06.073 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.15094.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15094.log.gz 2024-08-24T21:42:06.073 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23428.log 2024-08-24T21:42:06.074 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.15495.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15495.log.gz 2024-08-24T21:42:06.074 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14771.log 2024-08-24T21:42:06.074 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.23428.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23428.log.gz 2024-08-24T21:42:06.074 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20188.log 2024-08-24T21:42:06.074 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.14771.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14771.log.gz 2024-08-24T21:42:06.074 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16145.log 2024-08-24T21:42:06.074 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.20188.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20188.log.gz 2024-08-24T21:42:06.074 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16643.log 2024-08-24T21:42:06.074 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.16145.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.16145.log.gz 2024-08-24T21:42:06.074 INFO:teuthology.orchestra.run.smithi179.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.22195.log 2024-08-24T21:42:06.074 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.16643.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.16643.log.gz 2024-08-24T21:42:06.074 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20058.log 2024-08-24T21:42:06.075 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.22195.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22195.log.gz 2024-08-24T21:42:06.075 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23059.log 2024-08-24T21:42:06.075 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.20058.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20058.log.gz 2024-08-24T21:42:06.075 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17765.log 2024-08-24T21:42:06.075 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.23059.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23059.log.gz 2024-08-24T21:42:06.075 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22606.log 2024-08-24T21:42:06.075 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.17765.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17765.log.gz 2024-08-24T21:42:06.075 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20404.log 2024-08-24T21:42:06.075 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.22606.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22606.log.gz 2024-08-24T21:42:06.075 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.13657.log 2024-08-24T21:42:06.075 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.20404.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20404.log.gz 2024-08-24T21:42:06.076 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17183.log 2024-08-24T21:42:06.076 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.13657.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.13657.log.gz 2024-08-24T21:42:06.076 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20317.log 2024-08-24T21:42:06.076 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.17183.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17183.log.gz 2024-08-24T21:42:06.076 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16901.log 2024-08-24T21:42:06.076 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.20317.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20317.log.gz 2024-08-24T21:42:06.076 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15115.log 2024-08-24T21:42:06.076 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.16901.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.16901.log.gz 2024-08-24T21:42:06.076 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16793.log 2024-08-24T21:42:06.076 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.15115.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15115.log.gz 2024-08-24T21:42:06.076 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18544.log 2024-08-24T21:42:06.076 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.16793.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.16793.log.gz 2024-08-24T21:42:06.077 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18305.log 2024-08-24T21:42:06.077 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.18544.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18544.log.gz 2024-08-24T21:42:06.077 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20814.log 2024-08-24T21:42:06.077 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.18305.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18305.log.gz 2024-08-24T21:42:06.077 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15346.log 2024-08-24T21:42:06.077 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.20814.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20814.log.gz 2024-08-24T21:42:06.077 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22303.log 2024-08-24T21:42:06.077 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.15346.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15346.log.gz 2024-08-24T21:42:06.077 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16211.log 2024-08-24T21:42:06.077 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.22303.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22303.log.gz 2024-08-24T21:42:06.077 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20791.log 2024-08-24T21:42:06.077 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.16211.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.16211.log.gz 2024-08-24T21:42:06.077 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20382.log 2024-08-24T21:42:06.078 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.20791.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20791.log.gz 2024-08-24T21:42:06.078 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19451.log 2024-08-24T21:42:06.078 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.20382.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20382.log.gz 2024-08-24T21:42:06.078 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21958.log 2024-08-24T21:42:06.078 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.19451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17918.log 2024-08-24T21:42:06.078 INFO:teuthology.orchestra.run.smithi179.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19451.log.gz 2024-08-24T21:42:06.078 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.21958.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21958.log.gz 2024-08-24T21:42:06.078 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19862.log 2024-08-24T21:42:06.078 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.17918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.12939.log 2024-08-24T21:42:06.078 INFO:teuthology.orchestra.run.smithi179.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17918.log.gz 2024-08-24T21:42:06.078 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.19862.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19862.log.gz 2024-08-24T21:42:06.078 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22326.log 2024-08-24T21:42:06.078 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.12939.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.12939.log.gz 2024-08-24T21:42:06.079 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.13148.log 2024-08-24T21:42:06.079 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.22326.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22326.log.gz 2024-08-24T21:42:06.079 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15326.log 2024-08-24T21:42:06.079 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.13148.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.13148.log.gz 2024-08-24T21:42:06.079 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22866.log 2024-08-24T21:42:06.079 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.15326.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15326.log.gz 2024-08-24T21:42:06.079 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16730.log 2024-08-24T21:42:06.079 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.22866.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22866.log.gz 2024-08-24T21:42:06.079 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18500.log 2024-08-24T21:42:06.079 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.16730.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.16730.log.gz 2024-08-24T21:42:06.079 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15796.log 2024-08-24T21:42:06.079 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.18500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21850.log 2024-08-24T21:42:06.080 INFO:teuthology.orchestra.run.smithi179.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18500.log.gz 2024-08-24T21:42:06.080 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.15796.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15796.log.gz 2024-08-24T21:42:06.080 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20620.log 2024-08-24T21:42:06.080 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.21850.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21850.log.gz 2024-08-24T21:42:06.080 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21721.log 2024-08-24T21:42:06.080 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.20620.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20620.log.gz 2024-08-24T21:42:06.080 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16082.log 2024-08-24T21:42:06.080 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.21721.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21721.log.gz 2024-08-24T21:42:06.080 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23275.log 2024-08-24T21:42:06.080 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.16082.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.16082.log.gz 2024-08-24T21:42:06.080 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.13847.log 2024-08-24T21:42:06.080 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.23275.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23275.log.gz 2024-08-24T21:42:06.080 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.13086.log 2024-08-24T21:42:06.081 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.13847.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.13847.log.gz 2024-08-24T21:42:06.081 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23341.log 2024-08-24T21:42:06.081 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.13086.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.13086.log.gz 2024-08-24T21:42:06.081 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17528.log 2024-08-24T21:42:06.081 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.23341.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23341.log.gz 2024-08-24T21:42:06.081 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.13616.log 2024-08-24T21:42:06.081 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.17528.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17528.log.gz 2024-08-24T21:42:06.081 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18716.log 2024-08-24T21:42:06.081 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.13616.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.13616.log.gz 2024-08-24T21:42:06.081 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17356.log 2024-08-24T21:42:06.081 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.18716.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18716.log.gz 2024-08-24T21:42:06.081 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21376.log 2024-08-24T21:42:06.082 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.17356.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17356.log.gz 2024-08-24T21:42:06.082 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15305.log 2024-08-24T21:42:06.082 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.21376.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21376.log.gz 2024-08-24T21:42:06.082 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14750.log 2024-08-24T21:42:06.082 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.15305.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15305.log.gz 2024-08-24T21:42:06.082 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15135.log 2024-08-24T21:42:06.082 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.14750.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14750.log.gz 2024-08-24T21:42:06.082 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21223.log 2024-08-24T21:42:06.082 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.15135.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15135.log.gz 2024-08-24T21:42:06.082 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17680.log 2024-08-24T21:42:06.082 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.21223.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21223.log.gz 2024-08-24T21:42:06.082 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14293.log 2024-08-24T21:42:06.082 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.17680.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17680.log.gz 2024-08-24T21:42:06.083 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20014.log 2024-08-24T21:42:06.083 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.14293.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14293.log.gz 2024-08-24T21:42:06.083 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20749.log 2024-08-24T21:42:06.083 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.20014.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20014.log.gz 2024-08-24T21:42:06.083 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14397.log 2024-08-24T21:42:06.083 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.20749.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20749.log.gz 2024-08-24T21:42:06.083 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16988.log 2024-08-24T21:42:06.083 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.14397.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14397.log.gz 2024-08-24T21:42:06.083 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14791.log 2024-08-24T21:42:06.083 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.16988.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.16988.log.gz 2024-08-24T21:42:06.083 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14709.log 2024-08-24T21:42:06.083 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.14791.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14791.log.gz 2024-08-24T21:42:06.083 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.13127.log 2024-08-24T21:42:06.084 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.14709.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14709.log.gz 2024-08-24T21:42:06.084 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17981.log 2024-08-24T21:42:06.084 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.13127.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.13127.log.gz 2024-08-24T21:42:06.084 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17333.log 2024-08-24T21:42:06.084 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.17981.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17981.log.gz 2024-08-24T21:42:06.084 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.13209.log 2024-08-24T21:42:06.084 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.17333.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17333.log.gz 2024-08-24T21:42:06.084 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16880.log 2024-08-24T21:42:06.084 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.13209.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.13209.log.gz 2024-08-24T21:42:06.084 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19883.log 2024-08-24T21:42:06.084 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.16880.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.16880.log.gz 2024-08-24T21:42:06.084 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17270.log 2024-08-24T21:42:06.084 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.19883.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19883.log.gz 2024-08-24T21:42:06.085 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19214.log 2024-08-24T21:42:06.085 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.17270.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17270.log.gz 2024-08-24T21:42:06.085 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.13961.log 2024-08-24T21:42:06.085 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.19214.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19214.log.gz 2024-08-24T21:42:06.085 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19364.log 2024-08-24T21:42:06.085 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.13961.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.13961.log.gz 2024-08-24T21:42:06.085 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17009.log 2024-08-24T21:42:06.085 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.19364.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19364.log.gz 2024-08-24T21:42:06.085 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17248.log 2024-08-24T21:42:06.085 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.17009.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17009.log.gz 2024-08-24T21:42:06.085 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19343.log 2024-08-24T21:42:06.085 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.17248.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17248.log.gz 2024-08-24T21:42:06.086 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16838.log 2024-08-24T21:42:06.086 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.19343.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19343.log.gz 2024-08-24T21:42:06.086 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21331.log 2024-08-24T21:42:06.086 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.16838.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.16838.log.gz 2024-08-24T21:42:06.086 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15894.log 2024-08-24T21:42:06.086 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.21331.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21331.log.gz 2024-08-24T21:42:06.086 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14668.log 2024-08-24T21:42:06.086 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.15894.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15894.log.gz 2024-08-24T21:42:06.086 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15714.log 2024-08-24T21:42:06.086 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.14668.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14668.log.gz 2024-08-24T21:42:06.086 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17636.log 2024-08-24T21:42:06.086 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.15714.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15714.log.gz 2024-08-24T21:42:06.086 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19472.log 2024-08-24T21:42:06.087 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.17636.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17636.log.gz 2024-08-24T21:42:06.087 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18220.log 2024-08-24T21:42:06.087 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.19472.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19472.log.gz 2024-08-24T21:42:06.087 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17594.log 2024-08-24T21:42:06.087 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.18220.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18220.log.gz 2024-08-24T21:42:06.087 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21570.log 2024-08-24T21:42:06.087 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.17594.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17594.log.gz 2024-08-24T21:42:06.087 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18868.log 2024-08-24T21:42:06.087 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.21570.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21570.log.gz 2024-08-24T21:42:06.087 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22843.log 2024-08-24T21:42:06.087 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.18868.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18868.log.gz 2024-08-24T21:42:06.087 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19493.log 2024-08-24T21:42:06.087 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.22843.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22843.log.gz 2024-08-24T21:42:06.088 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17939.log 2024-08-24T21:42:06.088 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.19493.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19493.log.gz 2024-08-24T21:42:06.088 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22585.log 2024-08-24T21:42:06.088 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.17939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17810.log 2024-08-24T21:42:06.088 INFO:teuthology.orchestra.run.smithi179.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17939.log.gz 2024-08-24T21:42:06.088 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.22585.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22585.log.gz 2024-08-24T21:42:06.088 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20143.log 2024-08-24T21:42:06.088 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.17810.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17810.log.gz 2024-08-24T21:42:06.088 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17486.log 2024-08-24T21:42:06.088 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.20143.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20143.log.gz 2024-08-24T21:42:06.088 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19516.log 2024-08-24T21:42:06.088 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.17486.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17486.log.gz 2024-08-24T21:42:06.088 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22045.log 2024-08-24T21:42:06.089 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.19516.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19516.log.gz 2024-08-24T21:42:06.089 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21592.log 2024-08-24T21:42:06.089 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.22045.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22045.log.gz 2024-08-24T21:42:06.089 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20662.log 2024-08-24T21:42:06.089 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.21592.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21592.log.gz 2024-08-24T21:42:06.089 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19408.log 2024-08-24T21:42:06.089 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.20662.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20662.log.gz 2024-08-24T21:42:06.089 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15995.log 2024-08-24T21:42:06.089 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.19408.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19408.log.gz 2024-08-24T21:42:06.089 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18845.log 2024-08-24T21:42:06.089 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.15995.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15995.log.gz 2024-08-24T21:42:06.089 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21613.log 2024-08-24T21:42:06.089 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.18845.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18845.log.gz 2024-08-24T21:42:06.090 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19300.log 2024-08-24T21:42:06.090 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.21613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18782.log 2024-08-24T21:42:06.090 INFO:teuthology.orchestra.run.smithi179.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21613.log.gz 2024-08-24T21:42:06.090 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.19300.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19300.log.gz 2024-08-24T21:42:06.090 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21634.log 2024-08-24T21:42:06.090 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.18782.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18782.log.gz 2024-08-24T21:42:06.090 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22434.log 2024-08-24T21:42:06.090 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.21634.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21634.log.gz 2024-08-24T21:42:06.090 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15755.log 2024-08-24T21:42:06.090 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.22434.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22434.log.gz 2024-08-24T21:42:06.090 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16060.log 2024-08-24T21:42:06.090 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.15755.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15755.log.gz 2024-08-24T21:42:06.090 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.16060.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.16060.log.gz 2024-08-24T21:42:06.091 INFO:teuthology.orchestra.run.smithi179.stderr: 2024-08-24T21:42:06.091 INFO:teuthology.orchestra.run.smithi179.stderr:real 0m0.416s 2024-08-24T21:42:06.091 INFO:teuthology.orchestra.run.smithi179.stderr:user 0m0.078s 2024-08-24T21:42:06.091 INFO:teuthology.orchestra.run.smithi179.stderr:sys 0m0.831s 2024-08-24T21:42:06.102 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.37098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47849.log 2024-08-24T21:42:06.102 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37098.log.gz 2024-08-24T21:42:06.102 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.29609.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29609.log.gz 2024-08-24T21:42:06.102 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38340.log 2024-08-24T21:42:06.103 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35343.log 2024-08-24T21:42:06.103 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.47849.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47849.log.gz 2024-08-24T21:42:06.103 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.38340.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38340.log.gz 2024-08-24T21:42:06.103 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41546.log 2024-08-24T21:42:06.103 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41773.log 2024-08-24T21:42:06.103 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.35343.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35343.log.gz 2024-08-24T21:42:06.103 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.41546.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41546.log.gz 2024-08-24T21:42:06.103 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45356.log 2024-08-24T21:42:06.103 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48116.log 2024-08-24T21:42:06.103 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.41773.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41773.log.gz 2024-08-24T21:42:06.103 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.45356.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45356.log.gz 2024-08-24T21:42:06.103 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48312.log 2024-08-24T21:42:06.104 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35385.log 2024-08-24T21:42:06.104 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.48116.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48116.log.gz 2024-08-24T21:42:06.104 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.48312.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48312.log.gz 2024-08-24T21:42:06.104 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40410.log 2024-08-24T21:42:06.104 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.35385.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35385.log.gz 2024-08-24T21:42:06.104 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25497.log 2024-08-24T21:42:06.104 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.40410.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40410.log.gz 2024-08-24T21:42:06.104 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36031.log 2024-08-24T21:42:06.104 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.25497.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25497.log.gz 2024-08-24T21:42:06.104 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36594.log 2024-08-24T21:42:06.104 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.36031.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36031.log.gz 2024-08-24T21:42:06.104 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27824.log 2024-08-24T21:42:06.105 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.36594.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36594.log.gz 2024-08-24T21:42:06.105 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24289.log 2024-08-24T21:42:06.105 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.27824.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27824.log.gz 2024-08-24T21:42:06.105 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41125.log 2024-08-24T21:42:06.105 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.24289.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24289.log.gz 2024-08-24T21:42:06.105 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47051.log 2024-08-24T21:42:06.105 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.41125.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41125.log.gz 2024-08-24T21:42:06.105 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26715.log 2024-08-24T21:42:06.105 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.47051.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47051.log.gz 2024-08-24T21:42:06.105 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34443.log 2024-08-24T21:42:06.105 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.26715.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26715.log.gz 2024-08-24T21:42:06.105 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33335.log 2024-08-24T21:42:06.105 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.34443.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34443.log.gz 2024-08-24T21:42:06.106 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31761.log 2024-08-24T21:42:06.106 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.33335.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33335.log.gz 2024-08-24T21:42:06.106 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48480.log 2024-08-24T21:42:06.106 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.31761.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31761.log.gz 2024-08-24T21:42:06.106 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27782.log 2024-08-24T21:42:06.106 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.48480.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48480.log.gz 2024-08-24T21:42:06.106 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46737.log 2024-08-24T21:42:06.106 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.27782.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27782.log.gz 2024-08-24T21:42:06.106 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22916.log 2024-08-24T21:42:06.106 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46737.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46737.log.gz 2024-08-24T21:42:06.106 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44389.log 2024-08-24T21:42:06.106 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.22916.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22916.log.gz 2024-08-24T21:42:06.107 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27303.log 2024-08-24T21:42:06.107 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.44389.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44389.log.gz 2024-08-24T21:42:06.107 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48564.log 2024-08-24T21:42:06.107 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.27303.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27303.log.gz 2024-08-24T21:42:06.107 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34107.log 2024-08-24T21:42:06.107 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.48564.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48564.log.gz 2024-08-24T21:42:06.107 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34275.log 2024-08-24T21:42:06.107 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.34107.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34107.log.gz 2024-08-24T21:42:06.107 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37182.log 2024-08-24T21:42:06.107 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.34275.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34275.log.gz 2024-08-24T21:42:06.107 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32899.log 2024-08-24T21:42:06.107 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.37182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32815.log 2024-08-24T21:42:06.107 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37182.log.gz 2024-08-24T21:42:06.110 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.32899.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32899.log.gz 2024-08-24T21:42:06.110 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37564.log 2024-08-24T21:42:06.110 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36510.log 2024-08-24T21:42:06.110 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.32815.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32815.log.gz 2024-08-24T21:42:06.110 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.37564.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37564.log.gz 2024-08-24T21:42:06.111 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30819.log 2024-08-24T21:42:06.111 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38592.log 2024-08-24T21:42:06.111 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.36510.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36510.log.gz 2024-08-24T21:42:06.111 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.30819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41041.log 2024-08-24T21:42:06.111 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30819.log.gz 2024-08-24T21:42:06.111 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.38592.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38592.log.gz 2024-08-24T21:42:06.111 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41857.log 2024-08-24T21:42:06.111 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.41041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40746.log 2024-08-24T21:42:06.111 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41041.log.gz 2024-08-24T21:42:06.111 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.41857.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41857.log.gz 2024-08-24T21:42:06.112 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45104.log 2024-08-24T21:42:06.112 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30115.log 2024-08-24T21:42:06.112 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.40746.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40746.log.gz 2024-08-24T21:42:06.112 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.45104.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45104.log.gz 2024-08-24T21:42:06.113 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31408.log 2024-08-24T21:42:06.114 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.30115.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30115.log.gz 2024-08-24T21:42:06.114 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24935.log 2024-08-24T21:42:06.115 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.31408.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31408.log.gz 2024-08-24T21:42:06.115 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32941.log 2024-08-24T21:42:06.116 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.24935.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24935.log.gz 2024-08-24T21:42:06.117 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26253.log 2024-08-24T21:42:06.117 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.32941.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32941.log.gz 2024-08-24T21:42:06.118 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44431.log 2024-08-24T21:42:06.119 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.26253.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26253.log.gz 2024-08-24T21:42:06.119 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38949.log 2024-08-24T21:42:06.120 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.44431.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44431.log.gz 2024-08-24T21:42:06.120 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26127.log 2024-08-24T21:42:06.121 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.38949.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38949.log.gz 2024-08-24T21:42:06.122 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41167.log 2024-08-24T21:42:06.122 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.26127.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26127.log.gz 2024-08-24T21:42:06.123 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47345.log 2024-08-24T21:42:06.124 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.41167.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41167.log.gz 2024-08-24T21:42:06.124 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39033.log 2024-08-24T21:42:06.125 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.47345.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47345.log.gz 2024-08-24T21:42:06.125 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24809.log 2024-08-24T21:42:06.126 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.39033.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39033.log.gz 2024-08-24T21:42:06.127 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29017.log 2024-08-24T21:42:06.128 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.24809.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24809.log.gz 2024-08-24T21:42:06.128 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-08-24T21:42:06.129 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.29017.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29017.log.gz 2024-08-24T21:42:06.129 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31197.log 2024-08-24T21:42:06.130 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36636.log 2024-08-24T21:42:06.132 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.31197.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39805.log 2024-08-24T21:42:06.132 INFO:teuthology.orchestra.run.smithi060.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31197.log.gz 2024-08-24T21:42:06.132 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.36636.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36636.log.gz 2024-08-24T21:42:06.133 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-08-24T21:42:06.134 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.39805.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39805.log.gz 2024-08-24T21:42:06.134 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46779.log 2024-08-24T21:42:06.135 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35905.log 2024-08-24T21:42:06.137 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46779.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46779.log.gz 2024-08-24T21:42:06.137 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.35905.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35905.log.gz 2024-08-24T21:42:06.138 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38466.log 2024-08-24T21:42:06.140 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41251.log 2024-08-24T21:42:06.140 INFO:teuthology.orchestra.run.smithi060.stderr: 94.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-08-24T21:42:06.140 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.38466.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38466.log.gz 2024-08-24T21:42:06.141 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36888.log 2024-08-24T21:42:06.141 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.41251.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41251.log.gz 2024-08-24T21:42:06.142 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28118.log 2024-08-24T21:42:06.143 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.36888.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29483.log 2024-08-24T21:42:06.143 INFO:teuthology.orchestra.run.smithi060.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36888.log.gz 2024-08-24T21:42:06.144 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.28118.log: gzip -5 --verbose 0.0% -- /var/log/ceph/ceph-client.admin.46046.log -- replaced with /var/log/ceph/ceph-client.admin.28118.log.gz 2024-08-24T21:42:06.145 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-08-24T21:42:06.146 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.29483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45962.log 2024-08-24T21:42:06.146 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29483.log.gz 2024-08-24T21:42:06.146 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46046.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46046.log.gz 2024-08-24T21:42:06.147 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43885.log 2024-08-24T21:42:06.148 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.45962.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45962.log.gz 2024-08-24T21:42:06.149 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38256.log 2024-08-24T21:42:06.149 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43885.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43885.log.gz 2024-08-24T21:42:06.150 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43927.log 2024-08-24T21:42:06.151 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.38256.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28329.log 2024-08-24T21:42:06.151 INFO:teuthology.orchestra.run.smithi060.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38256.log.gz 2024-08-24T21:42:06.152 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43927.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43927.log.gz 2024-08-24T21:42:06.152 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42887.log 2024-08-24T21:42:06.153 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.28329.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28329.log.gz 2024-08-24T21:42:06.153 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-08-24T21:42:06.155 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42887.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42887.log.gz -5 2024-08-24T21:42:06.155 INFO:teuthology.orchestra.run.smithi060.stderr: --verbose -- /var/log/ceph/ceph-client.admin.28665.log 2024-08-24T21:42:06.156 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45524.log 2024-08-24T21:42:06.157 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.28665.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28665.log.gz 2024-08-24T21:42:06.158 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.45524.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45524.log.gz 2024-08-24T21:42:06.158 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46567.log 2024-08-24T21:42:06.160 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29399.log 2024-08-24T21:42:06.161 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46567.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46567.log.gz 2024-08-24T21:42:06.162 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.29399.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29399.log.gz 2024-08-24T21:42:06.163 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41983.log 2024-08-24T21:42:06.164 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43365.log 2024-08-24T21:42:06.165 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.41983.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41983.log.gz 2024-08-24T21:42:06.166 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43365.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43365.log.gz 2024-08-24T21:42:06.167 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35133.log 2024-08-24T21:42:06.168 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44599.log 2024-08-24T21:42:06.169 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.35133.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35133.log.gz 2024-08-24T21:42:06.170 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.44599.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44599.log.gz 2024-08-24T21:42:06.171 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46928.log 2024-08-24T21:42:06.172 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36720.log 2024-08-24T21:42:06.173 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46928.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46928.log.gz 2024-08-24T21:42:06.175 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.36720.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36720.log.gz 2024-08-24T21:42:06.175 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35259.log 2024-08-24T21:42:06.177 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38172.log 2024-08-24T21:42:06.178 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.35259.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35259.log.gz 2024-08-24T21:42:06.179 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.38172.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38172.log.gz 2024-08-24T21:42:06.179 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45019.log 2024-08-24T21:42:06.181 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34779.log 2024-08-24T21:42:06.182 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.45019.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45019.log.gz 2024-08-24T21:42:06.183 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.34779.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34779.log.gz 2024-08-24T21:42:06.183 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47471.log 2024-08-24T21:42:06.185 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30241.log 2024-08-24T21:42:06.186 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.47471.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47471.log.gz 2024-08-24T21:42:06.187 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.30241.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30241.log.gz 2024-08-24T21:42:06.188 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28539.log 2024-08-24T21:42:06.189 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30367.log 2024-08-24T21:42:06.190 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.28539.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28539.log.gz 2024-08-24T21:42:06.191 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.30367.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30367.log.gz 2024-08-24T21:42:06.192 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27051.log 2024-08-24T21:42:06.193 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37266.log 2024-08-24T21:42:06.194 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.27051.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27051.log.gz 2024-08-24T21:42:06.195 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.37266.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37266.log.gz 2024-08-24T21:42:06.196 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32016.log 2024-08-24T21:42:06.197 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30777.log 2024-08-24T21:42:06.198 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.32016.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32016.log.gz 2024-08-24T21:42:06.199 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.30777.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30777.log.gz 2024-08-24T21:42:06.200 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38781.log 2024-08-24T21:42:06.201 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43743.log 2024-08-24T21:42:06.202 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.38781.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38781.log.gz 2024-08-24T21:42:06.204 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35427.log 2024-08-24T21:42:06.204 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43743.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43743.log.gz 2024-08-24T21:42:06.205 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31512.log 2024-08-24T21:42:06.206 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.35427.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35427.log.gz 2024-08-24T21:42:06.207 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48354.log 2024-08-24T21:42:06.208 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.31512.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31512.log.gz 2024-08-24T21:42:06.208 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38991.log 2024-08-24T21:42:06.209 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.48354.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48354.log.gz 2024-08-24T21:42:06.210 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29101.log 2024-08-24T21:42:06.211 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.38991.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38991.log.gz 2024-08-24T21:42:06.211 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33209.log 2024-08-24T21:42:06.213 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.29101.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29101.log.gz 2024-08-24T21:42:06.213 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35217.log 2024-08-24T21:42:06.214 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.33209.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33209.log.gz 2024-08-24T21:42:06.215 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42675.log 2024-08-24T21:42:06.216 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.35217.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35217.log.gz 2024-08-24T21:42:06.217 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37732.log 2024-08-24T21:42:06.217 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42675.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42675.log.gz 2024-08-24T21:42:06.218 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36384.log 2024-08-24T21:42:06.219 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.37732.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37732.log.gz 2024-08-24T21:42:06.220 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22900.log 2024-08-24T21:42:06.221 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.36384.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36384.log.gz 2024-08-24T21:42:06.222 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28371.log 2024-08-24T21:42:06.223 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.22900.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22900.log.gz 2024-08-24T21:42:06.224 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29903.log 2024-08-24T21:42:06.224 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.28371.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28371.log.gz 2024-08-24T21:42:06.225 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45440.log 2024-08-24T21:42:06.226 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.29903.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29903.log.gz 2024-08-24T21:42:06.227 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31845.log 2024-08-24T21:42:06.228 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.45440.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45440.log.gz 2024-08-24T21:42:06.228 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36552.log 2024-08-24T21:42:06.230 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.31845.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31845.log.gz 2024-08-24T21:42:06.231 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22914.log 2024-08-24T21:42:06.231 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.36552.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36552.log.gz 2024-08-24T21:42:06.232 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29989.log 2024-08-24T21:42:06.233 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.22914.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22914.log.gz 2024-08-24T21:42:06.234 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26841.log 2024-08-24T21:42:06.234 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.29989.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29989.log.gz 2024-08-24T21:42:06.235 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38865.log 2024-08-24T21:42:06.236 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.26841.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26841.log.gz 2024-08-24T21:42:06.237 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42529.log 2024-08-24T21:42:06.238 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.38865.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38865.log.gz 2024-08-24T21:42:06.239 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46609.log 2024-08-24T21:42:06.240 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42529.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42529.log.gz 2024-08-24T21:42:06.241 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32142.log 2024-08-24T21:42:06.241 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46609.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46609.log.gz 2024-08-24T21:42:06.242 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32647.log 2024-08-24T21:42:06.243 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.32142.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32142.log.gz 2024-08-24T21:42:06.244 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23163.log 2024-08-24T21:42:06.245 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.32647.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32647.log.gz 2024-08-24T21:42:06.246 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43575.log 2024-08-24T21:42:06.246 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.23163.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23163.log.gz 2024-08-24T21:42:06.248 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18575.log 2024-08-24T21:42:06.248 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43575.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43575.log.gz 2024-08-24T21:42:06.249 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45061.log 2024-08-24T21:42:06.250 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.18575.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18575.log.gz 2024-08-24T21:42:06.251 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47177.log 2024-08-24T21:42:06.251 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.45061.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45061.log.gz 2024-08-24T21:42:06.252 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47891.log 2024-08-24T21:42:06.254 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.47177.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47177.log.gz 2024-08-24T21:42:06.254 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39117.log 2024-08-24T21:42:06.255 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.47891.log: 91.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-08-24T21:42:06.255 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47891.log.gz 2024-08-24T21:42:06.256 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45920.log 2024-08-24T21:42:06.256 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.39117.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39117.log.gz 2024-08-24T21:42:06.257 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40284.log 2024-08-24T21:42:06.258 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.45920.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45920.log.gz 2024-08-24T21:42:06.258 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34149.log 2024-08-24T21:42:06.259 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.40284.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40284.log.gz 2024-08-24T21:42:06.260 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24641.log 2024-08-24T21:42:06.260 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.34149.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34149.log.gz 2024-08-24T21:42:06.261 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36177.log 2024-08-24T21:42:06.261 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.24641.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24641.log.gz 2024-08-24T21:42:06.262 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41377.log 2024-08-24T21:42:06.263 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.36177.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36177.log.gz 2024-08-24T21:42:06.264 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32773.log 2024-08-24T21:42:06.264 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.41377.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41377.log.gz 2024-08-24T21:42:06.265 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30903.log 2024-08-24T21:42:06.265 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.32773.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32773.log.gz 2024-08-24T21:42:06.266 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31071.log 2024-08-24T21:42:06.266 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.30903.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30903.log.gz 2024-08-24T21:42:06.267 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38214.log 2024-08-24T21:42:06.268 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.31071.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31071.log.gz 2024-08-24T21:42:06.268 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30598.log 2024-08-24T21:42:06.269 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.38214.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38214.log.gz 2024-08-24T21:42:06.270 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27992.log 2024-08-24T21:42:06.270 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.30598.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30598.log.gz 2024-08-24T21:42:06.271 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34359.log 2024-08-24T21:42:06.272 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.27992.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27992.log.gz 2024-08-24T21:42:06.272 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23252.log 2024-08-24T21:42:06.273 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.34359.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30199.log 2024-08-24T21:42:06.273 INFO:teuthology.orchestra.run.smithi060.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34359.log.gz 2024-08-24T21:42:06.274 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.23252.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23252.log.gz 2024-08-24T21:42:06.274 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41419.log 2024-08-24T21:42:06.276 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37904.log 2024-08-24T21:42:06.276 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.30199.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30199.log.gz 2024-08-24T21:42:06.277 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.41419.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41419.log.gz 2024-08-24T21:42:06.277 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24331.log 2024-08-24T21:42:06.278 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.37904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27740.log 2024-08-24T21:42:06.278 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37904.log.gz 2024-08-24T21:42:06.279 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.24331.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24331.log.gz 2024-08-24T21:42:06.279 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35049.log 2024-08-24T21:42:06.280 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.27740.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27740.log.gz 2024-08-24T21:42:06.281 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28623.log 2024-08-24T21:42:06.281 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.35049.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35049.log.gz 2024-08-24T21:42:06.282 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42803.log 2024-08-24T21:42:06.283 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.28623.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28623.log.gz 2024-08-24T21:42:06.283 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43701.log 2024-08-24T21:42:06.284 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42803.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42803.log.gz 2024-08-24T21:42:06.285 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43701.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43701.log.gz 2024-08-24T21:42:06.296 INFO:teuthology.orchestra.run.smithi119.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-08-24T21:42:07.348 INFO:teuthology.orchestra.run.smithi060.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-08-24T21:42:08.976 INFO:teuthology.orchestra.run.smithi060.stderr: 95.2% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-08-24T21:42:11.934 INFO:teuthology.orchestra.run.smithi060.stderr: 95.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-08-24T21:42:18.937 INFO:teuthology.orchestra.run.smithi119.stderr: 95.1% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-08-24T21:42:23.273 INFO:teuthology.orchestra.run.smithi060.stderr: 95.2% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-08-24T21:42:24.480 INFO:teuthology.orchestra.run.smithi119.stderr: 95.2% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-08-24T21:42:31.427 INFO:teuthology.orchestra.run.smithi060.stderr: 94.7% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-08-24T21:42:31.430 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-08-24T21:42:31.430 INFO:teuthology.orchestra.run.smithi060.stderr:real 0m25.855s 2024-08-24T21:42:31.430 INFO:teuthology.orchestra.run.smithi060.stderr:user 0m49.615s 2024-08-24T21:42:31.430 INFO:teuthology.orchestra.run.smithi060.stderr:sys 0m5.847s 2024-08-24T21:42:33.352 INFO:teuthology.orchestra.run.smithi119.stderr: 94.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-08-24T21:42:33.355 INFO:teuthology.orchestra.run.smithi119.stderr: 2024-08-24T21:42:33.355 INFO:teuthology.orchestra.run.smithi119.stderr:real 0m27.770s 2024-08-24T21:42:33.355 INFO:teuthology.orchestra.run.smithi119.stderr:user 0m55.972s 2024-08-24T21:42:33.356 INFO:teuthology.orchestra.run.smithi119.stderr:sys 0m5.368s 2024-08-24T21:42:33.357 INFO:tasks.ceph:Archiving logs... 2024-08-24T21:42:33.357 DEBUG:teuthology.misc:Transferring archived files from smithi060:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-08-17_20:48:17-krbd-main-testing-default-smithi/7858438/remote/smithi060/log 2024-08-24T21:42:33.358 DEBUG:teuthology.orchestra.run.smithi060:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-24T21:42:39.979 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-08-17_20:48:17-krbd-main-testing-default-smithi/7858438/remote/smithi119/log 2024-08-24T21:42:39.980 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-24T21:42:47.219 DEBUG:teuthology.misc:Transferring archived files from smithi179:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-08-17_20:48:17-krbd-main-testing-default-smithi/7858438/remote/smithi179/log 2024-08-24T21:42:47.220 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-24T21:42:47.637 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-08-24T21:42:47.671 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/task/install/__init__.py", line 641, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_797669399b32d2915e64eb6d4b1257ae3c50f80b/qa/tasks/mon_thrash.py", line 466, in task thrash_proc.stop_and_join() File "/home/teuthworker/src/git.ceph.com_ceph_797669399b32d2915e64eb6d4b1257ae3c50f80b/qa/tasks/mon_thrash.py", line 178, in stop_and_join return self.join() File "/home/teuthworker/src/git.ceph.com_ceph_797669399b32d2915e64eb6d4b1257ae3c50f80b/qa/tasks/mon_thrash.py", line 170, in join self.stopping.set() AttributeError: 'bool' object has no attribute 'set' 2024-08-24T21:42:47.672 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-08-24T21:42:47.672 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-24T21:42:47.677 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-24T21:42:47.682 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-24T21:42:47.810 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-08-24T21:42:47.990 INFO:teuthology.task.clock:Checking final clock skew... 2024-08-24T21:42:47.990 DEBUG:teuthology.orchestra.run.smithi060:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-24T21:42:47.995 DEBUG:teuthology.orchestra.run.smithi119:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-24T21:42:48.000 DEBUG:teuthology.orchestra.run.smithi179:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-24T21:42:48.027 INFO:teuthology.orchestra.run.smithi060.stderr:bash: line 1: ntpq: command not found 2024-08-24T21:42:48.032 INFO:teuthology.orchestra.run.smithi119.stderr:bash: line 1: ntpq: command not found 2024-08-24T21:42:48.035 INFO:teuthology.orchestra.run.smithi179.stderr:bash: line 1: ntpq: command not found 2024-08-24T21:42:48.036 INFO:teuthology.orchestra.run.smithi060.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-24T21:42:48.036 INFO:teuthology.orchestra.run.smithi060.stdout:=============================================================================== 2024-08-24T21:42:48.036 INFO:teuthology.orchestra.run.smithi060.stdout:^* hv01.front.sepia.ceph.com 3 6 377 18 -42us[ -56us] +/- 36ms 2024-08-24T21:42:48.036 INFO:teuthology.orchestra.run.smithi060.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 21 -640us[ -654us] +/- 74ms 2024-08-24T21:42:48.036 INFO:teuthology.orchestra.run.smithi060.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 21 +744us[ +730us] +/- 73ms 2024-08-24T21:42:48.036 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-08-24T21:42:48.039 INFO:teuthology.orchestra.run.smithi119.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-24T21:42:48.039 INFO:teuthology.orchestra.run.smithi119.stdout:=============================================================================== 2024-08-24T21:42:48.040 INFO:teuthology.orchestra.run.smithi119.stdout:^* hv01.front.sepia.ceph.com 3 6 377 25 -52us[ -61us] +/- 36ms 2024-08-24T21:42:48.040 INFO:teuthology.orchestra.run.smithi119.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 20 -667us[ -667us] +/- 74ms 2024-08-24T21:42:48.040 INFO:teuthology.orchestra.run.smithi119.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 20 +730us[ +730us] +/- 73ms 2024-08-24T21:42:48.040 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-08-24T21:42:48.042 INFO:teuthology.orchestra.run.smithi179.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-24T21:42:48.043 INFO:teuthology.orchestra.run.smithi179.stdout:=============================================================================== 2024-08-24T21:42:48.043 INFO:teuthology.orchestra.run.smithi179.stdout:^* hv01.front.sepia.ceph.com 3 6 377 21 -7141ns[-7064ns] +/- 36ms 2024-08-24T21:42:48.043 INFO:teuthology.orchestra.run.smithi179.stdout:^+ hv02.front.sepia.ceph.com 3 7 377 88 -598us[ -600us] +/- 73ms 2024-08-24T21:42:48.043 INFO:teuthology.orchestra.run.smithi179.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 89 +779us[ +777us] +/- 72ms 2024-08-24T21:42:48.043 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-08-24T21:42:48.044 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-08-24T21:42:48.141 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-08-24T21:42:48.142 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-08-24T21:42:48.163 DEBUG:teuthology.orchestra.run.smithi060:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-24T21:42:48.279 DEBUG:teuthology.orchestra.run.smithi119:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-24T21:42:48.379 DEBUG:teuthology.orchestra.run.smithi179:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-24T21:42:48.477 DEBUG:teuthology.orchestra.run.smithi060:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-24T21:42:48.538 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-24T21:42:48.539 DEBUG:teuthology.orchestra.run.smithi119:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-24T21:42:48.599 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-24T21:42:48.599 DEBUG:teuthology.orchestra.run.smithi179:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-24T21:42:48.658 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-24T21:42:48.659 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-08-24T21:42:48.667 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-08-24T21:42:48.697 INFO:teuthology.task.internal:Duration was 2228.882488 seconds 2024-08-24T21:42:48.697 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-08-24T21:42:48.749 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-08-24T21:42:48.749 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-24T21:42:48.754 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-24T21:42:48.758 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-24T21:42:48.839 INFO:teuthology.orchestra.run.smithi060.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-24T21:42:48.842 INFO:teuthology.orchestra.run.smithi119.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-24T21:42:48.845 INFO:teuthology.orchestra.run.smithi179.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-24T21:42:49.306 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-08-24T21:42:49.306 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi060.front.sepia.ceph.com 2024-08-24T21:42:49.306 DEBUG:teuthology.orchestra.run.smithi060:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-24T21:42:49.356 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi119.front.sepia.ceph.com 2024-08-24T21:42:49.356 DEBUG:teuthology.orchestra.run.smithi119:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-24T21:42:49.411 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi179.front.sepia.ceph.com 2024-08-24T21:42:49.411 DEBUG:teuthology.orchestra.run.smithi179:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-24T21:42:49.465 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-08-24T21:42:49.465 DEBUG:teuthology.orchestra.run.smithi060:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-24T21:42:49.470 DEBUG:teuthology.orchestra.run.smithi119:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-24T21:42:49.474 DEBUG:teuthology.orchestra.run.smithi179:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-24T21:42:49.532 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-08-24T21:42:49.532 DEBUG:teuthology.orchestra.run.smithi060:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-24T21:42:49.536 DEBUG:teuthology.orchestra.run.smithi119:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-24T21:42:49.540 DEBUG:teuthology.orchestra.run.smithi179:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-24T21:42:49.657 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-08-24T21:42:49.669 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-08-24T21:42:49.670 DEBUG:teuthology.orchestra.run.smithi060:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-24T21:42:49.725 DEBUG:teuthology.orchestra.run.smithi119:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-24T21:42:49.782 DEBUG:teuthology.orchestra.run.smithi179:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-24T21:42:49.837 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-08-24T21:42:49.848 DEBUG:teuthology.orchestra.run.smithi060:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-24T21:42:49.852 DEBUG:teuthology.orchestra.run.smithi119:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-24T21:42:49.856 DEBUG:teuthology.orchestra.run.smithi179:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-24T21:42:49.919 INFO:teuthology.orchestra.run.smithi060.stdout:kernel.core_pattern = core 2024-08-24T21:42:49.922 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern = core 2024-08-24T21:42:49.926 INFO:teuthology.orchestra.run.smithi179.stdout:kernel.core_pattern = core 2024-08-24T21:42:49.966 DEBUG:teuthology.orchestra.run.smithi060:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-24T21:42:49.999 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-24T21:42:50.000 DEBUG:teuthology.orchestra.run.smithi119:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-24T21:42:50.032 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-24T21:42:50.033 DEBUG:teuthology.orchestra.run.smithi179:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-24T21:42:50.066 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-24T21:42:50.067 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-08-24T21:42:50.077 INFO:teuthology.task.internal:Transferring archived files... 2024-08-24T21:42:50.077 DEBUG:teuthology.misc:Transferring archived files from smithi060:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-08-17_20:48:17-krbd-main-testing-default-smithi/7858438/remote/smithi060 2024-08-24T21:42:50.078 DEBUG:teuthology.orchestra.run.smithi060:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-24T21:42:50.141 DEBUG:teuthology.misc:Transferring archived files from smithi119:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-08-17_20:48:17-krbd-main-testing-default-smithi/7858438/remote/smithi119 2024-08-24T21:42:50.141 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-24T21:42:50.201 DEBUG:teuthology.misc:Transferring archived files from smithi179:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-08-17_20:48:17-krbd-main-testing-default-smithi/7858438/remote/smithi179 2024-08-24T21:42:50.201 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-24T21:42:50.260 INFO:teuthology.task.internal:Removing archive directory... 2024-08-24T21:42:50.260 DEBUG:teuthology.orchestra.run.smithi060:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-24T21:42:50.264 DEBUG:teuthology.orchestra.run.smithi119:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-24T21:42:50.268 DEBUG:teuthology.orchestra.run.smithi179:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-24T21:42:50.302 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-08-24T21:42:50.314 INFO:teuthology.task.internal:Not uploading archives. 2024-08-24T21:42:50.315 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-08-24T21:42:50.348 INFO:teuthology.task.internal:Tidying up after the test... 2024-08-24T21:42:50.348 DEBUG:teuthology.orchestra.run.smithi060:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-24T21:42:50.352 DEBUG:teuthology.orchestra.run.smithi119:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-24T21:42:50.356 DEBUG:teuthology.orchestra.run.smithi179:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-24T21:42:50.384 INFO:teuthology.orchestra.run.smithi060.stdout: 393233 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 24 21:42 /home/ubuntu/cephtest 2024-08-24T21:42:50.386 INFO:teuthology.orchestra.run.smithi119.stdout: 393233 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 24 21:42 /home/ubuntu/cephtest 2024-08-24T21:42:50.390 INFO:teuthology.orchestra.run.smithi179.stdout: 393233 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 24 21:42 /home/ubuntu/cephtest 2024-08-24T21:42:50.393 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-08-24T21:42:50.403 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-08-24T21:42:50.454 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: AttributeError: 'bool' object has no attribute 'set' 2024-08-24T21:42:50.460 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 description: krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{crc-rxbounce} thrashers/mon-thrasher thrashosds-health workloads/krbd_diff_continuous} duration: 2228.882488012314 failure_reason: '''bool'' object has no attribute ''set''' flavor: default mon.a-kernel-sha1: 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 mon.b-kernel-sha1: 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 owner: scheduled_teuthology@teuthology status: fail success: false 2024-08-24T21:42:50.460 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-24T21:42:50.581 INFO:teuthology.run:FAIL